Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kvm-unit-tests/20250624.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bullseye/20240129.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-h26forge/20250117.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-fault-injection/20250520.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' 2025-09-27 00:18:39,686 - lava_callback - INFO - Received callback for node 68d535c9b70fb2a1e20f2216 2025-09-27 00:18:39,693 - lava_callback - INFO - Starting async job submit for node 68d535c9b70fb2a1e20f2216 INFO: 172.21.0.1:60280 - "POST /node/68d535c9b70fb2a1e20f2216 HTTP/1.0" 202 Accepted 2025-09-27 00:18:39,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:18:39,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535c9b70fb2a1e20f2216 HTTP/1.1" 502 150 2025-09-27 00:18:39,728 - urllib3.util.retry - DEBUG - Incremented Retry for (url='/latest/node/68d535c9b70fb2a1e20f2216'): Retry(total=4, connect=None, read=None, redirect=None, status=None) 2025-09-27 00:18:39,728 - urllib3.connectionpool - DEBUG - Retry: /latest/node/68d535c9b70fb2a1e20f2216 2025-09-27 00:18:39,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535c9b70fb2a1e20f2216 HTTP/1.1" 502 150 2025-09-27 00:18:39,729 - urllib3.util.retry - DEBUG - Incremented Retry for (url='/latest/node/68d535c9b70fb2a1e20f2216'): Retry(total=3, connect=None, read=None, redirect=None, status=None) 2025-09-27 00:18:41,729 - urllib3.connectionpool - DEBUG - Retry: /latest/node/68d535c9b70fb2a1e20f2216 2025-09-27 00:18:41,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535c9b70fb2a1e20f2216 HTTP/1.1" 200 None 2025-09-27 00:18:41,736 - lava_callback - DEBUG - Processing node 68d535c9b70fb2a1e20f2216: baseline-arm 2025-09-27 00:18:41,963 - lava_callback - ERROR - Error processing callback for node 68d535c9b70fb2a1e20f2216: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:18:44,269 - lava_callback - INFO - Received callback for node 68d4c870a5c2c05277bd02df INFO: 172.21.0.1:60284 - "POST /node/68d4c870a5c2c05277bd02df HTTP/1.0" 202 Accepted 2025-09-27 00:18:44,276 - lava_callback - INFO - Starting async job submit for node 68d4c870a5c2c05277bd02df 2025-09-27 00:18:44,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:18:44,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c870a5c2c05277bd02df HTTP/1.1" 200 None 2025-09-27 00:18:44,314 - lava_callback - DEBUG - Processing node 68d4c870a5c2c05277bd02df: baseline-arm64 2025-09-27 00:18:44,651 - lava_callback - ERROR - Error processing callback for node 68d4c870a5c2c05277bd02df: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:18:55,483 - lava_callback - INFO - Received callback for node 68d4c871a5c2c05277bd02e2 INFO: 172.21.0.1:34866 - "POST /node/68d4c871a5c2c05277bd02e2 HTTP/1.0" 202 Accepted 2025-09-27 00:18:55,489 - lava_callback - INFO - Starting async job submit for node 68d4c871a5c2c05277bd02e2 2025-09-27 00:18:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:18:55,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c871a5c2c05277bd02e2 HTTP/1.1" 200 None 2025-09-27 00:18:55,522 - lava_callback - DEBUG - Processing node 68d4c871a5c2c05277bd02e2: baseline-arm64 2025-09-27 00:18:55,872 - lava_callback - ERROR - Error processing callback for node 68d4c871a5c2c05277bd02e2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:19:38,638 - lava_callback - INFO - Received callback for node 68d4c874a5c2c05277bd02e5 INFO: 172.21.0.1:41466 - "POST /node/68d4c874a5c2c05277bd02e5 HTTP/1.0" 202 Accepted 2025-09-27 00:19:38,650 - lava_callback - INFO - Starting async job submit for node 68d4c874a5c2c05277bd02e5 2025-09-27 00:19:38,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:19:38,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c874a5c2c05277bd02e5 HTTP/1.1" 200 None 2025-09-27 00:19:38,894 - lava_callback - DEBUG - Processing node 68d4c874a5c2c05277bd02e5: baseline-arm64 2025-09-27 00:19:39,455 - lava_callback - ERROR - Error processing callback for node 68d4c874a5c2c05277bd02e5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:19:44,497 - lava_callback - INFO - Received callback for node 68d4c874a5c2c05277bd02e8 INFO: 172.21.0.1:46668 - "POST /node/68d4c874a5c2c05277bd02e8 HTTP/1.0" 202 Accepted 2025-09-27 00:19:44,504 - lava_callback - INFO - Starting async job submit for node 68d4c874a5c2c05277bd02e8 2025-09-27 00:19:44,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:19:44,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c874a5c2c05277bd02e8 HTTP/1.1" 200 None 2025-09-27 00:19:44,562 - lava_callback - DEBUG - Processing node 68d4c874a5c2c05277bd02e8: baseline-arm64 2025-09-27 00:19:44,940 - lava_callback - ERROR - Error processing callback for node 68d4c874a5c2c05277bd02e8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:20:17,358 - lava_callback - INFO - Received callback for node 68d4c9c1a5c2c05277bd040c INFO: 172.21.0.1:46180 - "POST /node/68d4c9c1a5c2c05277bd040c HTTP/1.0" 202 Accepted 2025-09-27 00:20:17,365 - lava_callback - INFO - Starting async job submit for node 68d4c9c1a5c2c05277bd040c 2025-09-27 00:20:17,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:20:17,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c9c1a5c2c05277bd040c HTTP/1.1" 200 None 2025-09-27 00:20:17,405 - lava_callback - DEBUG - Processing node 68d4c9c1a5c2c05277bd040c: baseline-arm64 2025-09-27 00:20:17,692 - lava_callback - ERROR - Error processing callback for node 68d4c9c1a5c2c05277bd040c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:20:23,708 - lava_callback - INFO - Received callback for node 68d4867da5c2c05277bcd770 INFO: 172.21.0.1:55154 - "POST /node/68d4867da5c2c05277bcd770 HTTP/1.0" 202 Accepted 2025-09-27 00:20:23,714 - lava_callback - INFO - Starting async job submit for node 68d4867da5c2c05277bcd770 2025-09-27 00:20:23,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:20:23,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4867da5c2c05277bcd770 HTTP/1.1" 200 None 2025-09-27 00:20:23,759 - lava_callback - DEBUG - Processing node 68d4867da5c2c05277bcd770: baseline-arm 2025-09-27 00:20:24,050 - lava_callback - ERROR - Error processing callback for node 68d4867da5c2c05277bcd770: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:20:29,147 - lava_callback - INFO - Received callback for node 68d48c0fa5c2c05277bce579 INFO: 172.21.0.1:55170 - "POST /node/68d48c0fa5c2c05277bce579 HTTP/1.0" 202 Accepted 2025-09-27 00:20:29,160 - lava_callback - INFO - Starting async job submit for node 68d48c0fa5c2c05277bce579 2025-09-27 00:20:29,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:20:29,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c0fa5c2c05277bce579 HTTP/1.1" 200 None 2025-09-27 00:20:29,376 - lava_callback - DEBUG - Processing node 68d48c0fa5c2c05277bce579: ltp-containers 2025-09-27 00:20:30,231 - lava_callback - ERROR - Error processing callback for node 68d48c0fa5c2c05277bce579: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:20:38,417 - lava_callback - INFO - Received callback for node 68d535cab70fb2a1e20f2219 INFO: 172.21.0.1:49098 - "POST /node/68d535cab70fb2a1e20f2219 HTTP/1.0" 202 Accepted 2025-09-27 00:20:38,423 - lava_callback - INFO - Starting async job submit for node 68d535cab70fb2a1e20f2219 2025-09-27 00:20:38,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:20:38,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535cab70fb2a1e20f2219 HTTP/1.1" 200 None 2025-09-27 00:20:38,456 - lava_callback - DEBUG - Processing node 68d535cab70fb2a1e20f2219: baseline-arm 2025-09-27 00:20:38,681 - lava_callback - ERROR - Error processing callback for node 68d535cab70fb2a1e20f2219: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:20:47,021 - lava_callback - INFO - Received callback for node 68d4c9c5a5c2c05277bd0412 INFO: 172.21.0.1:58508 - "POST /node/68d4c9c5a5c2c05277bd0412 HTTP/1.0" 202 Accepted 2025-09-27 00:20:47,029 - lava_callback - INFO - Starting async job submit for node 68d4c9c5a5c2c05277bd0412 2025-09-27 00:20:47,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:20:47,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c9c5a5c2c05277bd0412 HTTP/1.1" 200 None 2025-09-27 00:20:47,070 - lava_callback - DEBUG - Processing node 68d4c9c5a5c2c05277bd0412: baseline-arm64 2025-09-27 00:20:48,269 - lava_callback - ERROR - Error processing callback for node 68d4c9c5a5c2c05277bd0412: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:20:54,530 - lava_callback - INFO - Received callback for node 68d4c9c2a5c2c05277bd040f INFO: 172.21.0.1:35652 - "POST /node/68d4c9c2a5c2c05277bd040f HTTP/1.0" 202 Accepted 2025-09-27 00:20:54,536 - lava_callback - INFO - Starting async job submit for node 68d4c9c2a5c2c05277bd040f 2025-09-27 00:20:54,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:20:54,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c9c2a5c2c05277bd040f HTTP/1.1" 200 None 2025-09-27 00:20:54,584 - lava_callback - DEBUG - Processing node 68d4c9c2a5c2c05277bd040f: baseline-arm64 2025-09-27 00:20:54,919 - lava_callback - ERROR - Error processing callback for node 68d4c9c2a5c2c05277bd040f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36308 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:21:35,487 - lava_callback - INFO - Received callback for node 68d72dafa6a7b6615d4c4140 INFO: 172.21.0.1:43886 - "POST /node/68d72dafa6a7b6615d4c4140 HTTP/1.0" 202 Accepted 2025-09-27 00:21:35,496 - lava_callback - INFO - Starting async job submit for node 68d72dafa6a7b6615d4c4140 2025-09-27 00:21:35,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:21:35,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72dafa6a7b6615d4c4140 HTTP/1.1" 200 None 2025-09-27 00:21:35,531 - lava_callback - DEBUG - Processing node 68d72dafa6a7b6615d4c4140: baseline-riscv-collabora 2025-09-27 00:21:35,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:21:35,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:21:35,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d72dafa6a7b6615d4c4140/log.txt.gz 2025-09-27 00:21:35,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:21:36,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:21:36,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d72dafa6a7b6615d4c4140/lava_callback.json.gz 2025-09-27 00:21:36,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:21:36,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72dafa6a7b6615d4c4140 HTTP/1.1" 200 None 2025-09-27 00:21:36,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:21:36,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a453c94e462c68828bc HTTP/1.1" 200 None 2025-09-27 00:21:36,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:21:36,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72dafa6a7b6615d4c4140 HTTP/1.1" 200 None 2025-09-27 00:21:36,107 - lava_callback - INFO - Completed processing callback for node 68d72dafa6a7b6615d4c4140 INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:21:37,616 - lava_callback - INFO - Received callback for node 68d4c9c5a5c2c05277bd0415 INFO: 172.21.0.1:43904 - "POST /node/68d4c9c5a5c2c05277bd0415 HTTP/1.0" 202 Accepted 2025-09-27 00:21:37,622 - lava_callback - INFO - Starting async job submit for node 68d4c9c5a5c2c05277bd0415 2025-09-27 00:21:37,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:21:37,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c9c5a5c2c05277bd0415 HTTP/1.1" 200 None 2025-09-27 00:21:37,657 - lava_callback - DEBUG - Processing node 68d4c9c5a5c2c05277bd0415: baseline-arm64 2025-09-27 00:21:38,009 - lava_callback - ERROR - Error processing callback for node 68d4c9c5a5c2c05277bd0415: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:22:09,836 - lava_callback - INFO - Received callback for node 68d72daea6a7b6615d4c413d INFO: 172.21.0.1:55196 - "POST /node/68d72daea6a7b6615d4c413d HTTP/1.0" 202 Accepted 2025-09-27 00:22:09,842 - lava_callback - INFO - Starting async job submit for node 68d72daea6a7b6615d4c413d 2025-09-27 00:22:09,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:22:09,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72daea6a7b6615d4c413d HTTP/1.1" 200 None 2025-09-27 00:22:09,882 - lava_callback - DEBUG - Processing node 68d72daea6a7b6615d4c413d: baseline-riscv-broonie 2025-09-27 00:22:10,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:22:10,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:22:10,232 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d72daea6a7b6615d4c413d/log.txt.gz 2025-09-27 00:22:10,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:22:10,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:22:10,371 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d72daea6a7b6615d4c413d/lava_callback.json.gz 2025-09-27 00:22:10,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:22:10,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72daea6a7b6615d4c413d HTTP/1.1" 200 None 2025-09-27 00:22:10,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:22:10,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a453c94e462c68828bc HTTP/1.1" 200 None 2025-09-27 00:22:10,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:22:10,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72daea6a7b6615d4c413d HTTP/1.1" 200 None 2025-09-27 00:22:10,447 - lava_callback - INFO - Completed processing callback for node 68d72daea6a7b6615d4c413d 2025-09-27 00:22:14,521 - lava_callback - INFO - Received callback for node 68d4c9c8a5c2c05277bd0418 INFO: 172.21.0.1:55210 - "POST /node/68d4c9c8a5c2c05277bd0418 HTTP/1.0" 202 Accepted 2025-09-27 00:22:14,527 - lava_callback - INFO - Starting async job submit for node 68d4c9c8a5c2c05277bd0418 2025-09-27 00:22:14,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:22:14,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c9c8a5c2c05277bd0418 HTTP/1.1" 200 None 2025-09-27 00:22:14,561 - lava_callback - DEBUG - Processing node 68d4c9c8a5c2c05277bd0418: baseline-arm64 2025-09-27 00:22:14,863 - lava_callback - ERROR - Error processing callback for node 68d4c9c8a5c2c05277bd0418: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:22:24,068 - lava_callback - INFO - Received callback for node 68d4c9c8a5c2c05277bd041b INFO: 172.21.0.1:46278 - "POST /node/68d4c9c8a5c2c05277bd041b HTTP/1.0" 202 Accepted 2025-09-27 00:22:24,075 - lava_callback - INFO - Starting async job submit for node 68d4c9c8a5c2c05277bd041b 2025-09-27 00:22:24,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:22:24,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c9c8a5c2c05277bd041b HTTP/1.1" 200 None 2025-09-27 00:22:24,109 - lava_callback - DEBUG - Processing node 68d4c9c8a5c2c05277bd041b: baseline-arm64 2025-09-27 00:22:24,433 - lava_callback - ERROR - Error processing callback for node 68d4c9c8a5c2c05277bd041b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:22:42,389 - lava_callback - INFO - Received callback for node 68d535cbb70fb2a1e20f221c INFO: 172.21.0.1:59610 - "POST /node/68d535cbb70fb2a1e20f221c HTTP/1.0" 202 Accepted 2025-09-27 00:22:42,399 - lava_callback - INFO - Starting async job submit for node 68d535cbb70fb2a1e20f221c 2025-09-27 00:22:42,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:22:42,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535cbb70fb2a1e20f221c HTTP/1.1" 200 None 2025-09-27 00:22:42,464 - lava_callback - DEBUG - Processing node 68d535cbb70fb2a1e20f221c: baseline-arm 2025-09-27 00:22:42,861 - lava_callback - ERROR - Error processing callback for node 68d535cbb70fb2a1e20f221c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:22:55,030 - lava_callback - INFO - Received callback for node 68d4c9cba5c2c05277bd041e INFO: 172.21.0.1:51664 - "POST /node/68d4c9cba5c2c05277bd041e HTTP/1.0" 202 Accepted 2025-09-27 00:22:55,041 - lava_callback - INFO - Starting async job submit for node 68d4c9cba5c2c05277bd041e 2025-09-27 00:22:55,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:22:55,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c9cba5c2c05277bd041e HTTP/1.1" 200 None 2025-09-27 00:22:55,098 - lava_callback - DEBUG - Processing node 68d4c9cba5c2c05277bd041e: baseline-arm64 2025-09-27 00:22:55,600 - lava_callback - ERROR - Error processing callback for node 68d4c9cba5c2c05277bd041e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:23:24,513 - lava_callback - INFO - Received callback for node 68d4ca52a5c2c05277bd0508 INFO: 172.21.0.1:49808 - "POST /node/68d4ca52a5c2c05277bd0508 HTTP/1.0" 202 Accepted 2025-09-27 00:23:24,521 - lava_callback - INFO - Starting async job submit for node 68d4ca52a5c2c05277bd0508 2025-09-27 00:23:24,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:23:24,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ca52a5c2c05277bd0508 HTTP/1.1" 200 None 2025-09-27 00:23:24,556 - lava_callback - DEBUG - Processing node 68d4ca52a5c2c05277bd0508: baseline-arm64 2025-09-27 00:23:25,401 - lava_callback - ERROR - Error processing callback for node 68d4ca52a5c2c05277bd0508: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:23:37,002 - lava_callback - INFO - Received callback for node 68d4c9cca5c2c05277bd0421 INFO: 172.21.0.1:39304 - "POST /node/68d4c9cca5c2c05277bd0421 HTTP/1.0" 202 Accepted 2025-09-27 00:23:37,008 - lava_callback - INFO - Starting async job submit for node 68d4c9cca5c2c05277bd0421 2025-09-27 00:23:37,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:23:37,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c9cca5c2c05277bd0421 HTTP/1.1" 200 None 2025-09-27 00:23:37,042 - lava_callback - DEBUG - Processing node 68d4c9cca5c2c05277bd0421: baseline-arm64 2025-09-27 00:23:37,364 - lava_callback - ERROR - Error processing callback for node 68d4c9cca5c2c05277bd0421: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:24:17,657 - lava_callback - INFO - Received callback for node 68d4ca53a5c2c05277bd050b INFO: 172.21.0.1:42822 - "POST /node/68d4ca53a5c2c05277bd050b HTTP/1.0" 202 Accepted 2025-09-27 00:24:17,663 - lava_callback - INFO - Starting async job submit for node 68d4ca53a5c2c05277bd050b 2025-09-27 00:24:17,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:24:17,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ca53a5c2c05277bd050b HTTP/1.1" 200 None 2025-09-27 00:24:17,718 - lava_callback - DEBUG - Processing node 68d4ca53a5c2c05277bd050b: baseline-arm64 2025-09-27 00:24:18,014 - lava_callback - ERROR - Error processing callback for node 68d4ca53a5c2c05277bd050b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:24:26,217 - lava_callback - INFO - Received callback for node 68d4ca55a5c2c05277bd050e INFO: 172.21.0.1:41786 - "POST /node/68d4ca55a5c2c05277bd050e HTTP/1.0" 202 Accepted 2025-09-27 00:24:26,227 - lava_callback - INFO - Starting async job submit for node 68d4ca55a5c2c05277bd050e 2025-09-27 00:24:26,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:24:26,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ca55a5c2c05277bd050e HTTP/1.1" 200 None 2025-09-27 00:24:26,305 - lava_callback - DEBUG - Processing node 68d4ca55a5c2c05277bd050e: baseline-arm64 INFO: 172.21.0.1:41800 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:24:26,813 - lava_callback - ERROR - Error processing callback for node 68d4ca55a5c2c05277bd050e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:24:39,873 - lava_callback - INFO - Received callback for node 68d535cdb70fb2a1e20f221f INFO: 172.21.0.1:52918 - "POST /node/68d535cdb70fb2a1e20f221f HTTP/1.0" 202 Accepted 2025-09-27 00:24:39,879 - lava_callback - INFO - Starting async job submit for node 68d535cdb70fb2a1e20f221f 2025-09-27 00:24:39,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:24:39,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535cdb70fb2a1e20f221f HTTP/1.1" 200 None 2025-09-27 00:24:39,939 - lava_callback - DEBUG - Processing node 68d535cdb70fb2a1e20f221f: baseline-arm 2025-09-27 00:24:40,181 - lava_callback - ERROR - Error processing callback for node 68d535cdb70fb2a1e20f221f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:24:55,211 - lava_callback - INFO - Received callback for node 68d4ca56a5c2c05277bd0511 INFO: 172.21.0.1:47842 - "POST /node/68d4ca56a5c2c05277bd0511 HTTP/1.0" 202 Accepted 2025-09-27 00:24:55,217 - lava_callback - INFO - Starting async job submit for node 68d4ca56a5c2c05277bd0511 2025-09-27 00:24:55,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:24:55,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ca56a5c2c05277bd0511 HTTP/1.1" 200 None 2025-09-27 00:24:55,260 - lava_callback - DEBUG - Processing node 68d4ca56a5c2c05277bd0511: baseline-arm64 2025-09-27 00:24:55,552 - lava_callback - ERROR - Error processing callback for node 68d4ca56a5c2c05277bd0511: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:25:34,909 - lava_callback - INFO - Received callback for node 68d4ca5aa5c2c05277bd0514 INFO: 172.21.0.1:57394 - "POST /node/68d4ca5aa5c2c05277bd0514 HTTP/1.0" 202 Accepted 2025-09-27 00:25:34,927 - lava_callback - INFO - Starting async job submit for node 68d4ca5aa5c2c05277bd0514 2025-09-27 00:25:34,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:25:34,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ca5aa5c2c05277bd0514 HTTP/1.1" 200 None 2025-09-27 00:25:35,000 - lava_callback - DEBUG - Processing node 68d4ca5aa5c2c05277bd0514: baseline-arm64 2025-09-27 00:25:35,534 - lava_callback - ERROR - Error processing callback for node 68d4ca5aa5c2c05277bd0514: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:25:47,284 - lava_callback - INFO - Received callback for node 68d48bfca5c2c05277bce547 INFO: 172.21.0.1:45978 - "POST /node/68d48bfca5c2c05277bce547 HTTP/1.0" 202 Accepted 2025-09-27 00:25:47,292 - lava_callback - INFO - Starting async job submit for node 68d48bfca5c2c05277bce547 2025-09-27 00:25:47,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:25:47,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48bfca5c2c05277bce547 HTTP/1.1" 200 None 2025-09-27 00:25:47,313 - lava_callback - DEBUG - Processing node 68d48bfca5c2c05277bce547: baseline-arm 2025-09-27 00:25:47,313 - lava_callback - ERROR - Error processing callback for node 68d48bfca5c2c05277bce547: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:25:48,920 - lava_callback - INFO - Received callback for node 68d4ca5aa5c2c05277bd0517 INFO: 172.21.0.1:45990 - "POST /node/68d4ca5aa5c2c05277bd0517 HTTP/1.0" 202 Accepted 2025-09-27 00:25:48,931 - lava_callback - INFO - Starting async job submit for node 68d4ca5aa5c2c05277bd0517 2025-09-27 00:25:48,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:25:49,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ca5aa5c2c05277bd0517 HTTP/1.1" 200 None 2025-09-27 00:25:49,012 - lava_callback - DEBUG - Processing node 68d4ca5aa5c2c05277bd0517: baseline-arm64 2025-09-27 00:25:49,641 - lava_callback - ERROR - Error processing callback for node 68d4ca5aa5c2c05277bd0517: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:25:52,254 - lava_callback - INFO - Received callback for node 68d48c02a5c2c05277bce556 INFO: 172.21.0.1:53514 - "POST /node/68d48c02a5c2c05277bce556 HTTP/1.0" 202 Accepted 2025-09-27 00:25:52,263 - lava_callback - INFO - Starting async job submit for node 68d48c02a5c2c05277bce556 2025-09-27 00:25:52,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:25:52,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c02a5c2c05277bce556 HTTP/1.1" 200 None 2025-09-27 00:25:52,284 - lava_callback - DEBUG - Processing node 68d48c02a5c2c05277bce556: baseline-arm-broonie 2025-09-27 00:25:52,284 - lava_callback - ERROR - Error processing callback for node 68d48c02a5c2c05277bce556: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:26:12,145 - lava_callback - INFO - Received callback for node 68d48c12a5c2c05277bce58c INFO: 172.21.0.1:44346 - "POST /node/68d48c12a5c2c05277bce58c HTTP/1.0" 202 Accepted 2025-09-27 00:26:12,153 - lava_callback - INFO - Starting async job submit for node 68d48c12a5c2c05277bce58c 2025-09-27 00:26:12,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:12,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c12a5c2c05277bce58c HTTP/1.1" 200 None 2025-09-27 00:26:12,168 - lava_callback - DEBUG - Processing node 68d48c12a5c2c05277bce58c: ltp-fsx 2025-09-27 00:26:12,169 - lava_callback - ERROR - Error processing callback for node 68d48c12a5c2c05277bce58c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:26:12,901 - lava_callback - INFO - Received callback for node 68d48c13a5c2c05277bce58f INFO: 172.21.0.1:44352 - "POST /node/68d48c13a5c2c05277bce58f HTTP/1.0" 202 Accepted 2025-09-27 00:26:12,911 - lava_callback - INFO - Starting async job submit for node 68d48c13a5c2c05277bce58f 2025-09-27 00:26:12,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:12,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c13a5c2c05277bce58f HTTP/1.1" 200 None 2025-09-27 00:26:12,936 - lava_callback - DEBUG - Processing node 68d48c13a5c2c05277bce58f: ltp-input 2025-09-27 00:26:12,936 - lava_callback - ERROR - Error processing callback for node 68d48c13a5c2c05277bce58f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:26:13,747 - lava_callback - INFO - Received callback for node 68d48c14a5c2c05277bce592 INFO: 172.21.0.1:44366 - "POST /node/68d48c14a5c2c05277bce592 HTTP/1.0" 202 Accepted 2025-09-27 00:26:13,756 - lava_callback - INFO - Starting async job submit for node 68d48c14a5c2c05277bce592 2025-09-27 00:26:13,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:13,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c14a5c2c05277bce592 HTTP/1.1" 200 None 2025-09-27 00:26:13,773 - lava_callback - DEBUG - Processing node 68d48c14a5c2c05277bce592: ltp-ipc 2025-09-27 00:26:13,774 - lava_callback - ERROR - Error processing callback for node 68d48c14a5c2c05277bce592: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:26:14,543 - lava_callback - INFO - Received callback for node 68d48c14a5c2c05277bce597 INFO: 172.21.0.1:44370 - "POST /node/68d48c14a5c2c05277bce597 HTTP/1.0" 202 Accepted 2025-09-27 00:26:14,550 - lava_callback - INFO - Starting async job submit for node 68d48c14a5c2c05277bce597 2025-09-27 00:26:14,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:14,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c14a5c2c05277bce597 HTTP/1.1" 200 None 2025-09-27 00:26:14,568 - lava_callback - DEBUG - Processing node 68d48c14a5c2c05277bce597: ltp-pty 2025-09-27 00:26:14,568 - lava_callback - ERROR - Error processing callback for node 68d48c14a5c2c05277bce597: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:26:14,681 - lava_callback - INFO - Received callback for node 68d72f04a6a7b6615d4c419d INFO: 172.21.0.1:44374 - "POST /node/68d72f04a6a7b6615d4c419d HTTP/1.0" 202 Accepted 2025-09-27 00:26:14,690 - lava_callback - INFO - Starting async job submit for node 68d72f04a6a7b6615d4c419d 2025-09-27 00:26:14,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:14,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f04a6a7b6615d4c419d HTTP/1.1" 200 None 2025-09-27 00:26:14,734 - lava_callback - DEBUG - Processing node 68d72f04a6a7b6615d4c419d: baseline-x86 2025-09-27 00:26:15,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:26:15,109 - lava_callback - INFO - Received callback for node 68d4ca5da5c2c05277bd051a 2025-09-27 00:26:15,116 - lava_callback - INFO - Starting async job submit for node 68d4ca5da5c2c05277bd051a INFO: 172.21.0.1:44376 - "POST /node/68d4ca5da5c2c05277bd051a HTTP/1.0" 202 Accepted 2025-09-27 00:26:15,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44382 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 00:26:15,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ca5da5c2c05277bd051a HTTP/1.1" 200 None 2025-09-27 00:26:15,164 - lava_callback - DEBUG - Processing node 68d4ca5da5c2c05277bd051a: baseline-arm64 2025-09-27 00:26:15,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:26:15,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d72f04a6a7b6615d4c419d/log.txt.gz 2025-09-27 00:26:15,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:26:15,487 - lava_callback - INFO - Received callback for node 68d48c15a5c2c05277bce59a 2025-09-27 00:26:15,501 - lava_callback - INFO - Starting async job submit for node 68d48c15a5c2c05277bce59a INFO: 172.21.0.1:44390 - "POST /node/68d48c15a5c2c05277bce59a HTTP/1.0" 202 Accepted 2025-09-27 00:26:15,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:15,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c15a5c2c05277bce59a HTTP/1.1" 200 None 2025-09-27 00:26:15,558 - lava_callback - DEBUG - Processing node 68d48c15a5c2c05277bce59a: ltp-sched 2025-09-27 00:26:15,558 - lava_callback - ERROR - Error processing callback for node 68d48c15a5c2c05277bce59a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:26:15,642 - lava_callback - ERROR - Error processing callback for node 68d4ca5da5c2c05277bd051a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:26:15,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:26:15,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d72f04a6a7b6615d4c419d/lava_callback.json.gz 2025-09-27 00:26:15,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:15,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f04a6a7b6615d4c419d HTTP/1.1" 200 None 2025-09-27 00:26:15,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:15,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 00:26:15,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:15,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f04a6a7b6615d4c419d HTTP/1.1" 200 None 2025-09-27 00:26:15,791 - lava_callback - INFO - Completed processing callback for node 68d72f04a6a7b6615d4c419d 2025-09-27 00:26:16,241 - lava_callback - INFO - Received callback for node 68d48c16a5c2c05277bce59e INFO: 172.21.0.1:44402 - "POST /node/68d48c16a5c2c05277bce59e HTTP/1.0" 202 Accepted 2025-09-27 00:26:16,250 - lava_callback - INFO - Starting async job submit for node 68d48c16a5c2c05277bce59e 2025-09-27 00:26:16,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:16,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c16a5c2c05277bce59e HTTP/1.1" 200 None 2025-09-27 00:26:16,275 - lava_callback - DEBUG - Processing node 68d48c16a5c2c05277bce59e: ltp-smoketest 2025-09-27 00:26:16,275 - lava_callback - ERROR - Error processing callback for node 68d48c16a5c2c05277bce59e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:26:17,023 - lava_callback - INFO - Received callback for node 68d48c19a5c2c05277bce5a3 INFO: 172.21.0.1:44420 - "POST /node/68d48c19a5c2c05277bce5a3 HTTP/1.0" 202 Accepted 2025-09-27 00:26:17,029 - lava_callback - INFO - Starting async job submit for node 68d48c19a5c2c05277bce5a3 2025-09-27 00:26:17,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:17,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c19a5c2c05277bce5a3 HTTP/1.1" 200 None 2025-09-27 00:26:17,043 - lava_callback - DEBUG - Processing node 68d48c19a5c2c05277bce5a3: ltp-syscalls 2025-09-27 00:26:17,043 - lava_callback - ERROR - Error processing callback for node 68d48c19a5c2c05277bce5a3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:26:17,765 - lava_callback - INFO - Received callback for node 68d48c19a5c2c05277bce5a7 INFO: 172.21.0.1:44430 - "POST /node/68d48c19a5c2c05277bce5a7 HTTP/1.0" 202 Accepted 2025-09-27 00:26:17,774 - lava_callback - INFO - Starting async job submit for node 68d48c19a5c2c05277bce5a7 2025-09-27 00:26:17,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:17,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c19a5c2c05277bce5a7 HTTP/1.1" 200 None 2025-09-27 00:26:17,798 - lava_callback - DEBUG - Processing node 68d48c19a5c2c05277bce5a7: ltp-syscalls-ipc 2025-09-27 00:26:17,798 - lava_callback - ERROR - Error processing callback for node 68d48c19a5c2c05277bce5a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:26:18,540 - lava_callback - INFO - Received callback for node 68d48c1aa5c2c05277bce5aa INFO: 172.21.0.1:44434 - "POST /node/68d48c1aa5c2c05277bce5aa HTTP/1.0" 202 Accepted 2025-09-27 00:26:18,547 - lava_callback - INFO - Starting async job submit for node 68d48c1aa5c2c05277bce5aa 2025-09-27 00:26:18,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:18,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c1aa5c2c05277bce5aa HTTP/1.1" 200 None 2025-09-27 00:26:18,561 - lava_callback - DEBUG - Processing node 68d48c1aa5c2c05277bce5aa: ltp-timers 2025-09-27 00:26:18,561 - lava_callback - ERROR - Error processing callback for node 68d48c1aa5c2c05277bce5aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:26:19,314 - lava_callback - INFO - Received callback for node 68d48c1ba5c2c05277bce5ad INFO: 172.21.0.1:47284 - "POST /node/68d48c1ba5c2c05277bce5ad HTTP/1.0" 202 Accepted 2025-09-27 00:26:19,323 - lava_callback - INFO - Starting async job submit for node 68d48c1ba5c2c05277bce5ad 2025-09-27 00:26:19,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:19,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c1ba5c2c05277bce5ad HTTP/1.1" 200 None 2025-09-27 00:26:19,342 - lava_callback - DEBUG - Processing node 68d48c1ba5c2c05277bce5ad: ltp-watchqueue 2025-09-27 00:26:19,342 - lava_callback - ERROR - Error processing callback for node 68d48c1ba5c2c05277bce5ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:26:43,655 - lava_callback - INFO - Received callback for node 68d535cdb70fb2a1e20f2222 INFO: 172.21.0.1:39004 - "POST /node/68d535cdb70fb2a1e20f2222 HTTP/1.0" 202 Accepted 2025-09-27 00:26:43,661 - lava_callback - INFO - Starting async job submit for node 68d535cdb70fb2a1e20f2222 2025-09-27 00:26:43,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:43,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535cdb70fb2a1e20f2222 HTTP/1.1" 200 None 2025-09-27 00:26:43,713 - lava_callback - DEBUG - Processing node 68d535cdb70fb2a1e20f2222: baseline-arm 2025-09-27 00:26:43,961 - lava_callback - ERROR - Error processing callback for node 68d535cdb70fb2a1e20f2222: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:26:58,836 - lava_callback - INFO - Received callback for node 68d4ca5ea5c2c05277bd051d INFO: 172.21.0.1:34336 - "POST /node/68d4ca5ea5c2c05277bd051d HTTP/1.0" 202 Accepted 2025-09-27 00:26:58,842 - lava_callback - INFO - Starting async job submit for node 68d4ca5ea5c2c05277bd051d 2025-09-27 00:26:58,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:26:58,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ca5ea5c2c05277bd051d HTTP/1.1" 200 None 2025-09-27 00:26:58,876 - lava_callback - DEBUG - Processing node 68d4ca5ea5c2c05277bd051d: baseline-arm64 2025-09-27 00:26:59,184 - lava_callback - ERROR - Error processing callback for node 68d4ca5ea5c2c05277bd051d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:27:02,426 - lava_callback - INFO - Received callback for node 68d72f05a6a7b6615d4c41a0 INFO: 172.21.0.1:57596 - "POST /node/68d72f05a6a7b6615d4c41a0 HTTP/1.0" 202 Accepted 2025-09-27 00:27:02,432 - lava_callback - INFO - Starting async job submit for node 68d72f05a6a7b6615d4c41a0 2025-09-27 00:27:02,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:02,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f05a6a7b6615d4c41a0 HTTP/1.1" 200 None 2025-09-27 00:27:02,462 - lava_callback - DEBUG - Processing node 68d72f05a6a7b6615d4c41a0: baseline-x86 2025-09-27 00:27:02,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:27:02,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:27:02,940 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d72f05a6a7b6615d4c41a0/log.txt.gz 2025-09-27 00:27:02,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:27:03,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:27:03,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d72f05a6a7b6615d4c41a0/lava_callback.json.gz 2025-09-27 00:27:03,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:03,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f05a6a7b6615d4c41a0 HTTP/1.1" 200 None 2025-09-27 00:27:03,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:03,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 00:27:03,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:03,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f05a6a7b6615d4c41a0 HTTP/1.1" 200 None 2025-09-27 00:27:03,189 - lava_callback - INFO - Completed processing callback for node 68d72f05a6a7b6615d4c41a0 INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57860 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:27:30,230 - lava_callback - INFO - Received callback for node 68d4cd83a5c2c05277bd07d1 INFO: 172.21.0.1:48238 - "POST /node/68d4cd83a5c2c05277bd07d1 HTTP/1.0" 202 Accepted 2025-09-27 00:27:30,243 - lava_callback - INFO - Starting async job submit for node 68d4cd83a5c2c05277bd07d1 2025-09-27 00:27:30,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:30,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd83a5c2c05277bd07d1 HTTP/1.1" 200 None 2025-09-27 00:27:30,297 - lava_callback - DEBUG - Processing node 68d4cd83a5c2c05277bd07d1: baseline-arm64 2025-09-27 00:27:30,881 - lava_callback - ERROR - Error processing callback for node 68d4cd83a5c2c05277bd07d1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:27:38,637 - lava_callback - INFO - Received callback for node 68d4cd84a5c2c05277bd07d4 INFO: 172.21.0.1:48258 - "POST /node/68d4cd84a5c2c05277bd07d4 HTTP/1.0" 202 Accepted 2025-09-27 00:27:38,643 - lava_callback - INFO - Starting async job submit for node 68d4cd84a5c2c05277bd07d4 2025-09-27 00:27:38,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:38,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd84a5c2c05277bd07d4 HTTP/1.1" 200 None 2025-09-27 00:27:38,676 - lava_callback - DEBUG - Processing node 68d4cd84a5c2c05277bd07d4: baseline-arm64 2025-09-27 00:27:39,004 - lava_callback - ERROR - Error processing callback for node 68d4cd84a5c2c05277bd07d4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:27:46,862 - lava_callback - INFO - Received callback for node 68d48c81a5c2c05277bce607 INFO: 172.21.0.1:34906 - "POST /node/68d48c81a5c2c05277bce607 HTTP/1.0" 202 Accepted 2025-09-27 00:27:46,867 - lava_callback - INFO - Starting async job submit for node 68d48c81a5c2c05277bce607 2025-09-27 00:27:46,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:46,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c81a5c2c05277bce607 HTTP/1.1" 200 None 2025-09-27 00:27:46,880 - lava_callback - DEBUG - Processing node 68d48c81a5c2c05277bce607: baseline-arm 2025-09-27 00:27:46,880 - lava_callback - ERROR - Error processing callback for node 68d48c81a5c2c05277bce607: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:27:47,499 - lava_callback - INFO - Received callback for node 68d48c81a5c2c05277bce60a INFO: 172.21.0.1:34916 - "POST /node/68d48c81a5c2c05277bce60a HTTP/1.0" 202 Accepted 2025-09-27 00:27:47,505 - lava_callback - INFO - Starting async job submit for node 68d48c81a5c2c05277bce60a 2025-09-27 00:27:47,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:47,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c81a5c2c05277bce60a HTTP/1.1" 200 None 2025-09-27 00:27:47,548 - lava_callback - DEBUG - Processing node 68d48c81a5c2c05277bce60a: baseline-arm 2025-09-27 00:27:47,548 - lava_callback - ERROR - Error processing callback for node 68d48c81a5c2c05277bce60a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:27:49,487 - lava_callback - INFO - Received callback for node 68d48c12a5c2c05277bce588 INFO: 172.21.0.1:36600 - "POST /node/68d48c12a5c2c05277bce588 HTTP/1.0" 202 Accepted 2025-09-27 00:27:49,494 - lava_callback - INFO - Starting async job submit for node 68d48c12a5c2c05277bce588 2025-09-27 00:27:49,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:49,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c12a5c2c05277bce588 HTTP/1.1" 200 None 2025-09-27 00:27:49,635 - lava_callback - DEBUG - Processing node 68d48c12a5c2c05277bce588: ltp-fs-bind 2025-09-27 00:27:50,137 - lava_callback - ERROR - Error processing callback for node 68d48c12a5c2c05277bce588: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:27:54,062 - lava_callback - INFO - Received callback for node 68d72ee3a6a7b6615d4c4196 INFO: 172.21.0.1:36614 - "POST /node/68d72ee3a6a7b6615d4c4196 HTTP/1.0" 202 Accepted 2025-09-27 00:27:54,068 - lava_callback - INFO - Starting async job submit for node 68d72ee3a6a7b6615d4c4196 2025-09-27 00:27:54,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:54,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72ee3a6a7b6615d4c4196 HTTP/1.1" 200 None 2025-09-27 00:27:54,117 - lava_callback - DEBUG - Processing node 68d72ee3a6a7b6615d4c4196: baseline-x86 2025-09-27 00:27:54,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:27:54,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:27:54,518 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d72ee3a6a7b6615d4c4196/log.txt.gz 2025-09-27 00:27:54,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:27:54,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:27:54,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d72ee3a6a7b6615d4c4196/lava_callback.json.gz 2025-09-27 00:27:54,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:54,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72ee3a6a7b6615d4c4196 HTTP/1.1" 200 None 2025-09-27 00:27:54,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:54,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 00:27:54,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:54,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72ee3a6a7b6615d4c4196 HTTP/1.1" 200 None 2025-09-27 00:27:54,798 - lava_callback - INFO - Completed processing callback for node 68d72ee3a6a7b6615d4c4196 2025-09-27 00:27:56,021 - lava_callback - INFO - Received callback for node 68d72f4da6a7b6615d4c41b7 INFO: 172.21.0.1:36618 - "POST /node/68d72f4da6a7b6615d4c41b7 HTTP/1.0" 202 Accepted 2025-09-27 00:27:56,027 - lava_callback - INFO - Starting async job submit for node 68d72f4da6a7b6615d4c41b7 2025-09-27 00:27:56,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:56,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4da6a7b6615d4c41b7 HTTP/1.1" 200 None 2025-09-27 00:27:56,061 - lava_callback - DEBUG - Processing node 68d72f4da6a7b6615d4c41b7: baseline-arm 2025-09-27 00:27:56,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:27:56,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:27:56,472 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4da6a7b6615d4c41b7/log.txt.gz 2025-09-27 00:27:56,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:27:56,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:27:56,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4da6a7b6615d4c41b7/lava_callback.json.gz 2025-09-27 00:27:56,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:56,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4da6a7b6615d4c41b7 HTTP/1.1" 200 None 2025-09-27 00:27:56,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:56,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:27:56,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:27:56,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f4da6a7b6615d4c41b7 HTTP/1.1" 200 None 2025-09-27 00:27:56,700 - lava_callback - INFO - Completed processing callback for node 68d72f4da6a7b6615d4c41b7 2025-09-27 00:28:00,232 - lava_callback - INFO - Received callback for node 68d72f4ea6a7b6615d4c41c3 INFO: 172.21.0.1:44520 - "POST /node/68d72f4ea6a7b6615d4c41c3 HTTP/1.0" 202 Accepted 2025-09-27 00:28:00,238 - lava_callback - INFO - Starting async job submit for node 68d72f4ea6a7b6615d4c41c3 2025-09-27 00:28:00,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:00,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4ea6a7b6615d4c41c3 HTTP/1.1" 200 None 2025-09-27 00:28:00,271 - lava_callback - DEBUG - Processing node 68d72f4ea6a7b6615d4c41c3: baseline-arm 2025-09-27 00:28:00,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:00,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:00,679 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4ea6a7b6615d4c41c3/log.txt.gz 2025-09-27 00:28:00,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:00,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:00,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4ea6a7b6615d4c41c3/lava_callback.json.gz 2025-09-27 00:28:00,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:00,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4ea6a7b6615d4c41c3 HTTP/1.1" 200 None 2025-09-27 00:28:00,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:00,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:00,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:00,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f4ea6a7b6615d4c41c3 HTTP/1.1" 200 None 2025-09-27 00:28:00,892 - lava_callback - INFO - Completed processing callback for node 68d72f4ea6a7b6615d4c41c3 INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:28:07,013 - lava_callback - INFO - Received callback for node 68d48c8ba5c2c05277bce623 INFO: 172.21.0.1:44548 - "POST /node/68d48c8ba5c2c05277bce623 HTTP/1.0" 202 Accepted 2025-09-27 00:28:07,019 - lava_callback - INFO - Starting async job submit for node 68d48c8ba5c2c05277bce623 2025-09-27 00:28:07,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:07,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c8ba5c2c05277bce623 HTTP/1.1" 200 None 2025-09-27 00:28:07,032 - lava_callback - DEBUG - Processing node 68d48c8ba5c2c05277bce623: baseline-arm 2025-09-27 00:28:07,032 - lava_callback - ERROR - Error processing callback for node 68d48c8ba5c2c05277bce623: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:28:07,650 - lava_callback - INFO - Received callback for node 68d48c8ca5c2c05277bce626 INFO: 172.21.0.1:44550 - "POST /node/68d48c8ca5c2c05277bce626 HTTP/1.0" 202 Accepted 2025-09-27 00:28:07,656 - lava_callback - INFO - Starting async job submit for node 68d48c8ca5c2c05277bce626 2025-09-27 00:28:07,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:07,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c8ca5c2c05277bce626 HTTP/1.1" 200 None 2025-09-27 00:28:07,669 - lava_callback - DEBUG - Processing node 68d48c8ca5c2c05277bce626: baseline-arm 2025-09-27 00:28:07,669 - lava_callback - ERROR - Error processing callback for node 68d48c8ca5c2c05277bce626: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:28:12,063 - lava_callback - INFO - Received callback for node 68d72f53a6a7b6615d4c41e1 INFO: 172.21.0.1:53914 - "POST /node/68d72f53a6a7b6615d4c41e1 HTTP/1.0" 202 Accepted 2025-09-27 00:28:12,069 - lava_callback - INFO - Starting async job submit for node 68d72f53a6a7b6615d4c41e1 2025-09-27 00:28:12,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:12,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f53a6a7b6615d4c41e1 HTTP/1.1" 200 None 2025-09-27 00:28:12,101 - lava_callback - DEBUG - Processing node 68d72f53a6a7b6615d4c41e1: baseline-arm-pengutronix 2025-09-27 00:28:12,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:12,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:12,376 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d72f53a6a7b6615d4c41e1/log.txt.gz 2025-09-27 00:28:12,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:12,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:12,518 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d72f53a6a7b6615d4c41e1/lava_callback.json.gz 2025-09-27 00:28:12,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:12,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f53a6a7b6615d4c41e1 HTTP/1.1" 200 None 2025-09-27 00:28:12,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:12,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:12,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:12,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f53a6a7b6615d4c41e1 HTTP/1.1" 200 None 2025-09-27 00:28:12,597 - lava_callback - INFO - Completed processing callback for node 68d72f53a6a7b6615d4c41e1 2025-09-27 00:28:13,220 - lava_callback - INFO - Received callback for node 68d72f54a6a7b6615d4c41e4 INFO: 172.21.0.1:53920 - "POST /node/68d72f54a6a7b6615d4c41e4 HTTP/1.0" 202 Accepted 2025-09-27 00:28:13,225 - lava_callback - INFO - Starting async job submit for node 68d72f54a6a7b6615d4c41e4 2025-09-27 00:28:13,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:13,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f54a6a7b6615d4c41e4 HTTP/1.1" 200 None 2025-09-27 00:28:13,255 - lava_callback - DEBUG - Processing node 68d72f54a6a7b6615d4c41e4: baseline-arm-pengutronix 2025-09-27 00:28:13,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:13,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:13,511 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d72f54a6a7b6615d4c41e4/log.txt.gz 2025-09-27 00:28:13,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:13,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:13,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d72f54a6a7b6615d4c41e4/lava_callback.json.gz 2025-09-27 00:28:13,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:13,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f54a6a7b6615d4c41e4 HTTP/1.1" 200 None 2025-09-27 00:28:13,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:13,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:13,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f54a6a7b6615d4c41e4 HTTP/1.1" 200 None 2025-09-27 00:28:13,691 - lava_callback - INFO - Completed processing callback for node 68d72f54a6a7b6615d4c41e4 2025-09-27 00:28:14,655 - lava_callback - INFO - Received callback for node 68d4cd87a5c2c05277bd07d7 INFO: 172.21.0.1:53932 - "POST /node/68d4cd87a5c2c05277bd07d7 HTTP/1.0" 202 Accepted 2025-09-27 00:28:14,661 - lava_callback - INFO - Starting async job submit for node 68d4cd87a5c2c05277bd07d7 2025-09-27 00:28:14,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:14,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd87a5c2c05277bd07d7 HTTP/1.1" 200 None 2025-09-27 00:28:14,694 - lava_callback - DEBUG - Processing node 68d4cd87a5c2c05277bd07d7: baseline-arm64 2025-09-27 00:28:15,019 - lava_callback - ERROR - Error processing callback for node 68d4cd87a5c2c05277bd07d7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:28:19,654 - lava_callback - INFO - Received callback for node 68d72f55a6a7b6615d4c41e7 INFO: 172.21.0.1:34368 - "POST /node/68d72f55a6a7b6615d4c41e7 HTTP/1.0" 202 Accepted 2025-09-27 00:28:19,700 - lava_callback - INFO - Starting async job submit for node 68d72f55a6a7b6615d4c41e7 2025-09-27 00:28:19,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:19,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f55a6a7b6615d4c41e7 HTTP/1.1" 200 None 2025-09-27 00:28:19,736 - lava_callback - DEBUG - Processing node 68d72f55a6a7b6615d4c41e7: baseline-arm-pengutronix 2025-09-27 00:28:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:19,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:19,959 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d72f55a6a7b6615d4c41e7/log.txt.gz 2025-09-27 00:28:19,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:20,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:20,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d72f55a6a7b6615d4c41e7/lava_callback.json.gz 2025-09-27 00:28:20,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:20,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f55a6a7b6615d4c41e7 HTTP/1.1" 200 None 2025-09-27 00:28:20,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:20,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:20,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:20,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f55a6a7b6615d4c41e7 HTTP/1.1" 200 None 2025-09-27 00:28:20,150 - lava_callback - INFO - Completed processing callback for node 68d72f55a6a7b6615d4c41e7 INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:28:32,030 - lava_callback - INFO - Received callback for node 68d48c9ba5c2c05277bce638 INFO: 172.21.0.1:32922 - "POST /node/68d48c9ba5c2c05277bce638 HTTP/1.0" 202 Accepted 2025-09-27 00:28:32,035 - lava_callback - INFO - Starting async job submit for node 68d48c9ba5c2c05277bce638 2025-09-27 00:28:32,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:32,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c9ba5c2c05277bce638 HTTP/1.1" 200 None 2025-09-27 00:28:32,060 - lava_callback - DEBUG - Processing node 68d48c9ba5c2c05277bce638: baseline-arm-broonie 2025-09-27 00:28:32,060 - lava_callback - ERROR - Error processing callback for node 68d48c9ba5c2c05277bce638: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:28:32,779 - lava_callback - INFO - Received callback for node 68d48cada5c2c05277bce64a INFO: 172.21.0.1:32938 - "POST /node/68d48cada5c2c05277bce64a HTTP/1.0" 202 Accepted 2025-09-27 00:28:32,785 - lava_callback - INFO - Starting async job submit for node 68d48cada5c2c05277bce64a 2025-09-27 00:28:32,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:32,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cada5c2c05277bce64a HTTP/1.1" 200 None 2025-09-27 00:28:32,798 - lava_callback - DEBUG - Processing node 68d48cada5c2c05277bce64a: ltp-cap-bounds 2025-09-27 00:28:32,799 - lava_callback - ERROR - Error processing callback for node 68d48cada5c2c05277bce64a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:28:34,501 - lava_callback - INFO - Received callback for node 68d72f50a6a7b6615d4c41cc INFO: 172.21.0.1:32954 - "POST /node/68d72f50a6a7b6615d4c41cc HTTP/1.0" 202 Accepted 2025-09-27 00:28:34,510 - lava_callback - INFO - Starting async job submit for node 68d72f50a6a7b6615d4c41cc 2025-09-27 00:28:34,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:34,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f50a6a7b6615d4c41cc HTTP/1.1" 200 None 2025-09-27 00:28:34,563 - lava_callback - DEBUG - Processing node 68d72f50a6a7b6615d4c41cc: baseline-arm-broonie 2025-09-27 00:28:34,710 - lava_callback - INFO - Received callback for node 68d72f52a6a7b6615d4c41db INFO: 172.21.0.1:32966 - "POST /node/68d72f52a6a7b6615d4c41db HTTP/1.0" 202 Accepted 2025-09-27 00:28:34,728 - lava_callback - INFO - Starting async job submit for node 68d72f52a6a7b6615d4c41db 2025-09-27 00:28:34,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:34,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f52a6a7b6615d4c41db HTTP/1.1" 200 None 2025-09-27 00:28:34,906 - lava_callback - DEBUG - Processing node 68d72f52a6a7b6615d4c41db: baseline-arm-kontron 2025-09-27 00:28:35,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:35,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:35,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:35,404 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d72f50a6a7b6615d4c41cc/log.txt.gz 2025-09-27 00:28:35,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:35,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:35,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d72f52a6a7b6615d4c41db/log.txt.gz 2025-09-27 00:28:35,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:35,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:35,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d72f50a6a7b6615d4c41cc/lava_callback.json.gz 2025-09-27 00:28:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:35,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f50a6a7b6615d4c41cc HTTP/1.1" 200 None 2025-09-27 00:28:35,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:35,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:35,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:35,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:35,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d72f52a6a7b6615d4c41db/lava_callback.json.gz 2025-09-27 00:28:35,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f50a6a7b6615d4c41cc HTTP/1.1" 200 None 2025-09-27 00:28:35,684 - lava_callback - INFO - Completed processing callback for node 68d72f50a6a7b6615d4c41cc 2025-09-27 00:28:35,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:35,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f52a6a7b6615d4c41db HTTP/1.1" 200 None 2025-09-27 00:28:35,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:35,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:35,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:35,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f52a6a7b6615d4c41db HTTP/1.1" 200 None 2025-09-27 00:28:35,815 - lava_callback - INFO - Completed processing callback for node 68d72f52a6a7b6615d4c41db 2025-09-27 00:28:35,950 - lava_callback - INFO - Received callback for node 68d72f53a6a7b6615d4c41de INFO: 172.21.0.1:32976 - "POST /node/68d72f53a6a7b6615d4c41de HTTP/1.0" 202 Accepted 2025-09-27 00:28:35,957 - lava_callback - INFO - Starting async job submit for node 68d72f53a6a7b6615d4c41de 2025-09-27 00:28:35,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:36,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f53a6a7b6615d4c41de HTTP/1.1" 200 None 2025-09-27 00:28:36,014 - lava_callback - DEBUG - Processing node 68d72f53a6a7b6615d4c41de: baseline-arm-kontron 2025-09-27 00:28:36,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:36,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:36,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d72f53a6a7b6615d4c41de/log.txt.gz 2025-09-27 00:28:36,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:36,451 - lava_callback - INFO - Received callback for node 68d72f4da6a7b6615d4c41ba INFO: 172.21.0.1:32988 - "POST /node/68d72f4da6a7b6615d4c41ba HTTP/1.0" 202 Accepted 2025-09-27 00:28:36,458 - lava_callback - INFO - Starting async job submit for node 68d72f4da6a7b6615d4c41ba 2025-09-27 00:28:36,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:36,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:36,480 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d72f53a6a7b6615d4c41de/lava_callback.json.gz 2025-09-27 00:28:36,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:28:36,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4da6a7b6615d4c41ba HTTP/1.1" 200 None 2025-09-27 00:28:36,519 - lava_callback - DEBUG - Processing node 68d72f4da6a7b6615d4c41ba: baseline-arm 2025-09-27 00:28:36,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f53a6a7b6615d4c41de HTTP/1.1" 200 None 2025-09-27 00:28:36,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:36,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:36,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:28:36,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f53a6a7b6615d4c41de HTTP/1.1" 200 None 2025-09-27 00:28:36,740 - lava_callback - INFO - Completed processing callback for node 68d72f53a6a7b6615d4c41de 2025-09-27 00:28:36,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:36,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:36,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4da6a7b6615d4c41ba/log.txt.gz 2025-09-27 00:28:36,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:37,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:37,028 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4da6a7b6615d4c41ba/lava_callback.json.gz 2025-09-27 00:28:37,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:37,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4da6a7b6615d4c41ba HTTP/1.1" 200 None 2025-09-27 00:28:37,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:37,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:37,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:37,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f4da6a7b6615d4c41ba HTTP/1.1" 200 None 2025-09-27 00:28:37,114 - lava_callback - INFO - Completed processing callback for node 68d72f4da6a7b6615d4c41ba 2025-09-27 00:28:37,558 - lava_callback - INFO - Received callback for node 68d72f4ba6a7b6615d4c41ae INFO: 172.21.0.1:33016 - "POST /node/68d72f4ba6a7b6615d4c41ae HTTP/1.0" 202 Accepted 2025-09-27 00:28:37,565 - lava_callback - INFO - Starting async job submit for node 68d72f4ba6a7b6615d4c41ae 2025-09-27 00:28:37,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:37,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4ba6a7b6615d4c41ae HTTP/1.1" 200 None 2025-09-27 00:28:37,597 - lava_callback - DEBUG - Processing node 68d72f4ba6a7b6615d4c41ae: baseline-arm 2025-09-27 00:28:37,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:37,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:37,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4ba6a7b6615d4c41ae/log.txt.gz 2025-09-27 00:28:37,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:38,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:38,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4ba6a7b6615d4c41ae/lava_callback.json.gz 2025-09-27 00:28:38,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:38,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4ba6a7b6615d4c41ae HTTP/1.1" 200 None 2025-09-27 00:28:38,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:38,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:38,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:38,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f4ba6a7b6615d4c41ae HTTP/1.1" 200 None 2025-09-27 00:28:38,167 - lava_callback - INFO - Completed processing callback for node 68d72f4ba6a7b6615d4c41ae 2025-09-27 00:28:38,771 - lava_callback - INFO - Received callback for node 68d535cfb70fb2a1e20f2225 INFO: 172.21.0.1:33028 - "POST /node/68d535cfb70fb2a1e20f2225 HTTP/1.0" 202 Accepted 2025-09-27 00:28:38,778 - lava_callback - INFO - Starting async job submit for node 68d535cfb70fb2a1e20f2225 2025-09-27 00:28:38,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:38,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535cfb70fb2a1e20f2225 HTTP/1.1" 200 None 2025-09-27 00:28:38,816 - lava_callback - DEBUG - Processing node 68d535cfb70fb2a1e20f2225: baseline-arm 2025-09-27 00:28:39,093 - lava_callback - ERROR - Error processing callback for node 68d535cfb70fb2a1e20f2225: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:28:44,543 - lava_callback - INFO - Received callback for node 68d4cd87a5c2c05277bd07da INFO: 172.21.0.1:33086 - "POST /node/68d4cd87a5c2c05277bd07da HTTP/1.0" 202 Accepted 2025-09-27 00:28:44,549 - lava_callback - INFO - Starting async job submit for node 68d4cd87a5c2c05277bd07da 2025-09-27 00:28:44,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:44,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd87a5c2c05277bd07da HTTP/1.1" 200 None 2025-09-27 00:28:44,601 - lava_callback - DEBUG - Processing node 68d4cd87a5c2c05277bd07da: baseline-arm64 2025-09-27 00:28:44,930 - lava_callback - ERROR - Error processing callback for node 68d4cd87a5c2c05277bd07da: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:28:51,443 - lava_callback - INFO - Received callback for node 68d72f50a6a7b6615d4c41cf INFO: 172.21.0.1:43814 - "POST /node/68d72f50a6a7b6615d4c41cf HTTP/1.0" 202 Accepted 2025-09-27 00:28:51,450 - lava_callback - INFO - Starting async job submit for node 68d72f50a6a7b6615d4c41cf 2025-09-27 00:28:51,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:51,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f50a6a7b6615d4c41cf HTTP/1.1" 200 None 2025-09-27 00:28:51,483 - lava_callback - DEBUG - Processing node 68d72f50a6a7b6615d4c41cf: baseline-arm-broonie 2025-09-27 00:28:51,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:51,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:51,809 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d72f50a6a7b6615d4c41cf/log.txt.gz 2025-09-27 00:28:51,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:28:51,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:28:51,925 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d72f50a6a7b6615d4c41cf/lava_callback.json.gz 2025-09-27 00:28:51,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:51,948 - lava_callback - INFO - Received callback for node 68d48cb1a5c2c05277bce64d INFO: 172.21.0.1:43828 - "POST /node/68d48cb1a5c2c05277bce64d HTTP/1.0" 202 Accepted 2025-09-27 00:28:51,954 - lava_callback - INFO - Starting async job submit for node 68d48cb1a5c2c05277bce64d 2025-09-27 00:28:51,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:51,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f50a6a7b6615d4c41cf HTTP/1.1" 200 None 2025-09-27 00:28:51,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:51,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cb1a5c2c05277bce64d HTTP/1.1" 200 None 2025-09-27 00:28:51,971 - lava_callback - DEBUG - Processing node 68d48cb1a5c2c05277bce64d: ltp-containers 2025-09-27 00:28:51,971 - lava_callback - ERROR - Error processing callback for node 68d48cb1a5c2c05277bce64d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:28:51,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:28:51,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:52,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f50a6a7b6615d4c41cf HTTP/1.1" 200 None 2025-09-27 00:28:52,013 - lava_callback - INFO - Completed processing callback for node 68d72f50a6a7b6615d4c41cf 2025-09-27 00:28:52,755 - lava_callback - INFO - Received callback for node 68d48cb3a5c2c05277bce650 INFO: 172.21.0.1:43836 - "POST /node/68d48cb3a5c2c05277bce650 HTTP/1.0" 202 Accepted 2025-09-27 00:28:52,761 - lava_callback - INFO - Starting async job submit for node 68d48cb3a5c2c05277bce650 2025-09-27 00:28:52,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:52,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cb3a5c2c05277bce650 HTTP/1.1" 200 None 2025-09-27 00:28:52,773 - lava_callback - DEBUG - Processing node 68d48cb3a5c2c05277bce650: ltp-controllers 2025-09-27 00:28:52,773 - lava_callback - ERROR - Error processing callback for node 68d48cb3a5c2c05277bce650: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:43848 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:28:53,499 - lava_callback - INFO - Received callback for node 68d48cbaa5c2c05277bce672 INFO: 172.21.0.1:43852 - "POST /node/68d48cbaa5c2c05277bce672 HTTP/1.0" 202 Accepted 2025-09-27 00:28:53,505 - lava_callback - INFO - Starting async job submit for node 68d48cbaa5c2c05277bce672 2025-09-27 00:28:53,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:53,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cbaa5c2c05277bce672 HTTP/1.1" 200 None 2025-09-27 00:28:53,520 - lava_callback - DEBUG - Processing node 68d48cbaa5c2c05277bce672: ltp-cve 2025-09-27 00:28:53,520 - lava_callback - ERROR - Error processing callback for node 68d48cbaa5c2c05277bce672: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:28:54,224 - lava_callback - INFO - Received callback for node 68d48cc1a5c2c05277bce679 INFO: 172.21.0.1:43856 - "POST /node/68d48cc1a5c2c05277bce679 HTTP/1.0" 202 Accepted 2025-09-27 00:28:54,230 - lava_callback - INFO - Starting async job submit for node 68d48cc1a5c2c05277bce679 2025-09-27 00:28:54,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:54,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cc1a5c2c05277bce679 HTTP/1.1" 200 None 2025-09-27 00:28:54,246 - lava_callback - DEBUG - Processing node 68d48cc1a5c2c05277bce679: ltp-fs-bind 2025-09-27 00:28:54,247 - lava_callback - ERROR - Error processing callback for node 68d48cc1a5c2c05277bce679: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:28:55,022 - lava_callback - INFO - Received callback for node 68d4cd97a5c2c05277bd07f5 INFO: 172.21.0.1:43866 - "POST /node/68d4cd97a5c2c05277bd07f5 HTTP/1.0" 202 Accepted 2025-09-27 00:28:55,028 - lava_callback - INFO - Starting async job submit for node 68d4cd97a5c2c05277bd07f5 2025-09-27 00:28:55,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:28:55,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd97a5c2c05277bd07f5 HTTP/1.1" 200 None 2025-09-27 00:28:55,080 - lava_callback - DEBUG - Processing node 68d4cd97a5c2c05277bd07f5: baseline-arm64 2025-09-27 00:28:55,374 - lava_callback - ERROR - Error processing callback for node 68d4cd97a5c2c05277bd07f5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:29:12,092 - lava_callback - INFO - Received callback for node 68d48cc4a5c2c05277bce67c INFO: 172.21.0.1:59098 - "POST /node/68d48cc4a5c2c05277bce67c HTTP/1.0" 202 Accepted 2025-09-27 00:29:12,098 - lava_callback - INFO - Starting async job submit for node 68d48cc4a5c2c05277bce67c 2025-09-27 00:29:12,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:12,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cc4a5c2c05277bce67c HTTP/1.1" 200 None 2025-09-27 00:29:12,118 - lava_callback - DEBUG - Processing node 68d48cc4a5c2c05277bce67c: ltp-fsx 2025-09-27 00:29:12,118 - lava_callback - ERROR - Error processing callback for node 68d48cc4a5c2c05277bce67c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:29:12,889 - lava_callback - INFO - Received callback for node 68d48cc8a5c2c05277bce67f INFO: 172.21.0.1:59104 - "POST /node/68d48cc8a5c2c05277bce67f HTTP/1.0" 202 Accepted 2025-09-27 00:29:12,895 - lava_callback - INFO - Starting async job submit for node 68d48cc8a5c2c05277bce67f 2025-09-27 00:29:12,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:12,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cc8a5c2c05277bce67f HTTP/1.1" 200 None 2025-09-27 00:29:12,910 - lava_callback - DEBUG - Processing node 68d48cc8a5c2c05277bce67f: ltp-input 2025-09-27 00:29:12,910 - lava_callback - ERROR - Error processing callback for node 68d48cc8a5c2c05277bce67f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:29:13,626 - lava_callback - INFO - Received callback for node 68d48ccba5c2c05277bce6e0 INFO: 172.21.0.1:59110 - "POST /node/68d48ccba5c2c05277bce6e0 HTTP/1.0" 202 Accepted 2025-09-27 00:29:13,632 - lava_callback - INFO - Starting async job submit for node 68d48ccba5c2c05277bce6e0 2025-09-27 00:29:13,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:13,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48ccba5c2c05277bce6e0 HTTP/1.1" 200 None 2025-09-27 00:29:13,647 - lava_callback - DEBUG - Processing node 68d48ccba5c2c05277bce6e0: ltp-ipc 2025-09-27 00:29:13,647 - lava_callback - ERROR - Error processing callback for node 68d48ccba5c2c05277bce6e0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:29:14,360 - lava_callback - INFO - Received callback for node 68d48ccda5c2c05277bce6e3 INFO: 172.21.0.1:59122 - "POST /node/68d48ccda5c2c05277bce6e3 HTTP/1.0" 202 Accepted 2025-09-27 00:29:14,366 - lava_callback - INFO - Starting async job submit for node 68d48ccda5c2c05277bce6e3 2025-09-27 00:29:14,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:14,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48ccda5c2c05277bce6e3 HTTP/1.1" 200 None 2025-09-27 00:29:14,400 - lava_callback - DEBUG - Processing node 68d48ccda5c2c05277bce6e3: ltp-pty 2025-09-27 00:29:14,400 - lava_callback - ERROR - Error processing callback for node 68d48ccda5c2c05277bce6e3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:29:15,135 - lava_callback - INFO - Received callback for node 68d48cd2a5c2c05277bce6e6 INFO: 172.21.0.1:59132 - "POST /node/68d48cd2a5c2c05277bce6e6 HTTP/1.0" 202 Accepted 2025-09-27 00:29:15,140 - lava_callback - INFO - Starting async job submit for node 68d48cd2a5c2c05277bce6e6 2025-09-27 00:29:15,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:15,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cd2a5c2c05277bce6e6 HTTP/1.1" 200 None 2025-09-27 00:29:15,154 - lava_callback - DEBUG - Processing node 68d48cd2a5c2c05277bce6e6: ltp-sched 2025-09-27 00:29:15,154 - lava_callback - ERROR - Error processing callback for node 68d48cd2a5c2c05277bce6e6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59144 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 00:29:15,890 - lava_callback - INFO - Received callback for node 68d48cd5a5c2c05277bce6e9 INFO: 172.21.0.1:59158 - "POST /node/68d48cd5a5c2c05277bce6e9 HTTP/1.0" 202 Accepted 2025-09-27 00:29:15,899 - lava_callback - INFO - Starting async job submit for node 68d48cd5a5c2c05277bce6e9 2025-09-27 00:29:15,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:15,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cd5a5c2c05277bce6e9 HTTP/1.1" 200 None 2025-09-27 00:29:15,912 - lava_callback - DEBUG - Processing node 68d48cd5a5c2c05277bce6e9: ltp-smoketest 2025-09-27 00:29:15,913 - lava_callback - ERROR - Error processing callback for node 68d48cd5a5c2c05277bce6e9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:29:16,637 - lava_callback - INFO - Received callback for node 68d48cd9a5c2c05277bce6ec INFO: 172.21.0.1:59180 - "POST /node/68d48cd9a5c2c05277bce6ec HTTP/1.0" 202 Accepted 2025-09-27 00:29:16,643 - lava_callback - INFO - Starting async job submit for node 68d48cd9a5c2c05277bce6ec 2025-09-27 00:29:16,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:16,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cd9a5c2c05277bce6ec HTTP/1.1" 200 None 2025-09-27 00:29:16,657 - lava_callback - DEBUG - Processing node 68d48cd9a5c2c05277bce6ec: ltp-syscalls 2025-09-27 00:29:16,657 - lava_callback - ERROR - Error processing callback for node 68d48cd9a5c2c05277bce6ec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:29:32,084 - lava_callback - INFO - Received callback for node 68d48cdba5c2c05277bce6ef INFO: 172.21.0.1:55116 - "POST /node/68d48cdba5c2c05277bce6ef HTTP/1.0" 202 Accepted 2025-09-27 00:29:32,090 - lava_callback - INFO - Starting async job submit for node 68d48cdba5c2c05277bce6ef 2025-09-27 00:29:32,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:32,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cdba5c2c05277bce6ef HTTP/1.1" 200 None 2025-09-27 00:29:32,107 - lava_callback - DEBUG - Processing node 68d48cdba5c2c05277bce6ef: ltp-syscalls-ipc 2025-09-27 00:29:32,107 - lava_callback - ERROR - Error processing callback for node 68d48cdba5c2c05277bce6ef: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:29:32,888 - lava_callback - INFO - Received callback for node 68d48cdfa5c2c05277bce6f2 INFO: 172.21.0.1:55120 - "POST /node/68d48cdfa5c2c05277bce6f2 HTTP/1.0" 202 Accepted 2025-09-27 00:29:32,894 - lava_callback - INFO - Starting async job submit for node 68d48cdfa5c2c05277bce6f2 2025-09-27 00:29:32,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:32,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48cdfa5c2c05277bce6f2 HTTP/1.1" 200 None 2025-09-27 00:29:32,908 - lava_callback - DEBUG - Processing node 68d48cdfa5c2c05277bce6f2: ltp-timers 2025-09-27 00:29:32,908 - lava_callback - ERROR - Error processing callback for node 68d48cdfa5c2c05277bce6f2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:29:33,629 - lava_callback - INFO - Received callback for node 68d48ce1a5c2c05277bce6f5 INFO: 172.21.0.1:55128 - "POST /node/68d48ce1a5c2c05277bce6f5 HTTP/1.0" 202 Accepted 2025-09-27 00:29:33,635 - lava_callback - INFO - Starting async job submit for node 68d48ce1a5c2c05277bce6f5 2025-09-27 00:29:33,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:33,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48ce1a5c2c05277bce6f5 HTTP/1.1" 200 None 2025-09-27 00:29:33,649 - lava_callback - DEBUG - Processing node 68d48ce1a5c2c05277bce6f5: ltp-watchqueue 2025-09-27 00:29:33,649 - lava_callback - ERROR - Error processing callback for node 68d48ce1a5c2c05277bce6f5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 00:29:35,082 - lava_callback - INFO - Received callback for node 68d72f58a6a7b6615d4c41fa INFO: 172.21.0.1:55142 - "POST /node/68d72f58a6a7b6615d4c41fa HTTP/1.0" 202 Accepted 2025-09-27 00:29:35,089 - lava_callback - INFO - Starting async job submit for node 68d72f58a6a7b6615d4c41fa 2025-09-27 00:29:35,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:35,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f58a6a7b6615d4c41fa HTTP/1.1" 200 None 2025-09-27 00:29:35,138 - lava_callback - DEBUG - Processing node 68d72f58a6a7b6615d4c41fa: ltp-dio 2025-09-27 00:29:35,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:29:35,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:29:35,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d72f58a6a7b6615d4c41fa/log.txt.gz 2025-09-27 00:29:35,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:29:35,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:29:35,860 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d72f58a6a7b6615d4c41fa/lava_callback.json.gz 2025-09-27 00:29:35,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:35,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f58a6a7b6615d4c41fa HTTP/1.1" 200 None 2025-09-27 00:29:35,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:35,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:29:35,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:36,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f58a6a7b6615d4c41fa HTTP/1.1" 200 None 2025-09-27 00:29:36,026 - lava_callback - INFO - Completed processing callback for node 68d72f58a6a7b6615d4c41fa INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:29:42,472 - lava_callback - INFO - Received callback for node 68d4cd98a5c2c05277bd07f8 INFO: 172.21.0.1:41802 - "POST /node/68d4cd98a5c2c05277bd07f8 HTTP/1.0" 202 Accepted 2025-09-27 00:29:42,480 - lava_callback - INFO - Starting async job submit for node 68d4cd98a5c2c05277bd07f8 2025-09-27 00:29:42,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:42,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd98a5c2c05277bd07f8 HTTP/1.1" 200 None 2025-09-27 00:29:42,517 - lava_callback - DEBUG - Processing node 68d4cd98a5c2c05277bd07f8: baseline-arm64 2025-09-27 00:29:42,880 - lava_callback - ERROR - Error processing callback for node 68d4cd98a5c2c05277bd07f8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:29:44,374 - lava_callback - INFO - Received callback for node 68d4cd9aa5c2c05277bd07fb INFO: 172.21.0.1:41816 - "POST /node/68d4cd9aa5c2c05277bd07fb HTTP/1.0" 202 Accepted 2025-09-27 00:29:44,382 - lava_callback - INFO - Starting async job submit for node 68d4cd9aa5c2c05277bd07fb 2025-09-27 00:29:44,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:44,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd9aa5c2c05277bd07fb HTTP/1.1" 200 None 2025-09-27 00:29:44,421 - lava_callback - DEBUG - Processing node 68d4cd9aa5c2c05277bd07fb: baseline-arm64 2025-09-27 00:29:44,784 - lava_callback - ERROR - Error processing callback for node 68d4cd9aa5c2c05277bd07fb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:29:49,733 - lava_callback - INFO - Received callback for node 68d48c93a5c2c05277bce62f INFO: 172.21.0.1:54534 - "POST /node/68d48c93a5c2c05277bce62f HTTP/1.0" 202 Accepted 2025-09-27 00:29:49,739 - lava_callback - INFO - Starting async job submit for node 68d48c93a5c2c05277bce62f 2025-09-27 00:29:49,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:29:49,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c93a5c2c05277bce62f HTTP/1.1" 200 None 2025-09-27 00:29:49,777 - lava_callback - DEBUG - Processing node 68d48c93a5c2c05277bce62f: baseline-arm-broonie 2025-09-27 00:29:49,988 - lava_callback - ERROR - Error processing callback for node 68d48c93a5c2c05277bce62f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:30:14,995 - lava_callback - INFO - Received callback for node 68d4cd9ba5c2c05277bd07fe INFO: 172.21.0.1:43862 - "POST /node/68d4cd9ba5c2c05277bd07fe HTTP/1.0" 202 Accepted 2025-09-27 00:30:15,001 - lava_callback - INFO - Starting async job submit for node 68d4cd9ba5c2c05277bd07fe 2025-09-27 00:30:15,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:30:15,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd9ba5c2c05277bd07fe HTTP/1.1" 200 None 2025-09-27 00:30:15,056 - lava_callback - DEBUG - Processing node 68d4cd9ba5c2c05277bd07fe: baseline-arm64 INFO: 172.21.0.1:43870 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 00:30:15,352 - lava_callback - ERROR - Error processing callback for node 68d4cd9ba5c2c05277bd07fe: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:30:39,670 - lava_callback - INFO - Received callback for node 68d535cfb70fb2a1e20f2228 INFO: 172.21.0.1:35584 - "POST /node/68d535cfb70fb2a1e20f2228 HTTP/1.0" 202 Accepted 2025-09-27 00:30:39,677 - lava_callback - INFO - Starting async job submit for node 68d535cfb70fb2a1e20f2228 2025-09-27 00:30:39,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:30:39,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d535cfb70fb2a1e20f2228 HTTP/1.1" 200 None 2025-09-27 00:30:39,709 - lava_callback - DEBUG - Processing node 68d535cfb70fb2a1e20f2228: baseline-arm 2025-09-27 00:30:39,935 - lava_callback - ERROR - Error processing callback for node 68d535cfb70fb2a1e20f2228: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:30:44,036 - lava_callback - INFO - Received callback for node 68d4cda4a5c2c05277bd080d INFO: 172.21.0.1:35592 - "POST /node/68d4cda4a5c2c05277bd080d HTTP/1.0" 202 Accepted 2025-09-27 00:30:44,043 - lava_callback - INFO - Starting async job submit for node 68d4cda4a5c2c05277bd080d 2025-09-27 00:30:44,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:30:44,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cda4a5c2c05277bd080d HTTP/1.1" 200 None 2025-09-27 00:30:44,083 - lava_callback - DEBUG - Processing node 68d4cda4a5c2c05277bd080d: baseline-arm64 2025-09-27 00:30:44,405 - lava_callback - ERROR - Error processing callback for node 68d4cda4a5c2c05277bd080d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:30:54,580 - lava_callback - INFO - Received callback for node 68d4cda5a5c2c05277bd0810 INFO: 172.21.0.1:52650 - "POST /node/68d4cda5a5c2c05277bd0810 HTTP/1.0" 202 Accepted 2025-09-27 00:30:54,586 - lava_callback - INFO - Starting async job submit for node 68d4cda5a5c2c05277bd0810 2025-09-27 00:30:54,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:30:54,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cda5a5c2c05277bd0810 HTTP/1.1" 200 None 2025-09-27 00:30:54,635 - lava_callback - DEBUG - Processing node 68d4cda5a5c2c05277bd0810: baseline-arm64 2025-09-27 00:30:54,925 - lava_callback - ERROR - Error processing callback for node 68d4cda5a5c2c05277bd0810: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:31:08,194 - lava_callback - INFO - Received callback for node 68d48c10a5c2c05277bce57d INFO: 172.21.0.1:46694 - "POST /node/68d48c10a5c2c05277bce57d HTTP/1.0" 202 Accepted 2025-09-27 00:31:08,208 - lava_callback - INFO - Starting async job submit for node 68d48c10a5c2c05277bce57d 2025-09-27 00:31:08,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:31:08,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c10a5c2c05277bce57d HTTP/1.1" 200 None 2025-09-27 00:31:08,610 - lava_callback - DEBUG - Processing node 68d48c10a5c2c05277bce57d: ltp-controllers 2025-09-27 00:31:11,366 - lava_callback - ERROR - Error processing callback for node 68d48c10a5c2c05277bce57d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:31:34,382 - lava_callback - INFO - Received callback for node 68d4cdaaa5c2c05277bd0813 INFO: 172.21.0.1:59472 - "POST /node/68d4cdaaa5c2c05277bd0813 HTTP/1.0" 202 Accepted 2025-09-27 00:31:34,388 - lava_callback - INFO - Starting async job submit for node 68d4cdaaa5c2c05277bd0813 2025-09-27 00:31:34,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:31:34,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cdaaa5c2c05277bd0813 HTTP/1.1" 200 None 2025-09-27 00:31:34,432 - lava_callback - DEBUG - Processing node 68d4cdaaa5c2c05277bd0813: baseline-arm64 2025-09-27 00:31:34,772 - lava_callback - ERROR - Error processing callback for node 68d4cdaaa5c2c05277bd0813: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:31:44,278 - lava_callback - INFO - Received callback for node 68d4cdaba5c2c05277bd0816 INFO: 172.21.0.1:58950 - "POST /node/68d4cdaba5c2c05277bd0816 HTTP/1.0" 202 Accepted 2025-09-27 00:31:44,284 - lava_callback - INFO - Starting async job submit for node 68d4cdaba5c2c05277bd0816 2025-09-27 00:31:44,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:31:44,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cdaba5c2c05277bd0816 HTTP/1.1" 200 None 2025-09-27 00:31:44,338 - lava_callback - DEBUG - Processing node 68d4cdaba5c2c05277bd0816: baseline-arm64 2025-09-27 00:31:44,669 - lava_callback - ERROR - Error processing callback for node 68d4cdaba5c2c05277bd0816: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:32:14,708 - lava_callback - INFO - Received callback for node 68d4cdd0a5c2c05277bd0867 INFO: 172.21.0.1:44728 - "POST /node/68d4cdd0a5c2c05277bd0867 HTTP/1.0" 202 Accepted 2025-09-27 00:32:14,715 - lava_callback - INFO - Starting async job submit for node 68d4cdd0a5c2c05277bd0867 2025-09-27 00:32:14,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:32:14,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cdd0a5c2c05277bd0867 HTTP/1.1" 200 None 2025-09-27 00:32:14,748 - lava_callback - DEBUG - Processing node 68d4cdd0a5c2c05277bd0867: baseline-arm64 2025-09-27 00:32:15,078 - lava_callback - ERROR - Error processing callback for node 68d4cdd0a5c2c05277bd0867: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:32:44,542 - lava_callback - INFO - Received callback for node 68d4cdd4a5c2c05277bd086d INFO: 172.21.0.1:45566 - "POST /node/68d4cdd4a5c2c05277bd086d HTTP/1.0" 202 Accepted 2025-09-27 00:32:44,552 - lava_callback - INFO - Starting async job submit for node 68d4cdd4a5c2c05277bd086d 2025-09-27 00:32:44,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:32:44,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cdd4a5c2c05277bd086d HTTP/1.1" 200 None 2025-09-27 00:32:44,615 - lava_callback - DEBUG - Processing node 68d4cdd4a5c2c05277bd086d: baseline-arm64 2025-09-27 00:32:45,234 - lava_callback - ERROR - Error processing callback for node 68d4cdd4a5c2c05277bd086d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:32:55,472 - lava_callback - INFO - Received callback for node 68d4cdd1a5c2c05277bd086a INFO: 172.21.0.1:34528 - "POST /node/68d4cdd1a5c2c05277bd086a HTTP/1.0" 202 Accepted 2025-09-27 00:32:55,482 - lava_callback - INFO - Starting async job submit for node 68d4cdd1a5c2c05277bd086a 2025-09-27 00:32:55,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:32:55,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cdd1a5c2c05277bd086a HTTP/1.1" 200 None 2025-09-27 00:32:55,543 - lava_callback - DEBUG - Processing node 68d4cdd1a5c2c05277bd086a: baseline-arm64 2025-09-27 00:32:56,177 - lava_callback - ERROR - Error processing callback for node 68d4cdd1a5c2c05277bd086a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:33:51,502 - lava_callback - INFO - Received callback for node 68d4cefea5c2c05277bd0a20 INFO: 172.21.0.1:59602 - "POST /node/68d4cefea5c2c05277bd0a20 HTTP/1.0" 202 Accepted 2025-09-27 00:33:51,509 - lava_callback - INFO - Starting async job submit for node 68d4cefea5c2c05277bd0a20 2025-09-27 00:33:51,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:33:51,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cefea5c2c05277bd0a20 HTTP/1.1" 200 None 2025-09-27 00:33:51,542 - lava_callback - DEBUG - Processing node 68d4cefea5c2c05277bd0a20: baseline-arm64 2025-09-27 00:33:51,836 - lava_callback - ERROR - Error processing callback for node 68d4cefea5c2c05277bd0a20: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:34:05,792 - lava_callback - INFO - Received callback for node 68d4cdd4a5c2c05277bd0870 INFO: 172.21.0.1:50152 - "POST /node/68d4cdd4a5c2c05277bd0870 HTTP/1.0" 202 Accepted 2025-09-27 00:34:05,798 - lava_callback - INFO - Starting async job submit for node 68d4cdd4a5c2c05277bd0870 2025-09-27 00:34:05,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:34:05,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cdd4a5c2c05277bd0870 HTTP/1.1" 200 None 2025-09-27 00:34:05,831 - lava_callback - DEBUG - Processing node 68d4cdd4a5c2c05277bd0870: baseline-arm64 2025-09-27 00:34:06,204 - lava_callback - ERROR - Error processing callback for node 68d4cdd4a5c2c05277bd0870: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:34:21,643 - lava_callback - INFO - Received callback for node 68d4ceffa5c2c05277bd0a23 INFO: 172.21.0.1:52014 - "POST /node/68d4ceffa5c2c05277bd0a23 HTTP/1.0" 202 Accepted 2025-09-27 00:34:21,651 - lava_callback - INFO - Starting async job submit for node 68d4ceffa5c2c05277bd0a23 2025-09-27 00:34:21,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:34:21,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ceffa5c2c05277bd0a23 HTTP/1.1" 200 None 2025-09-27 00:34:21,710 - lava_callback - DEBUG - Processing node 68d4ceffa5c2c05277bd0a23: baseline-arm64 2025-09-27 00:34:22,025 - lava_callback - ERROR - Error processing callback for node 68d4ceffa5c2c05277bd0a23: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:35:23,864 - lava_callback - INFO - Received callback for node 68d4cf01a5c2c05277bd0a26 INFO: 172.21.0.1:47144 - "POST /node/68d4cf01a5c2c05277bd0a26 HTTP/1.0" 202 Accepted 2025-09-27 00:35:23,880 - lava_callback - INFO - Starting async job submit for node 68d4cf01a5c2c05277bd0a26 2025-09-27 00:35:24,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:35:24,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cf01a5c2c05277bd0a26 HTTP/1.1" 200 None 2025-09-27 00:35:24,188 - lava_callback - DEBUG - Processing node 68d4cf01a5c2c05277bd0a26: baseline-arm64 2025-09-27 00:35:25,711 - lava_callback - ERROR - Error processing callback for node 68d4cf01a5c2c05277bd0a26: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47148 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:35:27,389 - lava_callback - INFO - Received callback for node 68d4cf02a5c2c05277bd0a29 INFO: 172.21.0.1:47154 - "POST /node/68d4cf02a5c2c05277bd0a29 HTTP/1.0" 202 Accepted 2025-09-27 00:35:27,406 - lava_callback - INFO - Starting async job submit for node 68d4cf02a5c2c05277bd0a29 2025-09-27 00:35:27,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:35:27,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cf02a5c2c05277bd0a29 HTTP/1.1" 200 None 2025-09-27 00:35:27,479 - lava_callback - DEBUG - Processing node 68d4cf02a5c2c05277bd0a29: baseline-arm64 2025-09-27 00:35:27,995 - lava_callback - ERROR - Error processing callback for node 68d4cf02a5c2c05277bd0a29: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:35:35,092 - lava_callback - INFO - Received callback for node 68d4cf05a5c2c05277bd0a2c INFO: 172.21.0.1:43668 - "POST /node/68d4cf05a5c2c05277bd0a2c HTTP/1.0" 202 Accepted 2025-09-27 00:35:35,101 - lava_callback - INFO - Starting async job submit for node 68d4cf05a5c2c05277bd0a2c 2025-09-27 00:35:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:35:35,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cf05a5c2c05277bd0a2c HTTP/1.1" 200 None 2025-09-27 00:35:35,188 - lava_callback - DEBUG - Processing node 68d4cf05a5c2c05277bd0a2c: baseline-arm64 2025-09-27 00:35:35,895 - lava_callback - ERROR - Error processing callback for node 68d4cf05a5c2c05277bd0a2c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:36:27,704 - lava_callback - INFO - Received callback for node 68d48c11a5c2c05277bce580 INFO: 172.21.0.1:45808 - "POST /node/68d48c11a5c2c05277bce580 HTTP/1.0" 202 Accepted 2025-09-27 00:36:27,720 - lava_callback - INFO - Starting async job submit for node 68d48c11a5c2c05277bce580 2025-09-27 00:36:27,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:36:28,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48c11a5c2c05277bce580 HTTP/1.1" 200 None 2025-09-27 00:36:28,002 - lava_callback - DEBUG - Processing node 68d48c11a5c2c05277bce580: ltp-cve 2025-09-27 00:36:29,597 - lava_callback - ERROR - Error processing callback for node 68d48c11a5c2c05277bce580: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:36:39,116 - lava_callback - INFO - Received callback for node 68d4cf05a5c2c05277bd0a2f INFO: 172.21.0.1:49826 - "POST /node/68d4cf05a5c2c05277bd0a2f HTTP/1.0" 202 Accepted 2025-09-27 00:36:39,122 - lava_callback - INFO - Starting async job submit for node 68d4cf05a5c2c05277bd0a2f 2025-09-27 00:36:39,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:36:39,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cf05a5c2c05277bd0a2f HTTP/1.1" 200 None 2025-09-27 00:36:39,157 - lava_callback - DEBUG - Processing node 68d4cf05a5c2c05277bd0a2f: baseline-arm64 2025-09-27 00:36:39,464 - lava_callback - ERROR - Error processing callback for node 68d4cf05a5c2c05277bd0a2f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:36:56,553 - lava_callback - INFO - Received callback for node 68d4cf09a5c2c05277bd0a32 INFO: 172.21.0.1:50088 - "POST /node/68d4cf09a5c2c05277bd0a32 HTTP/1.0" 202 Accepted 2025-09-27 00:36:56,559 - lava_callback - INFO - Starting async job submit for node 68d4cf09a5c2c05277bd0a32 2025-09-27 00:36:56,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:36:56,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cf09a5c2c05277bd0a32 HTTP/1.1" 200 None 2025-09-27 00:36:56,593 - lava_callback - DEBUG - Processing node 68d4cf09a5c2c05277bd0a32: baseline-arm64 2025-09-27 00:36:56,938 - lava_callback - ERROR - Error processing callback for node 68d4cf09a5c2c05277bd0a32: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:37:04,879 - lava_callback - INFO - Received callback for node 68d4cf09a5c2c05277bd0a35 INFO: 172.21.0.1:58584 - "POST /node/68d4cf09a5c2c05277bd0a35 HTTP/1.0" 202 Accepted 2025-09-27 00:37:04,885 - lava_callback - INFO - Starting async job submit for node 68d4cf09a5c2c05277bd0a35 2025-09-27 00:37:04,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:37:04,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cf09a5c2c05277bd0a35 HTTP/1.1" 200 None 2025-09-27 00:37:04,924 - lava_callback - DEBUG - Processing node 68d4cf09a5c2c05277bd0a35: baseline-arm64 2025-09-27 00:37:05,233 - lava_callback - ERROR - Error processing callback for node 68d4cf09a5c2c05277bd0a35: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:37:09,709 - lava_callback - INFO - Received callback for node 68d49dfca5c2c05277bcf18c INFO: 172.21.0.1:45820 - "POST /node/68d49dfca5c2c05277bcf18c HTTP/1.0" 202 Accepted 2025-09-27 00:37:09,716 - lava_callback - INFO - Starting async job submit for node 68d49dfca5c2c05277bcf18c 2025-09-27 00:37:09,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:37:09,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49dfca5c2c05277bcf18c HTTP/1.1" 200 None 2025-09-27 00:37:09,768 - lava_callback - DEBUG - Processing node 68d49dfca5c2c05277bcf18c: ltp-sched 2025-09-27 00:37:10,330 - lava_callback - ERROR - Error processing callback for node 68d49dfca5c2c05277bcf18c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 00:38:15,274 - lava_callback - INFO - Received callback for node 68d4e821a5c2c05277bd0ea4 INFO: 172.21.0.1:46686 - "POST /node/68d4e821a5c2c05277bd0ea4 HTTP/1.0" 202 Accepted 2025-09-27 00:38:15,280 - lava_callback - INFO - Starting async job submit for node 68d4e821a5c2c05277bd0ea4 2025-09-27 00:38:15,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:38:15,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e821a5c2c05277bd0ea4 HTTP/1.1" 200 None 2025-09-27 00:38:15,326 - lava_callback - DEBUG - Processing node 68d4e821a5c2c05277bd0ea4: baseline-arm64 2025-09-27 00:38:15,723 - lava_callback - ERROR - Error processing callback for node 68d4e821a5c2c05277bd0ea4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:38:25,395 - lava_callback - INFO - Received callback for node 68d4e820a5c2c05277bd0ea1 INFO: 172.21.0.1:51326 - "POST /node/68d4e820a5c2c05277bd0ea1 HTTP/1.0" 202 Accepted 2025-09-27 00:38:25,402 - lava_callback - INFO - Starting async job submit for node 68d4e820a5c2c05277bd0ea1 2025-09-27 00:38:25,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:38:25,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e820a5c2c05277bd0ea1 HTTP/1.1" 200 None 2025-09-27 00:38:25,450 - lava_callback - DEBUG - Processing node 68d4e820a5c2c05277bd0ea1: baseline-arm64 2025-09-27 00:38:25,882 - lava_callback - ERROR - Error processing callback for node 68d4e820a5c2c05277bd0ea1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:38:30,387 - lava_callback - INFO - Received callback for node 68d4e83da5c2c05277bd0ed7 INFO: 172.21.0.1:58106 - "POST /node/68d4e83da5c2c05277bd0ed7 HTTP/1.0" 202 Accepted 2025-09-27 00:38:30,395 - lava_callback - INFO - Starting async job submit for node 68d4e83da5c2c05277bd0ed7 2025-09-27 00:38:30,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:38:30,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e83da5c2c05277bd0ed7 HTTP/1.1" 200 None 2025-09-27 00:38:30,431 - lava_callback - DEBUG - Processing node 68d4e83da5c2c05277bd0ed7: baseline-arm64 2025-09-27 00:38:30,806 - lava_callback - ERROR - Error processing callback for node 68d4e83da5c2c05277bd0ed7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:38:50,122 - lava_callback - INFO - Received callback for node 68d52374b70fb2a1e20f1f3d INFO: 172.21.0.1:47626 - "POST /node/68d52374b70fb2a1e20f1f3d HTTP/1.0" 202 Accepted 2025-09-27 00:38:50,131 - lava_callback - INFO - Starting async job submit for node 68d52374b70fb2a1e20f1f3d 2025-09-27 00:38:50,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:38:50,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52374b70fb2a1e20f1f3d HTTP/1.1" 200 None 2025-09-27 00:38:50,192 - lava_callback - DEBUG - Processing node 68d52374b70fb2a1e20f1f3d: baseline-arm64-broonie 2025-09-27 00:38:50,555 - lava_callback - ERROR - Error processing callback for node 68d52374b70fb2a1e20f1f3d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:38:51,937 - lava_callback - INFO - Received callback for node 68d7319ca6a7b6615d4c4520 INFO: 172.21.0.1:47640 - "POST /node/68d7319ca6a7b6615d4c4520 HTTP/1.0" 202 Accepted 2025-09-27 00:38:51,962 - lava_callback - INFO - Starting async job submit for node 68d7319ca6a7b6615d4c4520 2025-09-27 00:38:52,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:38:52,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7319ca6a7b6615d4c4520 HTTP/1.1" 200 None 2025-09-27 00:38:52,077 - lava_callback - DEBUG - Processing node 68d7319ca6a7b6615d4c4520: baseline-arm 2025-09-27 00:38:52,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:38:52,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:38:52,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7319ca6a7b6615d4c4520/log.txt.gz 2025-09-27 00:38:52,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:38:53,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:38:53,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7319ca6a7b6615d4c4520/lava_callback.json.gz 2025-09-27 00:38:53,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:38:53,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7319ca6a7b6615d4c4520 HTTP/1.1" 200 None 2025-09-27 00:38:53,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:38:53,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e46a6a7b6615d4c4169 HTTP/1.1" 200 None 2025-09-27 00:38:53,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:38:53,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7319ca6a7b6615d4c4520 HTTP/1.1" 200 None 2025-09-27 00:38:53,284 - lava_callback - INFO - Completed processing callback for node 68d7319ca6a7b6615d4c4520 INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:39:26,763 - lava_callback - INFO - Received callback for node 68d72edfa6a7b6615d4c4194 INFO: 172.21.0.1:42462 - "POST /node/68d72edfa6a7b6615d4c4194 HTTP/1.0" 202 Accepted 2025-09-27 00:39:26,772 - lava_callback - INFO - Starting async job submit for node 68d72edfa6a7b6615d4c4194 2025-09-27 00:39:26,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:39:26,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72edfa6a7b6615d4c4194 HTTP/1.1" 200 None 2025-09-27 00:39:26,812 - lava_callback - DEBUG - Processing node 68d72edfa6a7b6615d4c4194: baseline-x86 2025-09-27 00:39:27,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:39:27,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:39:27,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d72edfa6a7b6615d4c4194/log.txt.gz 2025-09-27 00:39:27,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:39:27,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:39:27,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d72edfa6a7b6615d4c4194/lava_callback.json.gz 2025-09-27 00:39:27,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:39:27,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72edfa6a7b6615d4c4194 HTTP/1.1" 200 None 2025-09-27 00:39:27,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:39:27,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 00:39:27,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:39:27,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72edfa6a7b6615d4c4194 HTTP/1.1" 200 None 2025-09-27 00:39:27,382 - lava_callback - INFO - Completed processing callback for node 68d72edfa6a7b6615d4c4194 INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:39:38,943 - lava_callback - INFO - Received callback for node 68d4e83da5c2c05277bd0eda INFO: 172.21.0.1:48204 - "POST /node/68d4e83da5c2c05277bd0eda HTTP/1.0" 202 Accepted 2025-09-27 00:39:38,949 - lava_callback - INFO - Starting async job submit for node 68d4e83da5c2c05277bd0eda 2025-09-27 00:39:38,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:39:38,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e83da5c2c05277bd0eda HTTP/1.1" 200 None 2025-09-27 00:39:38,983 - lava_callback - DEBUG - Processing node 68d4e83da5c2c05277bd0eda: baseline-arm64 2025-09-27 00:39:39,334 - lava_callback - ERROR - Error processing callback for node 68d4e83da5c2c05277bd0eda: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:39:46,090 - lava_callback - INFO - Received callback for node 68d48bf2a5c2c05277bce528 INFO: 172.21.0.1:47722 - "POST /node/68d48bf2a5c2c05277bce528 HTTP/1.0" 202 Accepted 2025-09-27 00:39:46,096 - lava_callback - INFO - Starting async job submit for node 68d48bf2a5c2c05277bce528 2025-09-27 00:39:46,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:39:46,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d48bf2a5c2c05277bce528 HTTP/1.1" 200 None 2025-09-27 00:39:46,148 - lava_callback - DEBUG - Processing node 68d48bf2a5c2c05277bce528: baseline-arm 2025-09-27 00:39:46,439 - lava_callback - ERROR - Error processing callback for node 68d48bf2a5c2c05277bce528: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:40:08,719 - lava_callback - INFO - Received callback for node 68d4876ea5c2c05277bcddfd INFO: 172.21.0.1:58446 - "POST /node/68d4876ea5c2c05277bcddfd HTTP/1.0" 202 Accepted 2025-09-27 00:40:08,742 - lava_callback - INFO - Starting async job submit for node 68d4876ea5c2c05277bcddfd 2025-09-27 00:40:10,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:40:10,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4876ea5c2c05277bcddfd HTTP/1.1" 200 None 2025-09-27 00:40:10,101 - lava_callback - DEBUG - Processing node 68d4876ea5c2c05277bcddfd: ltp-syscalls INFO: 172.21.0.1:53958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:40:16,881 - lava_callback - ERROR - Error processing callback for node 68d4876ea5c2c05277bcddfd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:41:25,173 - lava_callback - INFO - Received callback for node 68d50189ef0c6c1c7020650f INFO: 172.21.0.1:55722 - "POST /node/68d50189ef0c6c1c7020650f HTTP/1.0" 202 Accepted 2025-09-27 00:41:25,180 - lava_callback - INFO - Starting async job submit for node 68d50189ef0c6c1c7020650f 2025-09-27 00:41:25,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:41:25,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d50189ef0c6c1c7020650f HTTP/1.1" 200 None 2025-09-27 00:41:25,241 - lava_callback - DEBUG - Processing node 68d50189ef0c6c1c7020650f: baseline-arm64 2025-09-27 00:41:25,580 - lava_callback - ERROR - Error processing callback for node 68d50189ef0c6c1c7020650f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:41:41,053 - lava_callback - INFO - Received callback for node 68d5512fb70fb2a1e20f244b INFO: 172.21.0.1:37548 - "POST /node/68d5512fb70fb2a1e20f244b HTTP/1.0" 202 Accepted 2025-09-27 00:41:41,060 - lava_callback - INFO - Starting async job submit for node 68d5512fb70fb2a1e20f244b 2025-09-27 00:41:41,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:41:41,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5512fb70fb2a1e20f244b HTTP/1.1" 200 None 2025-09-27 00:41:41,093 - lava_callback - DEBUG - Processing node 68d5512fb70fb2a1e20f244b: baseline-arm 2025-09-27 00:41:41,323 - lava_callback - ERROR - Error processing callback for node 68d5512fb70fb2a1e20f244b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:42:25,747 - lava_callback - INFO - Received callback for node 68d50194ef0c6c1c7020652e INFO: 172.21.0.1:37506 - "POST /node/68d50194ef0c6c1c7020652e HTTP/1.0" 202 Accepted 2025-09-27 00:42:25,760 - lava_callback - INFO - Starting async job submit for node 68d50194ef0c6c1c7020652e 2025-09-27 00:42:25,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:42:25,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d50194ef0c6c1c7020652e HTTP/1.1" 200 None 2025-09-27 00:42:25,856 - lava_callback - DEBUG - Processing node 68d50194ef0c6c1c7020652e: baseline-arm64 2025-09-27 00:42:26,548 - lava_callback - ERROR - Error processing callback for node 68d50194ef0c6c1c7020652e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:42:34,091 - lava_callback - INFO - Received callback for node 68d501daef0c6c1c702065c2 INFO: 172.21.0.1:55248 - "POST /node/68d501daef0c6c1c702065c2 HTTP/1.0" 202 Accepted 2025-09-27 00:42:34,108 - lava_callback - INFO - Starting async job submit for node 68d501daef0c6c1c702065c2 2025-09-27 00:42:34,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:42:34,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d501daef0c6c1c702065c2 HTTP/1.1" 200 None 2025-09-27 00:42:34,151 - lava_callback - DEBUG - Processing node 68d501daef0c6c1c702065c2: baseline-arm64 2025-09-27 00:42:36,031 - lava_callback - INFO - Received callback for node 68d501d5ef0c6c1c702065a2 INFO: 172.21.0.1:55260 - "POST /node/68d501d5ef0c6c1c702065a2 HTTP/1.0" 202 Accepted 2025-09-27 00:42:36,062 - lava_callback - INFO - Starting async job submit for node 68d501d5ef0c6c1c702065a2 2025-09-27 00:42:36,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:42:36,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d501d5ef0c6c1c702065a2 HTTP/1.1" 200 None 2025-09-27 00:42:36,198 - lava_callback - DEBUG - Processing node 68d501d5ef0c6c1c702065a2: baseline-arm64 INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:42:37,390 - lava_callback - ERROR - Error processing callback for node 68d501d5ef0c6c1c702065a2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:42:40,430 - lava_callback - ERROR - Error processing callback for node 68d501daef0c6c1c702065c2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:43:32,398 - lava_callback - INFO - Received callback for node 68d55130b70fb2a1e20f244e INFO: 172.21.0.1:38914 - "POST /node/68d55130b70fb2a1e20f244e HTTP/1.0" 202 Accepted 2025-09-27 00:43:32,408 - lava_callback - INFO - Starting async job submit for node 68d55130b70fb2a1e20f244e 2025-09-27 00:43:32,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:43:32,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d55130b70fb2a1e20f244e HTTP/1.1" 200 None 2025-09-27 00:43:32,484 - lava_callback - DEBUG - Processing node 68d55130b70fb2a1e20f244e: baseline-arm 2025-09-27 00:43:32,919 - lava_callback - ERROR - Error processing callback for node 68d55130b70fb2a1e20f244e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:43:46,197 - lava_callback - INFO - Received callback for node 68d51ccfb70fb2a1e20f1338 INFO: 172.21.0.1:33286 - "POST /node/68d51ccfb70fb2a1e20f1338 HTTP/1.0" 202 Accepted 2025-09-27 00:43:46,203 - lava_callback - INFO - Starting async job submit for node 68d51ccfb70fb2a1e20f1338 2025-09-27 00:43:46,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:43:46,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51ccfb70fb2a1e20f1338 HTTP/1.1" 200 None 2025-09-27 00:43:46,256 - lava_callback - DEBUG - Processing node 68d51ccfb70fb2a1e20f1338: baseline-arm64 INFO: 172.21.0.1:33296 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:43:46,880 - lava_callback - ERROR - Error processing callback for node 68d51ccfb70fb2a1e20f1338: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:43:59,703 - lava_callback - INFO - Received callback for node 68d72eefa6a7b6615d4c4199 INFO: 172.21.0.1:44762 - "POST /node/68d72eefa6a7b6615d4c4199 HTTP/1.0" 202 Accepted 2025-09-27 00:43:59,712 - lava_callback - INFO - Starting async job submit for node 68d72eefa6a7b6615d4c4199 2025-09-27 00:43:59,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:43:59,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72eefa6a7b6615d4c4199 HTTP/1.1" 200 None 2025-09-27 00:43:59,837 - lava_callback - DEBUG - Processing node 68d72eefa6a7b6615d4c4199: baseline-x86 2025-09-27 00:44:01,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:44:01,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:44:01,244 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d72eefa6a7b6615d4c4199/log.txt.gz 2025-09-27 00:44:01,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:44:01,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:44:01,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d72eefa6a7b6615d4c4199/lava_callback.json.gz DEBUG: Setup failed for 68d72eefa6a7b6615d4c4199. Transitting job node result: incomplete -> fail 2025-09-27 00:44:01,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:44:01,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72eefa6a7b6615d4c4199 HTTP/1.1" 200 None 2025-09-27 00:44:01,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:44:01,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 00:44:01,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:44:01,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72eefa6a7b6615d4c4199 HTTP/1.1" 200 None 2025-09-27 00:44:01,920 - lava_callback - INFO - Completed processing callback for node 68d72eefa6a7b6615d4c4199 INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:45:05,433 - lava_callback - INFO - Received callback for node 68d51cd0b70fb2a1e20f133b INFO: 172.21.0.1:49948 - "POST /node/68d51cd0b70fb2a1e20f133b HTTP/1.0" 202 Accepted 2025-09-27 00:45:05,442 - lava_callback - INFO - Starting async job submit for node 68d51cd0b70fb2a1e20f133b 2025-09-27 00:45:05,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:05,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51cd0b70fb2a1e20f133b HTTP/1.1" 200 None 2025-09-27 00:45:05,508 - lava_callback - DEBUG - Processing node 68d51cd0b70fb2a1e20f133b: baseline-arm64 2025-09-27 00:45:06,110 - lava_callback - ERROR - Error processing callback for node 68d51cd0b70fb2a1e20f133b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56632 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 00:45:16,005 - lava_callback - INFO - Received callback for node 68d51cd4b70fb2a1e20f133e INFO: 172.21.0.1:56638 - "POST /node/68d51cd4b70fb2a1e20f133e HTTP/1.0" 202 Accepted 2025-09-27 00:45:16,016 - lava_callback - INFO - Starting async job submit for node 68d51cd4b70fb2a1e20f133e 2025-09-27 00:45:16,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:16,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51cd4b70fb2a1e20f133e HTTP/1.1" 200 None 2025-09-27 00:45:16,061 - lava_callback - DEBUG - Processing node 68d51cd4b70fb2a1e20f133e: baseline-arm64 INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:45:16,642 - lava_callback - ERROR - Error processing callback for node 68d51cd4b70fb2a1e20f133e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:45:34,382 - lava_callback - INFO - Received callback for node 68d73389a6a7b6615d4c460e INFO: 172.21.0.1:34754 - "POST /node/68d73389a6a7b6615d4c460e HTTP/1.0" 202 Accepted 2025-09-27 00:45:34,388 - lava_callback - INFO - Starting async job submit for node 68d73389a6a7b6615d4c460e 2025-09-27 00:45:34,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:34,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73389a6a7b6615d4c460e HTTP/1.1" 200 None 2025-09-27 00:45:34,418 - lava_callback - DEBUG - Processing node 68d73389a6a7b6615d4c460e: baseline-x86 2025-09-27 00:45:34,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:45:34,683 - lava_callback - INFO - Received callback for node 68d72f4fa6a7b6615d4c41c6 INFO: 172.21.0.1:34764 - "POST /node/68d72f4fa6a7b6615d4c41c6 HTTP/1.0" 202 Accepted 2025-09-27 00:45:34,691 - lava_callback - INFO - Starting async job submit for node 68d72f4fa6a7b6615d4c41c6 2025-09-27 00:45:34,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:34,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4fa6a7b6615d4c41c6 HTTP/1.1" 200 None 2025-09-27 00:45:34,737 - lava_callback - DEBUG - Processing node 68d72f4fa6a7b6615d4c41c6: baseline-arm 2025-09-27 00:45:34,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:45:34,819 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d73389a6a7b6615d4c460e/log.txt.gz 2025-09-27 00:45:34,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:45:35,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:45:35,125 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d73389a6a7b6615d4c460e/lava_callback.json.gz 2025-09-27 00:45:35,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:35,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:45:35,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73389a6a7b6615d4c460e HTTP/1.1" 200 None 2025-09-27 00:45:35,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:35,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 00:45:35,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:35,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73389a6a7b6615d4c460e HTTP/1.1" 200 None 2025-09-27 00:45:35,257 - lava_callback - INFO - Completed processing callback for node 68d73389a6a7b6615d4c460e 2025-09-27 00:45:35,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:45:35,472 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4fa6a7b6615d4c41c6/log.txt.gz 2025-09-27 00:45:35,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:45:35,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:45:35,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d72f4fa6a7b6615d4c41c6/lava_callback.json.gz DEBUG: Setup failed for 68d72f4fa6a7b6615d4c41c6. Transitting job node result: incomplete -> fail 2025-09-27 00:45:35,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:35,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f4fa6a7b6615d4c41c6 HTTP/1.1" 200 None 2025-09-27 00:45:35,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:35,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 00:45:35,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:35,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f4fa6a7b6615d4c41c6 HTTP/1.1" 200 None 2025-09-27 00:45:35,794 - lava_callback - INFO - Completed processing callback for node 68d72f4fa6a7b6615d4c41c6 INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:45:42,856 - lava_callback - INFO - Received callback for node 68d55139b70fb2a1e20f2463 INFO: 172.21.0.1:49778 - "POST /node/68d55139b70fb2a1e20f2463 HTTP/1.0" 202 Accepted 2025-09-27 00:45:42,866 - lava_callback - INFO - Starting async job submit for node 68d55139b70fb2a1e20f2463 2025-09-27 00:45:42,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:42,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d55139b70fb2a1e20f2463 HTTP/1.1" 200 None 2025-09-27 00:45:42,919 - lava_callback - DEBUG - Processing node 68d55139b70fb2a1e20f2463: baseline-arm 2025-09-27 00:45:43,186 - lava_callback - ERROR - Error processing callback for node 68d55139b70fb2a1e20f2463: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:45:45,192 - lava_callback - INFO - Received callback for node 68d51cd5b70fb2a1e20f1341 INFO: 172.21.0.1:49784 - "POST /node/68d51cd5b70fb2a1e20f1341 HTTP/1.0" 202 Accepted 2025-09-27 00:45:45,199 - lava_callback - INFO - Starting async job submit for node 68d51cd5b70fb2a1e20f1341 2025-09-27 00:45:45,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:45:45,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51cd5b70fb2a1e20f1341 HTTP/1.1" 200 None 2025-09-27 00:45:45,233 - lava_callback - DEBUG - Processing node 68d51cd5b70fb2a1e20f1341: baseline-arm64 2025-09-27 00:45:45,620 - lava_callback - ERROR - Error processing callback for node 68d51cd5b70fb2a1e20f1341: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:46:05,663 - lava_callback - INFO - Received callback for node 68d51cd9b70fb2a1e20f1344 INFO: 172.21.0.1:45022 - "POST /node/68d51cd9b70fb2a1e20f1344 HTTP/1.0" 202 Accepted 2025-09-27 00:46:05,670 - lava_callback - INFO - Starting async job submit for node 68d51cd9b70fb2a1e20f1344 2025-09-27 00:46:05,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:05,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51cd9b70fb2a1e20f1344 HTTP/1.1" 200 None 2025-09-27 00:46:05,706 - lava_callback - DEBUG - Processing node 68d51cd9b70fb2a1e20f1344: baseline-arm64 2025-09-27 00:46:06,151 - lava_callback - ERROR - Error processing callback for node 68d51cd9b70fb2a1e20f1344: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:46:34,299 - lava_callback - INFO - Received callback for node 68d733b8a6a7b6615d4c4643 INFO: 172.21.0.1:51468 - "POST /node/68d733b8a6a7b6615d4c4643 HTTP/1.0" 202 Accepted 2025-09-27 00:46:34,305 - lava_callback - INFO - Starting async job submit for node 68d733b8a6a7b6615d4c4643 2025-09-27 00:46:34,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:34,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b8a6a7b6615d4c4643 HTTP/1.1" 200 None 2025-09-27 00:46:34,338 - lava_callback - DEBUG - Processing node 68d733b8a6a7b6615d4c4643: baseline-arm 2025-09-27 00:46:34,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:46:34,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:46:34,857 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b8a6a7b6615d4c4643/log.txt.gz 2025-09-27 00:46:34,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:46:34,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:46:34,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b8a6a7b6615d4c4643/lava_callback.json.gz 2025-09-27 00:46:34,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:35,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b8a6a7b6615d4c4643 HTTP/1.1" 200 None 2025-09-27 00:46:35,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:35,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:46:35,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:35,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733b8a6a7b6615d4c4643 HTTP/1.1" 200 None 2025-09-27 00:46:35,052 - lava_callback - INFO - Completed processing callback for node 68d733b8a6a7b6615d4c4643 2025-09-27 00:46:36,482 - lava_callback - INFO - Received callback for node 68d51cdab70fb2a1e20f1347 INFO: 172.21.0.1:51482 - "POST /node/68d51cdab70fb2a1e20f1347 HTTP/1.0" 202 Accepted 2025-09-27 00:46:36,490 - lava_callback - INFO - Starting async job submit for node 68d51cdab70fb2a1e20f1347 2025-09-27 00:46:36,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:46:36,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51cdab70fb2a1e20f1347 HTTP/1.1" 200 None 2025-09-27 00:46:36,527 - lava_callback - DEBUG - Processing node 68d51cdab70fb2a1e20f1347: baseline-arm64 2025-09-27 00:46:36,864 - lava_callback - ERROR - Error processing callback for node 68d51cdab70fb2a1e20f1347: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:46:41,318 - lava_callback - INFO - Received callback for node 68d733b6a6a7b6615d4c4637 INFO: 172.21.0.1:55576 - "POST /node/68d733b6a6a7b6615d4c4637 HTTP/1.0" 202 Accepted 2025-09-27 00:46:41,324 - lava_callback - INFO - Starting async job submit for node 68d733b6a6a7b6615d4c4637 2025-09-27 00:46:41,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:41,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b6a6a7b6615d4c4637 HTTP/1.1" 200 None 2025-09-27 00:46:41,356 - lava_callback - DEBUG - Processing node 68d733b6a6a7b6615d4c4637: baseline-arm 2025-09-27 00:46:41,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:46:41,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:46:41,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b6a6a7b6615d4c4637/log.txt.gz 2025-09-27 00:46:41,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:46:42,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:46:42,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b6a6a7b6615d4c4637/lava_callback.json.gz 2025-09-27 00:46:42,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:42,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b6a6a7b6615d4c4637 HTTP/1.1" 200 None 2025-09-27 00:46:42,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:42,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:46:42,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:42,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733b6a6a7b6615d4c4637 HTTP/1.1" 200 None 2025-09-27 00:46:42,147 - lava_callback - INFO - Completed processing callback for node 68d733b6a6a7b6615d4c4637 INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:46:53,239 - lava_callback - INFO - Received callback for node 68d73389a6a7b6615d4c4611 INFO: 172.21.0.1:49872 - "POST /node/68d73389a6a7b6615d4c4611 HTTP/1.0" 202 Accepted 2025-09-27 00:46:53,245 - lava_callback - INFO - Starting async job submit for node 68d73389a6a7b6615d4c4611 2025-09-27 00:46:53,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:53,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73389a6a7b6615d4c4611 HTTP/1.1" 200 None 2025-09-27 00:46:53,275 - lava_callback - DEBUG - Processing node 68d73389a6a7b6615d4c4611: baseline-x86 2025-09-27 00:46:53,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:46:53,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:46:53,695 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d73389a6a7b6615d4c4611/log.txt.gz 2025-09-27 00:46:53,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:46:53,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:46:53,834 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d73389a6a7b6615d4c4611/lava_callback.json.gz 2025-09-27 00:46:53,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:53,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73389a6a7b6615d4c4611 HTTP/1.1" 200 None 2025-09-27 00:46:53,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:53,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 00:46:53,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:53,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73389a6a7b6615d4c4611 HTTP/1.1" 200 None 2025-09-27 00:46:53,907 - lava_callback - INFO - Completed processing callback for node 68d73389a6a7b6615d4c4611 2025-09-27 00:46:55,827 - lava_callback - INFO - Received callback for node 68d51ce3b70fb2a1e20f136d INFO: 172.21.0.1:49882 - "POST /node/68d51ce3b70fb2a1e20f136d HTTP/1.0" 202 Accepted 2025-09-27 00:46:55,833 - lava_callback - INFO - Starting async job submit for node 68d51ce3b70fb2a1e20f136d 2025-09-27 00:46:55,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:46:55,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51ce3b70fb2a1e20f136d HTTP/1.1" 200 None 2025-09-27 00:46:55,877 - lava_callback - DEBUG - Processing node 68d51ce3b70fb2a1e20f136d: baseline-arm64 2025-09-27 00:46:56,214 - lava_callback - ERROR - Error processing callback for node 68d51ce3b70fb2a1e20f136d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:47:00,702 - lava_callback - INFO - Received callback for node 68d733b8a6a7b6615d4c4649 INFO: 172.21.0.1:46328 - "POST /node/68d733b8a6a7b6615d4c4649 HTTP/1.0" 202 Accepted 2025-09-27 00:47:00,708 - lava_callback - INFO - Starting async job submit for node 68d733b8a6a7b6615d4c4649 2025-09-27 00:47:00,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:00,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b8a6a7b6615d4c4649 HTTP/1.1" 200 None 2025-09-27 00:47:00,821 - lava_callback - DEBUG - Processing node 68d733b8a6a7b6615d4c4649: baseline-arm-baylibre 2025-09-27 00:47:01,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:01,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:01,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733b8a6a7b6615d4c4649/log.txt.gz 2025-09-27 00:47:01,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:01,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:01,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733b8a6a7b6615d4c4649/lava_callback.json.gz 2025-09-27 00:47:01,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:01,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b8a6a7b6615d4c4649 HTTP/1.1" 200 None 2025-09-27 00:47:01,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:01,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:01,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:01,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733b8a6a7b6615d4c4649 HTTP/1.1" 200 None 2025-09-27 00:47:01,524 - lava_callback - INFO - Completed processing callback for node 68d733b8a6a7b6615d4c4649 2025-09-27 00:47:06,384 - lava_callback - INFO - Received callback for node 68d51ce5b70fb2a1e20f1370 INFO: 172.21.0.1:46332 - "POST /node/68d51ce5b70fb2a1e20f1370 HTTP/1.0" 202 Accepted 2025-09-27 00:47:06,390 - lava_callback - INFO - Starting async job submit for node 68d51ce5b70fb2a1e20f1370 2025-09-27 00:47:06,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:06,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51ce5b70fb2a1e20f1370 HTTP/1.1" 200 None 2025-09-27 00:47:06,423 - lava_callback - DEBUG - Processing node 68d51ce5b70fb2a1e20f1370: baseline-arm64 INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:47:06,756 - lava_callback - ERROR - Error processing callback for node 68d51ce5b70fb2a1e20f1370: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:47:13,167 - lava_callback - INFO - Received callback for node 68d733b6a6a7b6615d4c463a INFO: 172.21.0.1:36424 - "POST /node/68d733b6a6a7b6615d4c463a HTTP/1.0" 202 Accepted 2025-09-27 00:47:13,173 - lava_callback - INFO - Starting async job submit for node 68d733b6a6a7b6615d4c463a 2025-09-27 00:47:13,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:13,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b6a6a7b6615d4c463a HTTP/1.1" 200 None 2025-09-27 00:47:13,209 - lava_callback - DEBUG - Processing node 68d733b6a6a7b6615d4c463a: baseline-arm 2025-09-27 00:47:13,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:13,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:13,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b6a6a7b6615d4c463a/log.txt.gz 2025-09-27 00:47:13,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:13,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:13,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b6a6a7b6615d4c463a/lava_callback.json.gz 2025-09-27 00:47:13,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:13,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b6a6a7b6615d4c463a HTTP/1.1" 200 None 2025-09-27 00:47:13,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:13,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:13,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:13,727 - lava_callback - INFO - Received callback for node 68d733c9a6a7b6615d4c46b5 2025-09-27 00:47:13,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733b6a6a7b6615d4c463a HTTP/1.1" 200 None 2025-09-27 00:47:13,762 - lava_callback - INFO - Completed processing callback for node 68d733b6a6a7b6615d4c463a INFO: 172.21.0.1:36438 - "POST /node/68d733c9a6a7b6615d4c46b5 HTTP/1.0" 202 Accepted 2025-09-27 00:47:13,781 - lava_callback - INFO - Starting async job submit for node 68d733c9a6a7b6615d4c46b5 2025-09-27 00:47:13,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:13,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c9a6a7b6615d4c46b5 HTTP/1.1" 200 None 2025-09-27 00:47:13,859 - lava_callback - DEBUG - Processing node 68d733c9a6a7b6615d4c46b5: baseline-arm-pengutronix 2025-09-27 00:47:13,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:14,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:14,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d733c9a6a7b6615d4c46b5/log.txt.gz 2025-09-27 00:47:14,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:14,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:14,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d733c9a6a7b6615d4c46b5/lava_callback.json.gz 2025-09-27 00:47:14,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:14,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c9a6a7b6615d4c46b5 HTTP/1.1" 200 None 2025-09-27 00:47:14,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:14,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:14,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:14,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733c9a6a7b6615d4c46b5 HTTP/1.1" 200 None 2025-09-27 00:47:14,323 - lava_callback - INFO - Completed processing callback for node 68d733c9a6a7b6615d4c46b5 INFO: 172.21.0.1:36446 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 00:47:15,526 - lava_callback - INFO - Received callback for node 68d733b4a6a7b6615d4c462e INFO: 172.21.0.1:36452 - "POST /node/68d733b4a6a7b6615d4c462e HTTP/1.0" 202 Accepted 2025-09-27 00:47:15,532 - lava_callback - INFO - Starting async job submit for node 68d733b4a6a7b6615d4c462e 2025-09-27 00:47:15,555 - lava_callback - INFO - Received callback for node 68d733c7a6a7b6615d4c46ac INFO: 172.21.0.1:36464 - "POST /node/68d733c7a6a7b6615d4c46ac HTTP/1.0" 202 Accepted 2025-09-27 00:47:15,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:15,562 - lava_callback - INFO - Starting async job submit for node 68d733c7a6a7b6615d4c46ac 2025-09-27 00:47:15,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:15,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b4a6a7b6615d4c462e HTTP/1.1" 200 None 2025-09-27 00:47:15,603 - lava_callback - DEBUG - Processing node 68d733b4a6a7b6615d4c462e: baseline-arm 2025-09-27 00:47:15,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c7a6a7b6615d4c46ac HTTP/1.1" 200 None 2025-09-27 00:47:15,630 - lava_callback - DEBUG - Processing node 68d733c7a6a7b6615d4c46ac: baseline-arm-pengutronix 2025-09-27 00:47:15,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:15,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:16,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:16,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d733c7a6a7b6615d4c46ac/log.txt.gz 2025-09-27 00:47:16,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:16,122 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b4a6a7b6615d4c462e/log.txt.gz 2025-09-27 00:47:16,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:16,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:16,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:16,265 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d733c7a6a7b6615d4c46ac/lava_callback.json.gz 2025-09-27 00:47:16,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:16,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:16,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b4a6a7b6615d4c462e/lava_callback.json.gz 2025-09-27 00:47:16,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c7a6a7b6615d4c46ac HTTP/1.1" 200 None 2025-09-27 00:47:16,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:16,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b4a6a7b6615d4c462e HTTP/1.1" 200 None 2025-09-27 00:47:16,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:16,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:16,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:16,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:16,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:16,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733c7a6a7b6615d4c46ac HTTP/1.1" 200 None 2025-09-27 00:47:16,393 - lava_callback - INFO - Completed processing callback for node 68d733c7a6a7b6615d4c46ac 2025-09-27 00:47:16,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733b4a6a7b6615d4c462e HTTP/1.1" 200 None 2025-09-27 00:47:16,395 - lava_callback - INFO - Completed processing callback for node 68d733b4a6a7b6615d4c462e INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:47:32,379 - lava_callback - INFO - Received callback for node 68d733c2a6a7b6615d4c4688 INFO: 172.21.0.1:40450 - "POST /node/68d733c2a6a7b6615d4c4688 HTTP/1.0" 202 Accepted 2025-09-27 00:47:32,385 - lava_callback - INFO - Starting async job submit for node 68d733c2a6a7b6615d4c4688 2025-09-27 00:47:32,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:32,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c2a6a7b6615d4c4688 HTTP/1.1" 200 None 2025-09-27 00:47:32,419 - lava_callback - DEBUG - Processing node 68d733c2a6a7b6615d4c4688: baseline-arm-clabbe 2025-09-27 00:47:32,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:32,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:32,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d733c2a6a7b6615d4c4688/log.txt.gz 2025-09-27 00:47:32,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:32,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:32,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d733c2a6a7b6615d4c4688/lava_callback.json.gz 2025-09-27 00:47:32,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:32,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c2a6a7b6615d4c4688 HTTP/1.1" 200 None 2025-09-27 00:47:32,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:32,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:32,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:32,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733c2a6a7b6615d4c4688 HTTP/1.1" 200 None 2025-09-27 00:47:32,949 - lava_callback - INFO - Completed processing callback for node 68d733c2a6a7b6615d4c4688 2025-09-27 00:47:33,747 - lava_callback - INFO - Received callback for node 68d733bda6a7b6615d4c4667 INFO: 172.21.0.1:40456 - "POST /node/68d733bda6a7b6615d4c4667 HTTP/1.0" 202 Accepted 2025-09-27 00:47:33,753 - lava_callback - INFO - Starting async job submit for node 68d733bda6a7b6615d4c4667 2025-09-27 00:47:33,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:33,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733bda6a7b6615d4c4667 HTTP/1.1" 200 None 2025-09-27 00:47:33,787 - lava_callback - DEBUG - Processing node 68d733bda6a7b6615d4c4667: baseline-arm-broonie 2025-09-27 00:47:34,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:34,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:34,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d733bda6a7b6615d4c4667/log.txt.gz 2025-09-27 00:47:34,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:34,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:34,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d733bda6a7b6615d4c4667/lava_callback.json.gz 2025-09-27 00:47:34,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:34,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733bda6a7b6615d4c4667 HTTP/1.1" 200 None 2025-09-27 00:47:34,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:34,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:34,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:34,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733bda6a7b6615d4c4667 HTTP/1.1" 200 None 2025-09-27 00:47:34,296 - lava_callback - INFO - Completed processing callback for node 68d733bda6a7b6615d4c4667 2025-09-27 00:47:35,507 - lava_callback - INFO - Received callback for node 68d733c6a6a7b6615d4c46a3 INFO: 172.21.0.1:40464 - "POST /node/68d733c6a6a7b6615d4c46a3 HTTP/1.0" 202 Accepted 2025-09-27 00:47:35,513 - lava_callback - INFO - Starting async job submit for node 68d733c6a6a7b6615d4c46a3 2025-09-27 00:47:35,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:35,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c6a6a7b6615d4c46a3 HTTP/1.1" 200 None 2025-09-27 00:47:35,554 - lava_callback - DEBUG - Processing node 68d733c6a6a7b6615d4c46a3: baseline-arm-kontron 2025-09-27 00:47:35,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:35,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:35,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d733c6a6a7b6615d4c46a3/log.txt.gz 2025-09-27 00:47:35,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:35,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:35,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d733c6a6a7b6615d4c46a3/lava_callback.json.gz 2025-09-27 00:47:35,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:35,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c6a6a7b6615d4c46a3 HTTP/1.1" 200 None 2025-09-27 00:47:35,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:36,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:36,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:36,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733c6a6a7b6615d4c46a3 HTTP/1.1" 200 None 2025-09-27 00:47:36,045 - lava_callback - INFO - Completed processing callback for node 68d733c6a6a7b6615d4c46a3 INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:47:36,712 - lava_callback - INFO - Received callback for node 68d733c6a6a7b6615d4c46a9 INFO: 172.21.0.1:40486 - "POST /node/68d733c6a6a7b6615d4c46a9 HTTP/1.0" 202 Accepted 2025-09-27 00:47:36,718 - lava_callback - INFO - Starting async job submit for node 68d733c6a6a7b6615d4c46a9 2025-09-27 00:47:36,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:36,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c6a6a7b6615d4c46a9 HTTP/1.1" 200 None 2025-09-27 00:47:36,754 - lava_callback - DEBUG - Processing node 68d733c6a6a7b6615d4c46a9: baseline-arm-kontron 2025-09-27 00:47:36,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:36,974 - lava_callback - INFO - Received callback for node 68d7337ea6a7b6615d4c4605 INFO: 172.21.0.1:40492 - "POST /node/68d7337ea6a7b6615d4c4605 HTTP/1.0" 202 Accepted 2025-09-27 00:47:36,983 - lava_callback - INFO - Starting async job submit for node 68d7337ea6a7b6615d4c4605 2025-09-27 00:47:37,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:37,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7337ea6a7b6615d4c4605 HTTP/1.1" 200 None 2025-09-27 00:47:37,021 - lava_callback - DEBUG - Processing node 68d7337ea6a7b6615d4c4605: baseline-x86 2025-09-27 00:47:37,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:37,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d733c6a6a7b6615d4c46a9/log.txt.gz 2025-09-27 00:47:37,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40494 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:47:37,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:37,401 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d733c6a6a7b6615d4c46a9/lava_callback.json.gz 2025-09-27 00:47:37,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:37,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:37,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c6a6a7b6615d4c46a9 HTTP/1.1" 200 None 2025-09-27 00:47:37,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:37,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:37,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:37,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733c6a6a7b6615d4c46a9 HTTP/1.1" 200 None 2025-09-27 00:47:37,629 - lava_callback - INFO - Completed processing callback for node 68d733c6a6a7b6615d4c46a9 2025-09-27 00:47:37,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:37,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d7337ea6a7b6615d4c4605/log.txt.gz 2025-09-27 00:47:37,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:37,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:37,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d7337ea6a7b6615d4c4605/lava_callback.json.gz 2025-09-27 00:47:38,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:38,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7337ea6a7b6615d4c4605 HTTP/1.1" 200 None 2025-09-27 00:47:38,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:38,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 00:47:38,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:38,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7337ea6a7b6615d4c4605 HTTP/1.1" 200 None 2025-09-27 00:47:38,082 - lava_callback - INFO - Completed processing callback for node 68d7337ea6a7b6615d4c4605 2025-09-27 00:47:39,496 - lava_callback - INFO - Received callback for node 68d733bda6a7b6615d4c466d INFO: 172.21.0.1:53406 - "POST /node/68d733bda6a7b6615d4c466d HTTP/1.0" 202 Accepted 2025-09-27 00:47:39,503 - lava_callback - INFO - Starting async job submit for node 68d733bda6a7b6615d4c466d 2025-09-27 00:47:39,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:39,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733bda6a7b6615d4c466d HTTP/1.1" 200 None 2025-09-27 00:47:39,539 - lava_callback - DEBUG - Processing node 68d733bda6a7b6615d4c466d: baseline-arm-broonie 2025-09-27 00:47:39,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:39,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:39,865 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d733bda6a7b6615d4c466d/log.txt.gz 2025-09-27 00:47:39,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:39,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:39,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d733bda6a7b6615d4c466d/lava_callback.json.gz 2025-09-27 00:47:40,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:40,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733bda6a7b6615d4c466d HTTP/1.1" 200 None 2025-09-27 00:47:40,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:40,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:40,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:40,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733bda6a7b6615d4c466d HTTP/1.1" 200 None 2025-09-27 00:47:40,065 - lava_callback - INFO - Completed processing callback for node 68d733bda6a7b6615d4c466d 2025-09-27 00:47:43,078 - lava_callback - INFO - Received callback for node 68d55139b70fb2a1e20f2466 INFO: 172.21.0.1:53410 - "POST /node/68d55139b70fb2a1e20f2466 HTTP/1.0" 202 Accepted 2025-09-27 00:47:43,084 - lava_callback - INFO - Starting async job submit for node 68d55139b70fb2a1e20f2466 2025-09-27 00:47:43,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:43,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d55139b70fb2a1e20f2466 HTTP/1.1" 200 None 2025-09-27 00:47:43,122 - lava_callback - DEBUG - Processing node 68d55139b70fb2a1e20f2466: baseline-arm 2025-09-27 00:47:43,347 - lava_callback - ERROR - Error processing callback for node 68d55139b70fb2a1e20f2466: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:47:43,870 - lava_callback - INFO - Received callback for node 68d733b9a6a7b6615d4c464c INFO: 172.21.0.1:53426 - "POST /node/68d733b9a6a7b6615d4c464c HTTP/1.0" 202 Accepted 2025-09-27 00:47:43,876 - lava_callback - INFO - Starting async job submit for node 68d733b9a6a7b6615d4c464c 2025-09-27 00:47:43,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:43,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b9a6a7b6615d4c464c HTTP/1.1" 200 None 2025-09-27 00:47:43,912 - lava_callback - DEBUG - Processing node 68d733b9a6a7b6615d4c464c: baseline-arm-baylibre 2025-09-27 00:47:44,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:44,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:44,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733b9a6a7b6615d4c464c/log.txt.gz 2025-09-27 00:47:44,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:44,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:44,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733b9a6a7b6615d4c464c/lava_callback.json.gz 2025-09-27 00:47:44,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:44,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b9a6a7b6615d4c464c HTTP/1.1" 200 None 2025-09-27 00:47:44,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:44,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:44,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:44,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733b9a6a7b6615d4c464c HTTP/1.1" 200 None 2025-09-27 00:47:44,460 - lava_callback - INFO - Completed processing callback for node 68d733b9a6a7b6615d4c464c INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:47:48,611 - lava_callback - INFO - Received callback for node 68d733bba6a7b6615d4c465b INFO: 172.21.0.1:53438 - "POST /node/68d733bba6a7b6615d4c465b HTTP/1.0" 202 Accepted 2025-09-27 00:47:48,617 - lava_callback - INFO - Starting async job submit for node 68d733bba6a7b6615d4c465b 2025-09-27 00:47:48,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:48,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733bba6a7b6615d4c465b HTTP/1.1" 200 None 2025-09-27 00:47:48,659 - lava_callback - DEBUG - Processing node 68d733bba6a7b6615d4c465b: baseline-arm-baylibre 2025-09-27 00:47:48,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:48,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:48,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733bba6a7b6615d4c465b/log.txt.gz 2025-09-27 00:47:48,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:47:49,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:47:49,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733bba6a7b6615d4c465b/lava_callback.json.gz 2025-09-27 00:47:49,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:49,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733bba6a7b6615d4c465b HTTP/1.1" 200 None 2025-09-27 00:47:49,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:49,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:47:49,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:49,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733bba6a7b6615d4c465b HTTP/1.1" 200 None 2025-09-27 00:47:49,198 - lava_callback - INFO - Completed processing callback for node 68d733bba6a7b6615d4c465b INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:47:56,569 - lava_callback - INFO - Received callback for node 68d51d53b70fb2a1e20f1793 INFO: 172.21.0.1:60256 - "POST /node/68d51d53b70fb2a1e20f1793 HTTP/1.0" 202 Accepted 2025-09-27 00:47:56,576 - lava_callback - INFO - Starting async job submit for node 68d51d53b70fb2a1e20f1793 2025-09-27 00:47:56,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:47:56,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51d53b70fb2a1e20f1793 HTTP/1.1" 200 None 2025-09-27 00:47:56,610 - lava_callback - DEBUG - Processing node 68d51d53b70fb2a1e20f1793: baseline-arm64 2025-09-27 00:47:56,938 - lava_callback - ERROR - Error processing callback for node 68d51d53b70fb2a1e20f1793: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:48:04,596 - lava_callback - INFO - Received callback for node 68d733bba6a7b6615d4c4661 INFO: 172.21.0.1:60518 - "POST /node/68d733bba6a7b6615d4c4661 HTTP/1.0" 202 Accepted 2025-09-27 00:48:04,605 - lava_callback - INFO - Starting async job submit for node 68d733bba6a7b6615d4c4661 2025-09-27 00:48:04,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:04,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733bba6a7b6615d4c4661 HTTP/1.1" 200 None 2025-09-27 00:48:04,688 - lava_callback - DEBUG - Processing node 68d733bba6a7b6615d4c4661: baseline-arm-baylibre 2025-09-27 00:48:05,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:05,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:05,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733bba6a7b6615d4c4661/log.txt.gz 2025-09-27 00:48:05,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:05,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:05,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733bba6a7b6615d4c4661/lava_callback.json.gz 2025-09-27 00:48:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:05,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733bba6a7b6615d4c4661 HTTP/1.1" 200 None 2025-09-27 00:48:05,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:05,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:48:05,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:05,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733bba6a7b6615d4c4661 HTTP/1.1" 200 None 2025-09-27 00:48:05,949 - lava_callback - INFO - Completed processing callback for node 68d733bba6a7b6615d4c4661 INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 00:48:15,432 - lava_callback - INFO - Received callback for node 68d733c8a6a7b6615d4c46b2 INFO: 172.21.0.1:38160 - "POST /node/68d733c8a6a7b6615d4c46b2 HTTP/1.0" 202 Accepted 2025-09-27 00:48:15,441 - lava_callback - INFO - Starting async job submit for node 68d733c8a6a7b6615d4c46b2 2025-09-27 00:48:15,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:15,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c8a6a7b6615d4c46b2 HTTP/1.1" 200 None 2025-09-27 00:48:15,507 - lava_callback - DEBUG - Processing node 68d733c8a6a7b6615d4c46b2: baseline-arm-pengutronix 2025-09-27 00:48:15,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:16,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:16,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d733c8a6a7b6615d4c46b2/log.txt.gz 2025-09-27 00:48:16,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:48:16,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:16,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d733c8a6a7b6615d4c46b2/lava_callback.json.gz 2025-09-27 00:48:16,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:16,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c8a6a7b6615d4c46b2 HTTP/1.1" 200 None 2025-09-27 00:48:16,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:16,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:48:16,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:16,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733c8a6a7b6615d4c46b2 HTTP/1.1" 200 None 2025-09-27 00:48:16,668 - lava_callback - INFO - Completed processing callback for node 68d733c8a6a7b6615d4c46b2 2025-09-27 00:48:17,626 - lava_callback - INFO - Received callback for node 68d733baa6a7b6615d4c4652 INFO: 172.21.0.1:38176 - "POST /node/68d733baa6a7b6615d4c4652 HTTP/1.0" 202 Accepted 2025-09-27 00:48:17,638 - lava_callback - INFO - Starting async job submit for node 68d733baa6a7b6615d4c4652 2025-09-27 00:48:17,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:17,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733baa6a7b6615d4c4652 HTTP/1.1" 200 None 2025-09-27 00:48:17,716 - lava_callback - DEBUG - Processing node 68d733baa6a7b6615d4c4652: baseline-arm-baylibre 2025-09-27 00:48:18,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:18,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:18,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733baa6a7b6615d4c4652/log.txt.gz 2025-09-27 00:48:18,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:19,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:19,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733baa6a7b6615d4c4652/lava_callback.json.gz 2025-09-27 00:48:19,186 - lava_callback - INFO - Received callback for node 68d733baa6a7b6615d4c464f 2025-09-27 00:48:19,195 - lava_callback - INFO - Starting async job submit for node 68d733baa6a7b6615d4c464f 2025-09-27 00:48:19,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:38184 - "POST /node/68d733baa6a7b6615d4c464f HTTP/1.0" 202 Accepted 2025-09-27 00:48:19,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:19,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733baa6a7b6615d4c4652 HTTP/1.1" 200 None 2025-09-27 00:48:19,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:19,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733baa6a7b6615d4c464f HTTP/1.1" 200 None 2025-09-27 00:48:19,257 - lava_callback - DEBUG - Processing node 68d733baa6a7b6615d4c464f: baseline-arm-baylibre 2025-09-27 00:48:19,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:48:19,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:19,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733baa6a7b6615d4c4652 HTTP/1.1" 200 None 2025-09-27 00:48:19,399 - lava_callback - INFO - Completed processing callback for node 68d733baa6a7b6615d4c4652 2025-09-27 00:48:19,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:20,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:20,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733baa6a7b6615d4c464f/log.txt.gz 2025-09-27 00:48:20,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:20,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:20,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d733baa6a7b6615d4c464f/lava_callback.json.gz 2025-09-27 00:48:20,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:20,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733baa6a7b6615d4c464f HTTP/1.1" 200 None 2025-09-27 00:48:20,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:20,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:48:20,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:20,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733baa6a7b6615d4c464f HTTP/1.1" 200 None 2025-09-27 00:48:20,835 - lava_callback - INFO - Completed processing callback for node 68d733baa6a7b6615d4c464f INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:48:29,618 - lava_callback - INFO - Received callback for node 68d51d53b70fb2a1e20f1796 INFO: 172.21.0.1:42394 - "POST /node/68d51d53b70fb2a1e20f1796 HTTP/1.0" 202 Accepted 2025-09-27 00:48:29,635 - lava_callback - INFO - Starting async job submit for node 68d51d53b70fb2a1e20f1796 2025-09-27 00:48:29,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:29,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51d53b70fb2a1e20f1796 HTTP/1.1" 200 None 2025-09-27 00:48:29,690 - lava_callback - DEBUG - Processing node 68d51d53b70fb2a1e20f1796: baseline-arm64 2025-09-27 00:48:30,358 - lava_callback - ERROR - Error processing callback for node 68d51d53b70fb2a1e20f1796: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:48:37,610 - lava_callback - INFO - Received callback for node 68d733cca6a7b6615d4c46c7 INFO: 172.21.0.1:42430 - "POST /node/68d733cca6a7b6615d4c46c7 HTTP/1.0" 202 Accepted 2025-09-27 00:48:37,627 - lava_callback - INFO - Starting async job submit for node 68d733cca6a7b6615d4c46c7 2025-09-27 00:48:37,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:37,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733cca6a7b6615d4c46c7 HTTP/1.1" 200 None 2025-09-27 00:48:37,711 - lava_callback - DEBUG - Processing node 68d733cca6a7b6615d4c46c7: ltp-dio 2025-09-27 00:48:38,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:38,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:38,623 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d733cca6a7b6615d4c46c7/log.txt.gz 2025-09-27 00:48:38,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:38,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:38,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d733cca6a7b6615d4c46c7/lava_callback.json.gz 2025-09-27 00:48:38,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:39,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733cca6a7b6615d4c46c7 HTTP/1.1" 200 None 2025-09-27 00:48:39,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:39,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:48:39,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:39,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733cca6a7b6615d4c46c7 HTTP/1.1" 200 None 2025-09-27 00:48:39,105 - lava_callback - INFO - Completed processing callback for node 68d733cca6a7b6615d4c46c7 2025-09-27 00:48:42,659 - lava_callback - INFO - Received callback for node 68d72f06a6a7b6615d4c41a3 INFO: 172.21.0.1:44384 - "POST /node/68d72f06a6a7b6615d4c41a3 HTTP/1.0" 202 Accepted 2025-09-27 00:48:42,667 - lava_callback - INFO - Starting async job submit for node 68d72f06a6a7b6615d4c41a3 2025-09-27 00:48:42,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:42,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f06a6a7b6615d4c41a3 HTTP/1.1" 200 None 2025-09-27 00:48:42,703 - lava_callback - DEBUG - Processing node 68d72f06a6a7b6615d4c41a3: blktests-ddp-x86 2025-09-27 00:48:43,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:44,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:44,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d72f06a6a7b6615d4c41a3/log.txt.gz 2025-09-27 00:48:44,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:48:44,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:48:44,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d72f06a6a7b6615d4c41a3/lava_callback.json.gz 2025-09-27 00:48:45,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:45,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72f06a6a7b6615d4c41a3 HTTP/1.1" 200 None 2025-09-27 00:48:45,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:45,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 00:48:45,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:45,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d72f06a6a7b6615d4c41a3 HTTP/1.1" 200 None 2025-09-27 00:48:45,158 - lava_callback - INFO - Completed processing callback for node 68d72f06a6a7b6615d4c41a3 2025-09-27 00:48:45,714 - lava_callback - INFO - Received callback for node 68d51d56b70fb2a1e20f1799 INFO: 172.21.0.1:44388 - "POST /node/68d51d56b70fb2a1e20f1799 HTTP/1.0" 202 Accepted 2025-09-27 00:48:45,724 - lava_callback - INFO - Starting async job submit for node 68d51d56b70fb2a1e20f1799 2025-09-27 00:48:45,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:48:45,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51d56b70fb2a1e20f1799 HTTP/1.1" 200 None 2025-09-27 00:48:45,794 - lava_callback - DEBUG - Processing node 68d51d56b70fb2a1e20f1799: baseline-arm64 2025-09-27 00:48:46,575 - lava_callback - ERROR - Error processing callback for node 68d51d56b70fb2a1e20f1799: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:49:11,471 - lava_callback - INFO - Received callback for node 68d733c4a6a7b6615d4c4699 INFO: 172.21.0.1:48206 - "POST /node/68d733c4a6a7b6615d4c4699 HTTP/1.0" 202 Accepted 2025-09-27 00:49:11,477 - lava_callback - INFO - Starting async job submit for node 68d733c4a6a7b6615d4c4699 2025-09-27 00:49:11,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:11,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c4a6a7b6615d4c4699 HTTP/1.1" 200 None 2025-09-27 00:49:11,533 - lava_callback - DEBUG - Processing node 68d733c4a6a7b6615d4c4699: baseline-arm-clabbe 2025-09-27 00:49:11,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:49:11,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:49:11,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d733c4a6a7b6615d4c4699/log.txt.gz 2025-09-27 00:49:11,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:49:12,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:49:12,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d733c4a6a7b6615d4c4699/lava_callback.json.gz 2025-09-27 00:49:12,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:12,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c4a6a7b6615d4c4699 HTTP/1.1" 200 None 2025-09-27 00:49:12,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:12,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:49:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:12,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733c4a6a7b6615d4c4699 HTTP/1.1" 200 None 2025-09-27 00:49:12,156 - lava_callback - INFO - Completed processing callback for node 68d733c4a6a7b6615d4c4699 INFO: 172.21.0.1:48210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:49:17,199 - lava_callback - INFO - Received callback for node 68d51d56b70fb2a1e20f179c INFO: 172.21.0.1:48236 - "POST /node/68d51d56b70fb2a1e20f179c HTTP/1.0" 202 Accepted 2025-09-27 00:49:17,205 - lava_callback - INFO - Starting async job submit for node 68d51d56b70fb2a1e20f179c 2025-09-27 00:49:17,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:17,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51d56b70fb2a1e20f179c HTTP/1.1" 200 None 2025-09-27 00:49:17,239 - lava_callback - DEBUG - Processing node 68d51d56b70fb2a1e20f179c: baseline-arm64 2025-09-27 00:49:17,573 - lava_callback - ERROR - Error processing callback for node 68d51d56b70fb2a1e20f179c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:49:29,756 - lava_callback - INFO - Received callback for node 68d73451a6a7b6615d4c473b INFO: 172.21.0.1:47362 - "POST /node/68d73451a6a7b6615d4c473b HTTP/1.0" 202 Accepted 2025-09-27 00:49:29,769 - lava_callback - INFO - Starting async job submit for node 68d73451a6a7b6615d4c473b 2025-09-27 00:49:29,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:29,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73451a6a7b6615d4c473b HTTP/1.1" 200 None 2025-09-27 00:49:29,812 - lava_callback - DEBUG - Processing node 68d73451a6a7b6615d4c473b: baseline-arm-pengutronix 2025-09-27 00:49:29,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:49:30,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:49:30,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d73451a6a7b6615d4c473b/log.txt.gz 2025-09-27 00:49:30,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:49:30,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:49:30,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d73451a6a7b6615d4c473b/lava_callback.json.gz 2025-09-27 00:49:30,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:30,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73451a6a7b6615d4c473b HTTP/1.1" 200 None 2025-09-27 00:49:30,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:30,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:49:30,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:49:30,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73451a6a7b6615d4c473b HTTP/1.1" 200 None 2025-09-27 00:49:30,399 - lava_callback - INFO - Completed processing callback for node 68d73451a6a7b6615d4c473b 2025-09-27 00:49:36,507 - lava_callback - INFO - Received callback for node 68d553c9b70fb2a1e20f252e INFO: 172.21.0.1:47374 - "POST /node/68d553c9b70fb2a1e20f252e HTTP/1.0" 202 Accepted 2025-09-27 00:49:36,513 - lava_callback - INFO - Starting async job submit for node 68d553c9b70fb2a1e20f252e 2025-09-27 00:49:36,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:49:36,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d553c9b70fb2a1e20f252e HTTP/1.1" 200 None 2025-09-27 00:49:36,547 - lava_callback - DEBUG - Processing node 68d553c9b70fb2a1e20f252e: baseline-arm 2025-09-27 00:49:36,763 - lava_callback - ERROR - Error processing callback for node 68d553c9b70fb2a1e20f252e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:50:18,561 - lava_callback - INFO - Received callback for node 68d51d5ab70fb2a1e20f17ad INFO: 172.21.0.1:50762 - "POST /node/68d51d5ab70fb2a1e20f17ad HTTP/1.0" 202 Accepted 2025-09-27 00:50:18,570 - lava_callback - INFO - Starting async job submit for node 68d51d5ab70fb2a1e20f17ad 2025-09-27 00:50:18,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:50:18,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51d5ab70fb2a1e20f17ad HTTP/1.1" 200 None 2025-09-27 00:50:18,663 - lava_callback - DEBUG - Processing node 68d51d5ab70fb2a1e20f17ad: baseline-arm64 2025-09-27 00:50:19,273 - lava_callback - ERROR - Error processing callback for node 68d51d5ab70fb2a1e20f17ad: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 00:50:25,534 - lava_callback - INFO - Received callback for node 68d51d59b70fb2a1e20f17a3 INFO: 172.21.0.1:56850 - "POST /node/68d51d59b70fb2a1e20f17a3 HTTP/1.0" 202 Accepted 2025-09-27 00:50:25,544 - lava_callback - INFO - Starting async job submit for node 68d51d59b70fb2a1e20f17a3 2025-09-27 00:50:25,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:50:25,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51d59b70fb2a1e20f17a3 HTTP/1.1" 200 None 2025-09-27 00:50:25,645 - lava_callback - DEBUG - Processing node 68d51d59b70fb2a1e20f17a3: baseline-arm64 2025-09-27 00:50:26,348 - lava_callback - ERROR - Error processing callback for node 68d51d59b70fb2a1e20f17a3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56858 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:50:28,461 - lava_callback - INFO - Received callback for node 68d49dffa5c2c05277bcf18f INFO: 172.21.0.1:56872 - "POST /node/68d49dffa5c2c05277bcf18f HTTP/1.0" 202 Accepted 2025-09-27 00:50:28,469 - lava_callback - INFO - Starting async job submit for node 68d49dffa5c2c05277bcf18f 2025-09-27 00:50:28,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:50:28,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49dffa5c2c05277bcf18f HTTP/1.1" 200 None 2025-09-27 00:50:28,526 - lava_callback - DEBUG - Processing node 68d49dffa5c2c05277bcf18f: ltp-syscalls-ipc 2025-09-27 00:50:29,399 - lava_callback - ERROR - Error processing callback for node 68d49dffa5c2c05277bcf18f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:50:43,495 - lava_callback - INFO - Received callback for node 68d51d5db70fb2a1e20f17b0 INFO: 172.21.0.1:40912 - "POST /node/68d51d5db70fb2a1e20f17b0 HTTP/1.0" 202 Accepted 2025-09-27 00:50:43,502 - lava_callback - INFO - Starting async job submit for node 68d51d5db70fb2a1e20f17b0 2025-09-27 00:50:43,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:50:43,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51d5db70fb2a1e20f17b0 HTTP/1.1" 200 None 2025-09-27 00:50:43,536 - lava_callback - DEBUG - Processing node 68d51d5db70fb2a1e20f17b0: baseline-arm64 2025-09-27 00:50:43,877 - lava_callback - ERROR - Error processing callback for node 68d51d5db70fb2a1e20f17b0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40920 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:50:50,559 - lava_callback - INFO - Received callback for node 68d733c5a6a7b6615d4c469d INFO: 172.21.0.1:41298 - "POST /node/68d733c5a6a7b6615d4c469d HTTP/1.0" 202 Accepted 2025-09-27 00:50:50,565 - lava_callback - INFO - Starting async job submit for node 68d733c5a6a7b6615d4c469d 2025-09-27 00:50:50,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:50:50,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c5a6a7b6615d4c469d HTTP/1.1" 200 None 2025-09-27 00:50:50,598 - lava_callback - DEBUG - Processing node 68d733c5a6a7b6615d4c469d: baseline-arm-clabbe 2025-09-27 00:50:50,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:50:50,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:50:50,955 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d733c5a6a7b6615d4c469d/log.txt.gz 2025-09-27 00:50:50,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:50:51,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:50:51,100 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d733c5a6a7b6615d4c469d/lava_callback.json.gz 2025-09-27 00:50:51,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:50:51,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733c5a6a7b6615d4c469d HTTP/1.1" 200 None 2025-09-27 00:50:51,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:50:51,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 00:50:51,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:50:51,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733c5a6a7b6615d4c469d HTTP/1.1" 200 None 2025-09-27 00:50:51,176 - lava_callback - INFO - Completed processing callback for node 68d733c5a6a7b6615d4c469d INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:51:04,305 - lava_callback - INFO - Received callback for node 68d7302fa6a7b6615d4c4426 INFO: 172.21.0.1:49044 - "POST /node/68d7302fa6a7b6615d4c4426 HTTP/1.0" 202 Accepted 2025-09-27 00:51:04,311 - lava_callback - INFO - Starting async job submit for node 68d7302fa6a7b6615d4c4426 2025-09-27 00:51:04,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:51:04,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7302fa6a7b6615d4c4426 HTTP/1.1" 200 None 2025-09-27 00:51:04,354 - lava_callback - DEBUG - Processing node 68d7302fa6a7b6615d4c4426: baseline-x86-kcidebug-intel 2025-09-27 00:51:04,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:51:04,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:51:04,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d7302fa6a7b6615d4c4426/log.txt.gz 2025-09-27 00:51:04,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:51:04,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:51:04,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d7302fa6a7b6615d4c4426/lava_callback.json.gz DEBUG: Setup failed for 68d7302fa6a7b6615d4c4426. Transitting job node result: incomplete -> fail 2025-09-27 00:51:04,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:51:04,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7302fa6a7b6615d4c4426 HTTP/1.1" 200 None 2025-09-27 00:51:04,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:51:04,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a4d3c94e462c68828c2 HTTP/1.1" 200 None 2025-09-27 00:51:04,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:51:04,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7302fa6a7b6615d4c4426 HTTP/1.1" 200 None 2025-09-27 00:51:04,984 - lava_callback - INFO - Completed processing callback for node 68d7302fa6a7b6615d4c4426 INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:51:36,497 - lava_callback - INFO - Received callback for node 68d51d5db70fb2a1e20f17b3 INFO: 172.21.0.1:52266 - "POST /node/68d51d5db70fb2a1e20f17b3 HTTP/1.0" 202 Accepted 2025-09-27 00:51:36,504 - lava_callback - INFO - Starting async job submit for node 68d51d5db70fb2a1e20f17b3 2025-09-27 00:51:36,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52278 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:51:36,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d51d5db70fb2a1e20f17b3 HTTP/1.1" 200 None 2025-09-27 00:51:36,539 - lava_callback - DEBUG - Processing node 68d51d5db70fb2a1e20f17b3: baseline-arm64 2025-09-27 00:51:36,864 - lava_callback - ERROR - Error processing callback for node 68d51d5db70fb2a1e20f17b3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:51:43,142 - lava_callback - INFO - Received callback for node 68d553cab70fb2a1e20f2531 INFO: 172.21.0.1:56060 - "POST /node/68d553cab70fb2a1e20f2531 HTTP/1.0" 202 Accepted 2025-09-27 00:51:43,148 - lava_callback - INFO - Starting async job submit for node 68d553cab70fb2a1e20f2531 2025-09-27 00:51:43,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:51:43,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d553cab70fb2a1e20f2531 HTTP/1.1" 200 None 2025-09-27 00:51:43,181 - lava_callback - DEBUG - Processing node 68d553cab70fb2a1e20f2531: baseline-arm 2025-09-27 00:51:43,426 - lava_callback - ERROR - Error processing callback for node 68d553cab70fb2a1e20f2531: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:53:23,552 - lava_callback - INFO - Received callback for node 68d5226bb70fb2a1e20f1d48 INFO: 172.21.0.1:35966 - "POST /node/68d5226bb70fb2a1e20f1d48 HTTP/1.0" 202 Accepted 2025-09-27 00:53:23,562 - lava_callback - INFO - Starting async job submit for node 68d5226bb70fb2a1e20f1d48 2025-09-27 00:53:23,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:53:23,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5226bb70fb2a1e20f1d48 HTTP/1.1" 200 None 2025-09-27 00:53:23,616 - lava_callback - DEBUG - Processing node 68d5226bb70fb2a1e20f1d48: baseline-arm64 2025-09-27 00:53:24,159 - lava_callback - ERROR - Error processing callback for node 68d5226bb70fb2a1e20f1d48: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:53:39,364 - lava_callback - INFO - Received callback for node 68d55403b70fb2a1e20f254b INFO: 172.21.0.1:45282 - "POST /node/68d55403b70fb2a1e20f254b HTTP/1.0" 202 Accepted 2025-09-27 00:53:39,371 - lava_callback - INFO - Starting async job submit for node 68d55403b70fb2a1e20f254b 2025-09-27 00:53:39,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:53:39,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d55403b70fb2a1e20f254b HTTP/1.1" 200 None 2025-09-27 00:53:39,429 - lava_callback - DEBUG - Processing node 68d55403b70fb2a1e20f254b: baseline-arm 2025-09-27 00:53:39,746 - lava_callback - ERROR - Error processing callback for node 68d55403b70fb2a1e20f254b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:54:39,838 - lava_callback - INFO - Received callback for node 68d5226cb70fb2a1e20f1d4b INFO: 172.21.0.1:55396 - "POST /node/68d5226cb70fb2a1e20f1d4b HTTP/1.0" 202 Accepted 2025-09-27 00:54:39,848 - lava_callback - INFO - Starting async job submit for node 68d5226cb70fb2a1e20f1d4b 2025-09-27 00:54:39,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:54:39,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5226cb70fb2a1e20f1d4b HTTP/1.1" 200 None 2025-09-27 00:54:39,927 - lava_callback - DEBUG - Processing node 68d5226cb70fb2a1e20f1d4b: baseline-arm64 2025-09-27 00:54:40,473 - lava_callback - ERROR - Error processing callback for node 68d5226cb70fb2a1e20f1d4b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:55:27,817 - lava_callback - INFO - Received callback for node 68d492eda5c2c05277bce8e5 INFO: 172.21.0.1:38484 - "POST /node/68d492eda5c2c05277bce8e5 HTTP/1.0" 202 Accepted 2025-09-27 00:55:27,823 - lava_callback - INFO - Starting async job submit for node 68d492eda5c2c05277bce8e5 2025-09-27 00:55:27,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:55:27,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d492eda5c2c05277bce8e5 HTTP/1.1" 200 None 2025-09-27 00:55:27,842 - lava_callback - DEBUG - Processing node 68d492eda5c2c05277bce8e5: baseline-arm 2025-09-27 00:55:27,842 - lava_callback - ERROR - Error processing callback for node 68d492eda5c2c05277bce8e5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:55:44,277 - lava_callback - INFO - Received callback for node 68d55404b70fb2a1e20f255a INFO: 172.21.0.1:50274 - "POST /node/68d55404b70fb2a1e20f255a HTTP/1.0" 202 Accepted 2025-09-27 00:55:44,283 - lava_callback - INFO - Starting async job submit for node 68d55404b70fb2a1e20f255a 2025-09-27 00:55:44,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:55:44,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d55404b70fb2a1e20f255a HTTP/1.1" 200 None 2025-09-27 00:55:44,318 - lava_callback - DEBUG - Processing node 68d55404b70fb2a1e20f255a: baseline-arm 2025-09-27 00:55:44,539 - lava_callback - ERROR - Error processing callback for node 68d55404b70fb2a1e20f255a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:56:02,619 - lava_callback - INFO - Received callback for node 68d52272b70fb2a1e20f1d4e INFO: 172.21.0.1:35208 - "POST /node/68d52272b70fb2a1e20f1d4e HTTP/1.0" 202 Accepted 2025-09-27 00:56:02,627 - lava_callback - INFO - Starting async job submit for node 68d52272b70fb2a1e20f1d4e 2025-09-27 00:56:02,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:56:02,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52272b70fb2a1e20f1d4e HTTP/1.1" 200 None 2025-09-27 00:56:02,689 - lava_callback - DEBUG - Processing node 68d52272b70fb2a1e20f1d4e: baseline-arm64 2025-09-27 00:56:03,262 - lava_callback - ERROR - Error processing callback for node 68d52272b70fb2a1e20f1d4e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:56:10,832 - lava_callback - INFO - Received callback for node 68d4a03ba5c2c05277bcf19e INFO: 172.21.0.1:33348 - "POST /node/68d4a03ba5c2c05277bcf19e HTTP/1.0" 202 Accepted 2025-09-27 00:56:10,841 - lava_callback - INFO - Starting async job submit for node 68d4a03ba5c2c05277bcf19e 2025-09-27 00:56:10,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:56:10,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a03ba5c2c05277bcf19e HTTP/1.1" 200 None 2025-09-27 00:56:10,895 - lava_callback - DEBUG - Processing node 68d4a03ba5c2c05277bcf19e: ltp-syscalls-ipc 2025-09-27 00:56:12,147 - lava_callback - ERROR - Error processing callback for node 68d4a03ba5c2c05277bcf19e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:56:48,443 - lava_callback - INFO - Received callback for node 68d49eeaa5c2c05277bcf196 INFO: 172.21.0.1:53934 - "POST /node/68d49eeaa5c2c05277bcf196 HTTP/1.0" 202 Accepted 2025-09-27 00:56:48,451 - lava_callback - INFO - Starting async job submit for node 68d49eeaa5c2c05277bcf196 2025-09-27 00:56:48,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:56:48,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49eeaa5c2c05277bcf196 HTTP/1.1" 200 None 2025-09-27 00:56:48,531 - lava_callback - DEBUG - Processing node 68d49eeaa5c2c05277bcf196: ltp-sched 2025-09-27 00:56:49,544 - lava_callback - ERROR - Error processing callback for node 68d49eeaa5c2c05277bcf196: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:57:19,437 - lava_callback - INFO - Received callback for node 68d52273b70fb2a1e20f1d51 INFO: 172.21.0.1:55388 - "POST /node/68d52273b70fb2a1e20f1d51 HTTP/1.0" 202 Accepted 2025-09-27 00:57:19,444 - lava_callback - INFO - Starting async job submit for node 68d52273b70fb2a1e20f1d51 2025-09-27 00:57:19,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:57:19,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52273b70fb2a1e20f1d51 HTTP/1.1" 200 None 2025-09-27 00:57:19,502 - lava_callback - DEBUG - Processing node 68d52273b70fb2a1e20f1d51: baseline-arm64 2025-09-27 00:57:20,129 - lava_callback - ERROR - Error processing callback for node 68d52273b70fb2a1e20f1d51: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:57:31,966 - lava_callback - INFO - Received callback for node 68d7319da6a7b6615d4c4523 INFO: 172.21.0.1:53996 - "POST /node/68d7319da6a7b6615d4c4523 HTTP/1.0" 202 Accepted 2025-09-27 00:57:31,987 - lava_callback - INFO - Starting async job submit for node 68d7319da6a7b6615d4c4523 2025-09-27 00:57:32,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:57:32,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7319da6a7b6615d4c4523 HTTP/1.1" 200 None 2025-09-27 00:57:32,179 - lava_callback - DEBUG - Processing node 68d7319da6a7b6615d4c4523: ltp-smoketest 2025-09-27 00:57:33,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:57:33,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:57:33,506 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d7319da6a7b6615d4c4523/log.txt.gz 2025-09-27 00:57:33,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 00:57:34,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 00:57:34,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d7319da6a7b6615d4c4523/lava_callback.json.gz 2025-09-27 00:57:34,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:57:34,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7319da6a7b6615d4c4523 HTTP/1.1" 200 None 2025-09-27 00:57:34,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:57:34,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e46a6a7b6615d4c4169 HTTP/1.1" 200 None 2025-09-27 00:57:34,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:57:34,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7319da6a7b6615d4c4523 HTTP/1.1" 200 None 2025-09-27 00:57:34,495 - lava_callback - INFO - Completed processing callback for node 68d7319da6a7b6615d4c4523 INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:58:40,321 - lava_callback - INFO - Received callback for node 68d52279b70fb2a1e20f1d54 INFO: 172.21.0.1:42088 - "POST /node/68d52279b70fb2a1e20f1d54 HTTP/1.0" 202 Accepted 2025-09-27 00:58:40,331 - lava_callback - INFO - Starting async job submit for node 68d52279b70fb2a1e20f1d54 2025-09-27 00:58:40,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:58:40,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52279b70fb2a1e20f1d54 HTTP/1.1" 200 None 2025-09-27 00:58:40,399 - lava_callback - DEBUG - Processing node 68d52279b70fb2a1e20f1d54: baseline-arm64 2025-09-27 00:58:41,055 - lava_callback - ERROR - Error processing callback for node 68d52279b70fb2a1e20f1d54: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK 2025-09-27 00:59:25,792 - lava_callback - INFO - Received callback for node 68d492e9a5c2c05277bce8e2 INFO: 172.21.0.1:45678 - "POST /node/68d492e9a5c2c05277bce8e2 HTTP/1.0" 202 Accepted 2025-09-27 00:59:25,799 - lava_callback - INFO - Starting async job submit for node 68d492e9a5c2c05277bce8e2 2025-09-27 00:59:25,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 00:59:25,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d492e9a5c2c05277bce8e2 HTTP/1.1" 200 None 2025-09-27 00:59:25,896 - lava_callback - DEBUG - Processing node 68d492e9a5c2c05277bce8e2: baseline-arm 2025-09-27 00:59:26,275 - lava_callback - ERROR - Error processing callback for node 68d492e9a5c2c05277bce8e2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:00:02,714 - lava_callback - INFO - Received callback for node 68d5227ab70fb2a1e20f1d57 INFO: 172.21.0.1:55392 - "POST /node/68d5227ab70fb2a1e20f1d57 HTTP/1.0" 202 Accepted 2025-09-27 01:00:02,724 - lava_callback - INFO - Starting async job submit for node 68d5227ab70fb2a1e20f1d57 2025-09-27 01:00:02,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:02,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5227ab70fb2a1e20f1d57 HTTP/1.1" 200 None 2025-09-27 01:00:02,771 - lava_callback - DEBUG - Processing node 68d5227ab70fb2a1e20f1d57: baseline-arm64 2025-09-27 01:00:03,264 - lava_callback - ERROR - Error processing callback for node 68d5227ab70fb2a1e20f1d57: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:00:23,892 - lava_callback - INFO - Received callback for node 68d73266a6a7b6615d4c4580 INFO: 172.21.0.1:37552 - "POST /node/68d73266a6a7b6615d4c4580 HTTP/1.0" 202 Accepted 2025-09-27 01:00:23,940 - lava_callback - INFO - Starting async job submit for node 68d73266a6a7b6615d4c4580 2025-09-27 01:00:23,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:23,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73266a6a7b6615d4c4580 HTTP/1.1" 200 None 2025-09-27 01:00:24,000 - lava_callback - DEBUG - Processing node 68d73266a6a7b6615d4c4580: baseline-x86 2025-09-27 01:00:24,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:24,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:24,261 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d73266a6a7b6615d4c4580/log.txt.gz 2025-09-27 01:00:24,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:24,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:24,401 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d73266a6a7b6615d4c4580/lava_callback.json.gz 2025-09-27 01:00:24,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:24,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73266a6a7b6615d4c4580 HTTP/1.1" 200 None 2025-09-27 01:00:24,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:24,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 01:00:24,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:24,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73266a6a7b6615d4c4580 HTTP/1.1" 200 None 2025-09-27 01:00:24,551 - lava_callback - INFO - Completed processing callback for node 68d73266a6a7b6615d4c4580 INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:00:52,175 - lava_callback - INFO - Received callback for node 68d736fba6a7b6615d4c4846 INFO: 172.21.0.1:38876 - "POST /node/68d736fba6a7b6615d4c4846 HTTP/1.0" 202 Accepted 2025-09-27 01:00:52,183 - lava_callback - INFO - Starting async job submit for node 68d736fba6a7b6615d4c4846 2025-09-27 01:00:52,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:52,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736fba6a7b6615d4c4846 HTTP/1.1" 200 None 2025-09-27 01:00:52,249 - lava_callback - DEBUG - Processing node 68d736fba6a7b6615d4c4846: baseline-arm64-foundriesio 2025-09-27 01:00:52,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:52,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:52,730 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d736fba6a7b6615d4c4846/log.txt.gz 2025-09-27 01:00:52,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:52,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:52,847 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d736fba6a7b6615d4c4846/lava_callback.json.gz 2025-09-27 01:00:52,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:52,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736fba6a7b6615d4c4846 HTTP/1.1" 200 None 2025-09-27 01:00:52,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:52,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:00:52,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:52,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736fba6a7b6615d4c4846 HTTP/1.1" 200 None 2025-09-27 01:00:52,931 - lava_callback - INFO - Completed processing callback for node 68d736fba6a7b6615d4c4846 2025-09-27 01:00:55,472 - lava_callback - INFO - Received callback for node 68d736f8a6a7b6615d4c483a INFO: 172.21.0.1:38888 - "POST /node/68d736f8a6a7b6615d4c483a HTTP/1.0" 202 Accepted 2025-09-27 01:00:55,478 - lava_callback - INFO - Starting async job submit for node 68d736f8a6a7b6615d4c483a 2025-09-27 01:00:55,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:55,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f8a6a7b6615d4c483a HTTP/1.1" 200 None 2025-09-27 01:00:55,518 - lava_callback - DEBUG - Processing node 68d736f8a6a7b6615d4c483a: baseline-arm64-pengutronix 2025-09-27 01:00:55,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:55,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:55,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d736f8a6a7b6615d4c483a/log.txt.gz 2025-09-27 01:00:55,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:55,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:55,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d736f8a6a7b6615d4c483a/lava_callback.json.gz 2025-09-27 01:00:55,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:55,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f8a6a7b6615d4c483a HTTP/1.1" 200 None 2025-09-27 01:00:56,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:56,011 - lava_callback - INFO - Received callback for node 68d736f6a6a7b6615d4c4831 INFO: 172.21.0.1:38894 - "POST /node/68d736f6a6a7b6615d4c4831 HTTP/1.0" 202 Accepted 2025-09-27 01:00:56,017 - lava_callback - INFO - Starting async job submit for node 68d736f6a6a7b6615d4c4831 2025-09-27 01:00:56,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:00:56,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:56,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:56,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f6a6a7b6615d4c4831 HTTP/1.1" 200 None 2025-09-27 01:00:56,075 - lava_callback - DEBUG - Processing node 68d736f6a6a7b6615d4c4831: baseline-arm64-kontron 2025-09-27 01:00:56,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736f8a6a7b6615d4c483a HTTP/1.1" 200 None 2025-09-27 01:00:56,099 - lava_callback - INFO - Completed processing callback for node 68d736f8a6a7b6615d4c483a 2025-09-27 01:00:56,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:00:56,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:56,647 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d736f6a6a7b6615d4c4831/log.txt.gz 2025-09-27 01:00:56,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:56,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:56,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d736f6a6a7b6615d4c4831/lava_callback.json.gz 2025-09-27 01:00:56,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:56,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f6a6a7b6615d4c4831 HTTP/1.1" 200 None 2025-09-27 01:00:56,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:56,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:00:56,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:56,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736f6a6a7b6615d4c4831 HTTP/1.1" 200 None 2025-09-27 01:00:56,891 - lava_callback - INFO - Completed processing callback for node 68d736f6a6a7b6615d4c4831 2025-09-27 01:00:57,256 - lava_callback - INFO - Received callback for node 68d736f7a6a7b6615d4c4834 INFO: 172.21.0.1:38918 - "POST /node/68d736f7a6a7b6615d4c4834 HTTP/1.0" 202 Accepted 2025-09-27 01:00:57,263 - lava_callback - INFO - Starting async job submit for node 68d736f7a6a7b6615d4c4834 2025-09-27 01:00:57,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:57,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f7a6a7b6615d4c4834 HTTP/1.1" 200 None 2025-09-27 01:00:57,300 - lava_callback - DEBUG - Processing node 68d736f7a6a7b6615d4c4834: baseline-arm64-kontron 2025-09-27 01:00:57,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:57,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:57,662 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d736f7a6a7b6615d4c4834/log.txt.gz 2025-09-27 01:00:57,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:57,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:57,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d736f7a6a7b6615d4c4834/lava_callback.json.gz 2025-09-27 01:00:57,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:57,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f7a6a7b6615d4c4834 HTTP/1.1" 200 None 2025-09-27 01:00:57,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:57,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:00:57,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:57,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736f7a6a7b6615d4c4834 HTTP/1.1" 200 None 2025-09-27 01:00:57,898 - lava_callback - INFO - Completed processing callback for node 68d736f7a6a7b6615d4c4834 2025-09-27 01:00:59,622 - lava_callback - INFO - Received callback for node 68d736faa6a7b6615d4c4843 INFO: 172.21.0.1:35054 - "POST /node/68d736faa6a7b6615d4c4843 HTTP/1.0" 202 Accepted 2025-09-27 01:00:59,629 - lava_callback - INFO - Starting async job submit for node 68d736faa6a7b6615d4c4843 2025-09-27 01:00:59,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:00:59,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736faa6a7b6615d4c4843 HTTP/1.1" 200 None 2025-09-27 01:00:59,661 - lava_callback - DEBUG - Processing node 68d736faa6a7b6615d4c4843: baseline-arm64-foundriesio 2025-09-27 01:00:59,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:00:59,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:00:59,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d736faa6a7b6615d4c4843/log.txt.gz 2025-09-27 01:00:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:00,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:00,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d736faa6a7b6615d4c4843/lava_callback.json.gz 2025-09-27 01:01:00,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:00,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736faa6a7b6615d4c4843 HTTP/1.1" 200 None 2025-09-27 01:01:00,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:00,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:00,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:00,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736faa6a7b6615d4c4843 HTTP/1.1" 200 None 2025-09-27 01:01:00,249 - lava_callback - INFO - Completed processing callback for node 68d736faa6a7b6615d4c4843 INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:01:03,653 - lava_callback - INFO - Received callback for node 68d736faa6a7b6615d4c4840 INFO: 172.21.0.1:35070 - "POST /node/68d736faa6a7b6615d4c4840 HTTP/1.0" 202 Accepted 2025-09-27 01:01:03,659 - lava_callback - INFO - Starting async job submit for node 68d736faa6a7b6615d4c4840 2025-09-27 01:01:03,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:03,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736faa6a7b6615d4c4840 HTTP/1.1" 200 None 2025-09-27 01:01:03,710 - lava_callback - DEBUG - Processing node 68d736faa6a7b6615d4c4840: baseline-arm64-pengutronix 2025-09-27 01:01:03,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:04,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:04,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d736faa6a7b6615d4c4840/log.txt.gz 2025-09-27 01:01:04,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:04,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:04,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d736faa6a7b6615d4c4840/lava_callback.json.gz 2025-09-27 01:01:04,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:04,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736faa6a7b6615d4c4840 HTTP/1.1" 200 None 2025-09-27 01:01:04,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:04,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:04,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:04,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736faa6a7b6615d4c4840 HTTP/1.1" 200 None 2025-09-27 01:01:04,244 - lava_callback - INFO - Completed processing callback for node 68d736faa6a7b6615d4c4840 INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:01:13,267 - lava_callback - INFO - Received callback for node 68d736dda6a7b6615d4c478d INFO: 172.21.0.1:42906 - "POST /node/68d736dda6a7b6615d4c478d HTTP/1.0" 202 Accepted 2025-09-27 01:01:13,273 - lava_callback - INFO - Starting async job submit for node 68d736dda6a7b6615d4c478d 2025-09-27 01:01:13,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:13,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dda6a7b6615d4c478d HTTP/1.1" 200 None 2025-09-27 01:01:13,309 - lava_callback - DEBUG - Processing node 68d736dda6a7b6615d4c478d: baseline-arm64 2025-09-27 01:01:13,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:13,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:13,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dda6a7b6615d4c478d/log.txt.gz 2025-09-27 01:01:13,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:13,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:13,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dda6a7b6615d4c478d/lava_callback.json.gz 2025-09-27 01:01:13,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:13,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dda6a7b6615d4c478d HTTP/1.1" 200 None 2025-09-27 01:01:13,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:13,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:13,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:13,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736dda6a7b6615d4c478d HTTP/1.1" 200 None 2025-09-27 01:01:13,868 - lava_callback - INFO - Completed processing callback for node 68d736dda6a7b6615d4c478d INFO: 172.21.0.1:42916 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 01:01:16,274 - lava_callback - INFO - Received callback for node 68d736e3a6a7b6615d4c47b6 INFO: 172.21.0.1:42932 - "POST /node/68d736e3a6a7b6615d4c47b6 HTTP/1.0" 202 Accepted 2025-09-27 01:01:16,280 - lava_callback - INFO - Starting async job submit for node 68d736e3a6a7b6615d4c47b6 2025-09-27 01:01:16,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:16,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e3a6a7b6615d4c47b6 HTTP/1.1" 200 None 2025-09-27 01:01:16,313 - lava_callback - DEBUG - Processing node 68d736e3a6a7b6615d4c47b6: baseline-arm64 INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:01:16,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:16,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:16,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e3a6a7b6615d4c47b6/log.txt.gz 2025-09-27 01:01:16,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:16,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:16,934 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e3a6a7b6615d4c47b6/lava_callback.json.gz 2025-09-27 01:01:16,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:16,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e3a6a7b6615d4c47b6 HTTP/1.1" 200 None 2025-09-27 01:01:16,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:16,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:16,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:17,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e3a6a7b6615d4c47b6 HTTP/1.1" 200 None 2025-09-27 01:01:17,011 - lava_callback - INFO - Completed processing callback for node 68d736e3a6a7b6615d4c47b6 2025-09-27 01:01:19,703 - lava_callback - INFO - Received callback for node 68d736e2a6a7b6615d4c47aa INFO: 172.21.0.1:55124 - "POST /node/68d736e2a6a7b6615d4c47aa HTTP/1.0" 202 Accepted 2025-09-27 01:01:19,713 - lava_callback - INFO - Starting async job submit for node 68d736e2a6a7b6615d4c47aa 2025-09-27 01:01:19,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:19,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e2a6a7b6615d4c47aa HTTP/1.1" 200 None 2025-09-27 01:01:19,751 - lava_callback - DEBUG - Processing node 68d736e2a6a7b6615d4c47aa: baseline-arm64 2025-09-27 01:01:20,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:20,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:20,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e2a6a7b6615d4c47aa/log.txt.gz 2025-09-27 01:01:20,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:20,166 - lava_callback - INFO - Received callback for node 68d736f6a6a7b6615d4c482e INFO: 172.21.0.1:55140 - "POST /node/68d736f6a6a7b6615d4c482e HTTP/1.0" 202 Accepted 2025-09-27 01:01:20,172 - lava_callback - INFO - Starting async job submit for node 68d736f6a6a7b6615d4c482e 2025-09-27 01:01:20,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:20,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f6a6a7b6615d4c482e HTTP/1.1" 200 None 2025-09-27 01:01:20,207 - lava_callback - DEBUG - Processing node 68d736f6a6a7b6615d4c482e: baseline-arm64-clabbe 2025-09-27 01:01:20,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:20,292 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e2a6a7b6615d4c47aa/lava_callback.json.gz 2025-09-27 01:01:20,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:20,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e2a6a7b6615d4c47aa HTTP/1.1" 200 None 2025-09-27 01:01:20,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:20,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:20,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:20,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:20,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e2a6a7b6615d4c47aa HTTP/1.1" 200 None 2025-09-27 01:01:20,511 - lava_callback - INFO - Completed processing callback for node 68d736e2a6a7b6615d4c47aa 2025-09-27 01:01:20,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:20,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d736f6a6a7b6615d4c482e/log.txt.gz 2025-09-27 01:01:20,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:20,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:20,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d736f6a6a7b6615d4c482e/lava_callback.json.gz 2025-09-27 01:01:20,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:20,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f6a6a7b6615d4c482e HTTP/1.1" 200 None 2025-09-27 01:01:20,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:20,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:20,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:20,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736f6a6a7b6615d4c482e HTTP/1.1" 200 None 2025-09-27 01:01:20,865 - lava_callback - INFO - Completed processing callback for node 68d736f6a6a7b6615d4c482e 2025-09-27 01:01:22,299 - lava_callback - INFO - Received callback for node 68d736e2a6a7b6615d4c47ad INFO: 172.21.0.1:55154 - "POST /node/68d736e2a6a7b6615d4c47ad HTTP/1.0" 202 Accepted 2025-09-27 01:01:22,305 - lava_callback - INFO - Starting async job submit for node 68d736e2a6a7b6615d4c47ad 2025-09-27 01:01:22,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:22,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e2a6a7b6615d4c47ad HTTP/1.1" 200 None 2025-09-27 01:01:22,342 - lava_callback - DEBUG - Processing node 68d736e2a6a7b6615d4c47ad: baseline-arm64 2025-09-27 01:01:22,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:22,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:22,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e2a6a7b6615d4c47ad/log.txt.gz 2025-09-27 01:01:22,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:22,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:22,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e2a6a7b6615d4c47ad/lava_callback.json.gz 2025-09-27 01:01:22,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:22,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e2a6a7b6615d4c47ad HTTP/1.1" 200 None 2025-09-27 01:01:22,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:23,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:23,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:23,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e2a6a7b6615d4c47ad HTTP/1.1" 200 None 2025-09-27 01:01:23,037 - lava_callback - INFO - Completed processing callback for node 68d736e2a6a7b6615d4c47ad 2025-09-27 01:01:23,537 - lava_callback - INFO - Received callback for node 68d5227db70fb2a1e20f1d5a INFO: 172.21.0.1:55158 - "POST /node/68d5227db70fb2a1e20f1d5a HTTP/1.0" 202 Accepted 2025-09-27 01:01:23,543 - lava_callback - INFO - Starting async job submit for node 68d5227db70fb2a1e20f1d5a 2025-09-27 01:01:23,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:23,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5227db70fb2a1e20f1d5a HTTP/1.1" 200 None 2025-09-27 01:01:23,582 - lava_callback - DEBUG - Processing node 68d5227db70fb2a1e20f1d5a: baseline-arm64 2025-09-27 01:01:23,950 - lava_callback - ERROR - Error processing callback for node 68d5227db70fb2a1e20f1d5a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 01:01:26,091 - lava_callback - INFO - Received callback for node 68d73368a6a7b6615d4c45ff INFO: 172.21.0.1:55168 - "POST /node/68d73368a6a7b6615d4c45ff HTTP/1.0" 202 Accepted 2025-09-27 01:01:26,101 - lava_callback - INFO - Starting async job submit for node 68d73368a6a7b6615d4c45ff 2025-09-27 01:01:26,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:26,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73368a6a7b6615d4c45ff HTTP/1.1" 200 None 2025-09-27 01:01:26,215 - lava_callback - DEBUG - Processing node 68d73368a6a7b6615d4c45ff: baseline-x86 2025-09-27 01:01:26,252 - lava_callback - INFO - Received callback for node 68d73702a6a7b6615d4c4868 INFO: 172.21.0.1:55178 - "POST /node/68d73702a6a7b6615d4c4868 HTTP/1.0" 202 Accepted 2025-09-27 01:01:26,275 - lava_callback - INFO - Starting async job submit for node 68d73702a6a7b6615d4c4868 2025-09-27 01:01:26,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:26,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73702a6a7b6615d4c4868 HTTP/1.1" 200 None 2025-09-27 01:01:26,463 - lava_callback - DEBUG - Processing node 68d73702a6a7b6615d4c4868: baseline-arm64 INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:01:27,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:27,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:27,475 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73702a6a7b6615d4c4868/log.txt.gz 2025-09-27 01:01:27,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:27,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:27,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:27,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73702a6a7b6615d4c4868/lava_callback.json.gz 2025-09-27 01:01:27,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:27,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:27,666 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d73368a6a7b6615d4c45ff/log.txt.gz 2025-09-27 01:01:27,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:27,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73702a6a7b6615d4c4868 HTTP/1.1" 200 None 2025-09-27 01:01:27,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:27,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:01:27,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:27,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73702a6a7b6615d4c4868 HTTP/1.1" 200 None 2025-09-27 01:01:27,747 - lava_callback - INFO - Completed processing callback for node 68d73702a6a7b6615d4c4868 2025-09-27 01:01:27,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:27,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d73368a6a7b6615d4c45ff/lava_callback.json.gz DEBUG: Setup failed for 68d73368a6a7b6615d4c45ff. Transitting job node result: incomplete -> fail 2025-09-27 01:01:28,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:28,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73368a6a7b6615d4c45ff HTTP/1.1" 200 None 2025-09-27 01:01:28,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:28,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 01:01:28,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:28,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73368a6a7b6615d4c45ff HTTP/1.1" 200 None 2025-09-27 01:01:28,193 - lava_callback - INFO - Completed processing callback for node 68d73368a6a7b6615d4c45ff 2025-09-27 01:01:31,225 - lava_callback - INFO - Received callback for node 68d736dfa6a7b6615d4c479f INFO: 172.21.0.1:38232 - "POST /node/68d736dfa6a7b6615d4c479f HTTP/1.0" 202 Accepted 2025-09-27 01:01:31,238 - lava_callback - INFO - Starting async job submit for node 68d736dfa6a7b6615d4c479f 2025-09-27 01:01:31,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:31,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dfa6a7b6615d4c479f HTTP/1.1" 200 None 2025-09-27 01:01:31,297 - lava_callback - DEBUG - Processing node 68d736dfa6a7b6615d4c479f: baseline-arm64 2025-09-27 01:01:31,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:32,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:32,236 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dfa6a7b6615d4c479f/log.txt.gz 2025-09-27 01:01:32,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:32,531 - lava_callback - INFO - Received callback for node 68d736dfa6a7b6615d4c4799 INFO: 172.21.0.1:38242 - "POST /node/68d736dfa6a7b6615d4c4799 HTTP/1.0" 202 Accepted 2025-09-27 01:01:32,544 - lava_callback - INFO - Starting async job submit for node 68d736dfa6a7b6615d4c4799 2025-09-27 01:01:32,585 - lava_callback - INFO - Received callback for node 68d736e4a6a7b6615d4c47bc 2025-09-27 01:01:32,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:38250 - "POST /node/68d736e4a6a7b6615d4c47bc HTTP/1.0" 202 Accepted 2025-09-27 01:01:32,609 - lava_callback - INFO - Starting async job submit for node 68d736e4a6a7b6615d4c47bc 2025-09-27 01:01:32,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:32,640 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dfa6a7b6615d4c479f/lava_callback.json.gz 2025-09-27 01:01:32,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dfa6a7b6615d4c4799 HTTP/1.1" 200 None 2025-09-27 01:01:32,691 - lava_callback - DEBUG - Processing node 68d736dfa6a7b6615d4c4799: baseline-arm64 2025-09-27 01:01:32,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:32,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:32,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e4a6a7b6615d4c47bc HTTP/1.1" 200 None 2025-09-27 01:01:32,803 - lava_callback - DEBUG - Processing node 68d736e4a6a7b6615d4c47bc: baseline-arm64 2025-09-27 01:01:32,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dfa6a7b6615d4c479f HTTP/1.1" 200 None 2025-09-27 01:01:32,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:32,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:32,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:33,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736dfa6a7b6615d4c479f HTTP/1.1" 200 None 2025-09-27 01:01:33,057 - lava_callback - INFO - Completed processing callback for node 68d736dfa6a7b6615d4c479f 2025-09-27 01:01:34,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:34,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:34,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:34,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e4a6a7b6615d4c47bc/log.txt.gz 2025-09-27 01:01:34,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:34,309 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dfa6a7b6615d4c4799/log.txt.gz 2025-09-27 01:01:34,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:34,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:34,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:34,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e4a6a7b6615d4c47bc/lava_callback.json.gz 2025-09-27 01:01:34,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:34,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:34,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dfa6a7b6615d4c4799/lava_callback.json.gz 2025-09-27 01:01:34,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:34,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e4a6a7b6615d4c47bc HTTP/1.1" 200 None 2025-09-27 01:01:34,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:34,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dfa6a7b6615d4c4799 HTTP/1.1" 200 None 2025-09-27 01:01:34,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:34,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:34,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:34,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:34,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:34,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e4a6a7b6615d4c47bc HTTP/1.1" 200 None 2025-09-27 01:01:34,637 - lava_callback - INFO - Completed processing callback for node 68d736e4a6a7b6615d4c47bc 2025-09-27 01:01:34,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736dfa6a7b6615d4c4799 HTTP/1.1" 200 None 2025-09-27 01:01:34,646 - lava_callback - INFO - Completed processing callback for node 68d736dfa6a7b6615d4c4799 2025-09-27 01:01:36,213 - lava_callback - INFO - Received callback for node 68d736dda6a7b6615d4c4790 INFO: 172.21.0.1:38258 - "POST /node/68d736dda6a7b6615d4c4790 HTTP/1.0" 202 Accepted 2025-09-27 01:01:36,220 - lava_callback - INFO - Received callback for node 68d736e4a6a7b6615d4c47b9 2025-09-27 01:01:36,225 - lava_callback - INFO - Starting async job submit for node 68d736dda6a7b6615d4c4790 INFO: 172.21.0.1:38274 - "POST /node/68d736e4a6a7b6615d4c47b9 HTTP/1.0" 202 Accepted 2025-09-27 01:01:36,231 - lava_callback - INFO - Starting async job submit for node 68d736e4a6a7b6615d4c47b9 2025-09-27 01:01:36,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:36,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:36,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e4a6a7b6615d4c47b9 HTTP/1.1" 200 None 2025-09-27 01:01:36,294 - lava_callback - DEBUG - Processing node 68d736e4a6a7b6615d4c47b9: baseline-arm64 2025-09-27 01:01:36,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dda6a7b6615d4c4790 HTTP/1.1" 200 None 2025-09-27 01:01:36,320 - lava_callback - DEBUG - Processing node 68d736dda6a7b6615d4c4790: baseline-arm64 INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:01:37,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:37,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:37,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:37,210 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e4a6a7b6615d4c47b9/log.txt.gz 2025-09-27 01:01:37,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:37,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:37,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dda6a7b6615d4c4790/log.txt.gz 2025-09-27 01:01:37,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:37,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:37,350 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e4a6a7b6615d4c47b9/lava_callback.json.gz 2025-09-27 01:01:37,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:37,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e4a6a7b6615d4c47b9 HTTP/1.1" 200 None 2025-09-27 01:01:37,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:37,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:37,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:37,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:37,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dda6a7b6615d4c4790/lava_callback.json.gz INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:01:37,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:37,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e4a6a7b6615d4c47b9 HTTP/1.1" 200 None 2025-09-27 01:01:37,484 - lava_callback - INFO - Completed processing callback for node 68d736e4a6a7b6615d4c47b9 2025-09-27 01:01:37,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dda6a7b6615d4c4790 HTTP/1.1" 200 None 2025-09-27 01:01:37,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:37,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:37,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:37,578 - lava_callback - INFO - Received callback for node 68d73700a6a7b6615d4c4858 INFO: 172.21.0.1:38306 - "POST /node/68d73700a6a7b6615d4c4858 HTTP/1.0" 202 Accepted 2025-09-27 01:01:37,588 - lava_callback - INFO - Starting async job submit for node 68d73700a6a7b6615d4c4858 2025-09-27 01:01:37,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736dda6a7b6615d4c4790 HTTP/1.1" 200 None 2025-09-27 01:01:37,621 - lava_callback - INFO - Completed processing callback for node 68d736dda6a7b6615d4c4790 2025-09-27 01:01:37,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:37,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73700a6a7b6615d4c4858 HTTP/1.1" 200 None 2025-09-27 01:01:37,666 - lava_callback - DEBUG - Processing node 68d73700a6a7b6615d4c4858: baseline-arm64 2025-09-27 01:01:38,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:38,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:38,310 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73700a6a7b6615d4c4858/log.txt.gz 2025-09-27 01:01:38,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:38,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:38,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73700a6a7b6615d4c4858/lava_callback.json.gz 2025-09-27 01:01:38,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:38,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73700a6a7b6615d4c4858 HTTP/1.1" 200 None 2025-09-27 01:01:38,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:38,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:01:38,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:38,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73700a6a7b6615d4c4858 HTTP/1.1" 200 None 2025-09-27 01:01:38,606 - lava_callback - INFO - Completed processing callback for node 68d73700a6a7b6615d4c4858 2025-09-27 01:01:41,079 - lava_callback - INFO - Received callback for node 68d73703a6a7b6615d4c486b INFO: 172.21.0.1:57490 - "POST /node/68d73703a6a7b6615d4c486b HTTP/1.0" 202 Accepted 2025-09-27 01:01:41,086 - lava_callback - INFO - Starting async job submit for node 68d73703a6a7b6615d4c486b 2025-09-27 01:01:41,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:41,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73703a6a7b6615d4c486b HTTP/1.1" 200 None 2025-09-27 01:01:41,123 - lava_callback - DEBUG - Processing node 68d73703a6a7b6615d4c486b: baseline-arm64 2025-09-27 01:01:41,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:41,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:41,938 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73703a6a7b6615d4c486b/log.txt.gz 2025-09-27 01:01:41,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:42,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:42,094 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73703a6a7b6615d4c486b/lava_callback.json.gz 2025-09-27 01:01:42,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:42,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73703a6a7b6615d4c486b HTTP/1.1" 200 None 2025-09-27 01:01:42,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:42,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:01:42,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:42,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73703a6a7b6615d4c486b HTTP/1.1" 200 None 2025-09-27 01:01:42,171 - lava_callback - INFO - Completed processing callback for node 68d73703a6a7b6615d4c486b 2025-09-27 01:01:43,489 - lava_callback - INFO - Received callback for node 68d736fea6a7b6615d4c484c INFO: 172.21.0.1:57496 - "POST /node/68d736fea6a7b6615d4c484c HTTP/1.0" 202 Accepted 2025-09-27 01:01:43,498 - lava_callback - INFO - Starting async job submit for node 68d736fea6a7b6615d4c484c 2025-09-27 01:01:43,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:43,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736fea6a7b6615d4c484c HTTP/1.1" 200 None 2025-09-27 01:01:43,535 - lava_callback - DEBUG - Processing node 68d736fea6a7b6615d4c484c: baseline-arm64 2025-09-27 01:01:43,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:44,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:44,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736fea6a7b6615d4c484c/log.txt.gz 2025-09-27 01:01:44,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:44,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:44,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736fea6a7b6615d4c484c/lava_callback.json.gz 2025-09-27 01:01:44,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:44,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736fea6a7b6615d4c484c HTTP/1.1" 200 None 2025-09-27 01:01:44,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:44,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:01:44,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:44,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736fea6a7b6615d4c484c HTTP/1.1" 200 None 2025-09-27 01:01:44,277 - lava_callback - INFO - Completed processing callback for node 68d736fea6a7b6615d4c484c 2025-09-27 01:01:44,636 - lava_callback - INFO - Received callback for node 68d736e0a6a7b6615d4c47a5 INFO: 172.21.0.1:57508 - "POST /node/68d736e0a6a7b6615d4c47a5 HTTP/1.0" 202 Accepted 2025-09-27 01:01:44,643 - lava_callback - INFO - Starting async job submit for node 68d736e0a6a7b6615d4c47a5 2025-09-27 01:01:44,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:44,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e0a6a7b6615d4c47a5 HTTP/1.1" 200 None 2025-09-27 01:01:44,680 - lava_callback - DEBUG - Processing node 68d736e0a6a7b6615d4c47a5: baseline-arm64 2025-09-27 01:01:45,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:45,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:45,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e0a6a7b6615d4c47a5/log.txt.gz 2025-09-27 01:01:45,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:45,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:45,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e0a6a7b6615d4c47a5/lava_callback.json.gz 2025-09-27 01:01:45,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:45,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e0a6a7b6615d4c47a5 HTTP/1.1" 200 None 2025-09-27 01:01:45,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:45,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:45,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:45,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e0a6a7b6615d4c47a5 HTTP/1.1" 200 None 2025-09-27 01:01:45,390 - lava_callback - INFO - Completed processing callback for node 68d736e0a6a7b6615d4c47a5 INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:01:49,900 - lava_callback - INFO - Received callback for node 68d736fea6a7b6615d4c484f INFO: 172.21.0.1:53990 - "POST /node/68d736fea6a7b6615d4c484f HTTP/1.0" 202 Accepted 2025-09-27 01:01:49,906 - lava_callback - INFO - Starting async job submit for node 68d736fea6a7b6615d4c484f 2025-09-27 01:01:49,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:49,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736fea6a7b6615d4c484f HTTP/1.1" 200 None 2025-09-27 01:01:49,947 - lava_callback - DEBUG - Processing node 68d736fea6a7b6615d4c484f: baseline-arm64 2025-09-27 01:01:50,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:50,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:50,473 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736fea6a7b6615d4c484f/log.txt.gz 2025-09-27 01:01:50,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:50,573 - lava_callback - INFO - Received callback for node 68d73701a6a7b6615d4c485e INFO: 172.21.0.1:54004 - "POST /node/68d73701a6a7b6615d4c485e HTTP/1.0" 202 Accepted 2025-09-27 01:01:50,583 - lava_callback - INFO - Starting async job submit for node 68d73701a6a7b6615d4c485e 2025-09-27 01:01:50,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:50,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73701a6a7b6615d4c485e HTTP/1.1" 200 None 2025-09-27 01:01:50,635 - lava_callback - DEBUG - Processing node 68d73701a6a7b6615d4c485e: baseline-arm64 2025-09-27 01:01:50,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:50,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736fea6a7b6615d4c484f/lava_callback.json.gz 2025-09-27 01:01:50,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:50,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736fea6a7b6615d4c484f HTTP/1.1" 200 None 2025-09-27 01:01:50,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:50,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:01:50,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:51,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:51,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736fea6a7b6615d4c484f HTTP/1.1" 200 None 2025-09-27 01:01:51,068 - lava_callback - INFO - Completed processing callback for node 68d736fea6a7b6615d4c484f 2025-09-27 01:01:51,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:51,251 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73701a6a7b6615d4c485e/log.txt.gz 2025-09-27 01:01:51,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:51,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:51,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73701a6a7b6615d4c485e/lava_callback.json.gz 2025-09-27 01:01:51,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:51,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73701a6a7b6615d4c485e HTTP/1.1" 200 None 2025-09-27 01:01:51,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:51,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:01:51,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:51,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73701a6a7b6615d4c485e HTTP/1.1" 200 None 2025-09-27 01:01:51,555 - lava_callback - INFO - Completed processing callback for node 68d73701a6a7b6615d4c485e 2025-09-27 01:01:51,842 - lava_callback - INFO - Received callback for node 68d73705a6a7b6615d4c487a INFO: 172.21.0.1:54012 - "POST /node/68d73705a6a7b6615d4c487a HTTP/1.0" 202 Accepted 2025-09-27 01:01:51,848 - lava_callback - INFO - Starting async job submit for node 68d73705a6a7b6615d4c487a 2025-09-27 01:01:51,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:51,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73705a6a7b6615d4c487a HTTP/1.1" 200 None 2025-09-27 01:01:51,884 - lava_callback - DEBUG - Processing node 68d73705a6a7b6615d4c487a: baseline-arm64 2025-09-27 01:01:52,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:52,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:52,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73705a6a7b6615d4c487a/log.txt.gz 2025-09-27 01:01:52,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:52,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:52,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73705a6a7b6615d4c487a/lava_callback.json.gz 2025-09-27 01:01:52,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:52,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73705a6a7b6615d4c487a HTTP/1.1" 200 None 2025-09-27 01:01:52,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:52,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:01:52,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:52,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73705a6a7b6615d4c487a HTTP/1.1" 200 None 2025-09-27 01:01:52,660 - lava_callback - INFO - Completed processing callback for node 68d73705a6a7b6615d4c487a 2025-09-27 01:01:56,238 - lava_callback - INFO - Received callback for node 68d736f3a6a7b6615d4c4819 INFO: 172.21.0.1:54024 - "POST /node/68d736f3a6a7b6615d4c4819 HTTP/1.0" 202 Accepted 2025-09-27 01:01:56,246 - lava_callback - INFO - Starting async job submit for node 68d736f3a6a7b6615d4c4819 2025-09-27 01:01:56,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:56,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f3a6a7b6615d4c4819 HTTP/1.1" 200 None 2025-09-27 01:01:56,294 - lava_callback - DEBUG - Processing node 68d736f3a6a7b6615d4c4819: baseline-arm64-clabbe INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:01:56,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:56,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:56,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d736f3a6a7b6615d4c4819/log.txt.gz 2025-09-27 01:01:56,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:01:57,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:01:57,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d736f3a6a7b6615d4c4819/lava_callback.json.gz 2025-09-27 01:01:57,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:57,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f3a6a7b6615d4c4819 HTTP/1.1" 200 None 2025-09-27 01:01:57,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:57,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:01:57,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:57,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736f3a6a7b6615d4c4819 HTTP/1.1" 200 None 2025-09-27 01:01:57,138 - lava_callback - INFO - Completed processing callback for node 68d736f3a6a7b6615d4c4819 2025-09-27 01:01:59,874 - lava_callback - INFO - Received callback for node 68d73712a6a7b6615d4c48b9 INFO: 172.21.0.1:53238 - "POST /node/68d73712a6a7b6615d4c48b9 HTTP/1.0" 202 Accepted 2025-09-27 01:01:59,883 - lava_callback - INFO - Starting async job submit for node 68d73712a6a7b6615d4c48b9 2025-09-27 01:01:59,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:01:59,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73712a6a7b6615d4c48b9 HTTP/1.1" 200 None 2025-09-27 01:01:59,934 - lava_callback - DEBUG - Processing node 68d73712a6a7b6615d4c48b9: baseline-arm64-foundriesio 2025-09-27 01:02:00,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:00,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:00,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d73712a6a7b6615d4c48b9/log.txt.gz 2025-09-27 01:02:00,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:00,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:00,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d73712a6a7b6615d4c48b9/lava_callback.json.gz 2025-09-27 01:02:00,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:00,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73712a6a7b6615d4c48b9 HTTP/1.1" 200 None 2025-09-27 01:02:00,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:00,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:00,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:00,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73712a6a7b6615d4c48b9 HTTP/1.1" 200 None 2025-09-27 01:02:00,749 - lava_callback - INFO - Completed processing callback for node 68d73712a6a7b6615d4c48b9 INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:02:03,204 - lava_callback - INFO - Received callback for node 68d73700a6a7b6615d4c485b INFO: 172.21.0.1:53258 - "POST /node/68d73700a6a7b6615d4c485b HTTP/1.0" 202 Accepted 2025-09-27 01:02:03,210 - lava_callback - INFO - Starting async job submit for node 68d73700a6a7b6615d4c485b 2025-09-27 01:02:03,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:03,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73700a6a7b6615d4c485b HTTP/1.1" 200 None 2025-09-27 01:02:03,244 - lava_callback - DEBUG - Processing node 68d73700a6a7b6615d4c485b: baseline-arm64 2025-09-27 01:02:03,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:03,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:03,686 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73700a6a7b6615d4c485b/log.txt.gz 2025-09-27 01:02:03,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:03,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:03,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73700a6a7b6615d4c485b/lava_callback.json.gz 2025-09-27 01:02:03,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:03,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73700a6a7b6615d4c485b HTTP/1.1" 200 None 2025-09-27 01:02:03,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:03,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:03,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:03,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73700a6a7b6615d4c485b HTTP/1.1" 200 None 2025-09-27 01:02:03,938 - lava_callback - INFO - Completed processing callback for node 68d73700a6a7b6615d4c485b 2025-09-27 01:02:04,347 - lava_callback - INFO - Received callback for node 68d736fda6a7b6615d4c4849 INFO: 172.21.0.1:53274 - "POST /node/68d736fda6a7b6615d4c4849 HTTP/1.0" 202 Accepted 2025-09-27 01:02:04,354 - lava_callback - INFO - Starting async job submit for node 68d736fda6a7b6615d4c4849 2025-09-27 01:02:04,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:04,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736fda6a7b6615d4c4849 HTTP/1.1" 200 None 2025-09-27 01:02:04,398 - lava_callback - DEBUG - Processing node 68d736fda6a7b6615d4c4849: baseline-arm64 2025-09-27 01:02:04,594 - lava_callback - INFO - Received callback for node 68d73711a6a7b6615d4c48b6 INFO: 172.21.0.1:53276 - "POST /node/68d73711a6a7b6615d4c48b6 HTTP/1.0" 202 Accepted 2025-09-27 01:02:04,616 - lava_callback - INFO - Starting async job submit for node 68d73711a6a7b6615d4c48b6 2025-09-27 01:02:04,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:04,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:04,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73711a6a7b6615d4c48b6 HTTP/1.1" 200 None 2025-09-27 01:02:04,697 - lava_callback - DEBUG - Processing node 68d73711a6a7b6615d4c48b6: baseline-arm64-foundriesio 2025-09-27 01:02:04,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:04,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736fda6a7b6615d4c4849/log.txt.gz 2025-09-27 01:02:04,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:04,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:05,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:05,135 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736fda6a7b6615d4c4849/lava_callback.json.gz 2025-09-27 01:02:05,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:05,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:05,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d73711a6a7b6615d4c48b6/log.txt.gz 2025-09-27 01:02:05,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:05,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736fda6a7b6615d4c4849 HTTP/1.1" 200 None 2025-09-27 01:02:05,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:05,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:05,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:05,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736fda6a7b6615d4c4849 HTTP/1.1" 200 None 2025-09-27 01:02:05,229 - lava_callback - INFO - Completed processing callback for node 68d736fda6a7b6615d4c4849 2025-09-27 01:02:05,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:05,350 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d73711a6a7b6615d4c48b6/lava_callback.json.gz 2025-09-27 01:02:05,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:05,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73711a6a7b6615d4c48b6 HTTP/1.1" 200 None 2025-09-27 01:02:05,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:05,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:05,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:05,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73711a6a7b6615d4c48b6 HTTP/1.1" 200 None 2025-09-27 01:02:05,439 - lava_callback - INFO - Completed processing callback for node 68d73711a6a7b6615d4c48b6 INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:02:06,817 - lava_callback - INFO - Received callback for node 68d73702a6a7b6615d4c4864 INFO: 172.21.0.1:53286 - "POST /node/68d73702a6a7b6615d4c4864 HTTP/1.0" 202 Accepted 2025-09-27 01:02:06,823 - lava_callback - INFO - Starting async job submit for node 68d73702a6a7b6615d4c4864 2025-09-27 01:02:06,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:06,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73702a6a7b6615d4c4864 HTTP/1.1" 200 None 2025-09-27 01:02:06,877 - lava_callback - DEBUG - Processing node 68d73702a6a7b6615d4c4864: baseline-arm64 2025-09-27 01:02:07,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:07,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:07,320 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73702a6a7b6615d4c4864/log.txt.gz 2025-09-27 01:02:07,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:07,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:07,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73702a6a7b6615d4c4864/lava_callback.json.gz 2025-09-27 01:02:07,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:07,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73702a6a7b6615d4c4864 HTTP/1.1" 200 None 2025-09-27 01:02:07,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:07,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:07,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:07,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73702a6a7b6615d4c4864 HTTP/1.1" 200 None 2025-09-27 01:02:07,568 - lava_callback - INFO - Completed processing callback for node 68d73702a6a7b6615d4c4864 INFO: 172.21.0.1:43978 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 01:02:15,581 - lava_callback - INFO - Received callback for node 68d73710a6a7b6615d4c48b0 INFO: 172.21.0.1:43984 - "POST /node/68d73710a6a7b6615d4c48b0 HTTP/1.0" 202 Accepted 2025-09-27 01:02:15,587 - lava_callback - INFO - Starting async job submit for node 68d73710a6a7b6615d4c48b0 2025-09-27 01:02:15,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:15,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73710a6a7b6615d4c48b0 HTTP/1.1" 200 None 2025-09-27 01:02:15,626 - lava_callback - DEBUG - Processing node 68d73710a6a7b6615d4c48b0: baseline-arm64-pengutronix 2025-09-27 01:02:15,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:15,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:15,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d73710a6a7b6615d4c48b0/log.txt.gz 2025-09-27 01:02:15,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:16,078 - lava_callback - INFO - Received callback for node 68d7370fa6a7b6615d4c48aa INFO: 172.21.0.1:44000 - "POST /node/68d7370fa6a7b6615d4c48aa HTTP/1.0" 202 Accepted 2025-09-27 01:02:16,089 - lava_callback - INFO - Starting async job submit for node 68d7370fa6a7b6615d4c48aa 2025-09-27 01:02:16,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:16,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:16,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d73710a6a7b6615d4c48b0/lava_callback.json.gz 2025-09-27 01:02:16,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370fa6a7b6615d4c48aa HTTP/1.1" 200 None 2025-09-27 01:02:16,158 - lava_callback - DEBUG - Processing node 68d7370fa6a7b6615d4c48aa: baseline-arm64-kontron 2025-09-27 01:02:16,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:16,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73710a6a7b6615d4c48b0 HTTP/1.1" 200 None 2025-09-27 01:02:16,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:16,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:16,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:16,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73710a6a7b6615d4c48b0 HTTP/1.1" 200 None 2025-09-27 01:02:16,460 - lava_callback - INFO - Completed processing callback for node 68d73710a6a7b6615d4c48b0 INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:02:16,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:16,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:16,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d7370fa6a7b6615d4c48aa/log.txt.gz 2025-09-27 01:02:16,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:16,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:16,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d7370fa6a7b6615d4c48aa/lava_callback.json.gz 2025-09-27 01:02:16,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:16,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370fa6a7b6615d4c48aa HTTP/1.1" 200 None 2025-09-27 01:02:16,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:16,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:16,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:16,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370fa6a7b6615d4c48aa HTTP/1.1" 200 None 2025-09-27 01:02:16,925 - lava_callback - INFO - Completed processing callback for node 68d7370fa6a7b6615d4c48aa 2025-09-27 01:02:22,112 - lava_callback - INFO - Received callback for node 68d73711a6a7b6615d4c48b3 INFO: 172.21.0.1:53828 - "POST /node/68d73711a6a7b6615d4c48b3 HTTP/1.0" 202 Accepted 2025-09-27 01:02:22,118 - lava_callback - INFO - Starting async job submit for node 68d73711a6a7b6615d4c48b3 2025-09-27 01:02:22,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:22,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73711a6a7b6615d4c48b3 HTTP/1.1" 200 None 2025-09-27 01:02:22,164 - lava_callback - DEBUG - Processing node 68d73711a6a7b6615d4c48b3: baseline-arm64-pengutronix 2025-09-27 01:02:22,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:22,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:22,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d73711a6a7b6615d4c48b3/log.txt.gz 2025-09-27 01:02:22,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:22,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:22,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d73711a6a7b6615d4c48b3/lava_callback.json.gz 2025-09-27 01:02:22,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:22,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73711a6a7b6615d4c48b3 HTTP/1.1" 200 None 2025-09-27 01:02:22,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:22,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:22,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:22,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73711a6a7b6615d4c48b3 HTTP/1.1" 200 None 2025-09-27 01:02:22,796 - lava_callback - INFO - Completed processing callback for node 68d73711a6a7b6615d4c48b3 INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:02:36,146 - lava_callback - INFO - Received callback for node 68d5227eb70fb2a1e20f1d5d INFO: 172.21.0.1:57562 - "POST /node/68d5227eb70fb2a1e20f1d5d HTTP/1.0" 202 Accepted 2025-09-27 01:02:36,153 - lava_callback - INFO - Starting async job submit for node 68d5227eb70fb2a1e20f1d5d 2025-09-27 01:02:36,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:36,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5227eb70fb2a1e20f1d5d HTTP/1.1" 200 None 2025-09-27 01:02:36,224 - lava_callback - DEBUG - Processing node 68d5227eb70fb2a1e20f1d5d: baseline-arm64 INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:02:36,666 - lava_callback - ERROR - Error processing callback for node 68d5227eb70fb2a1e20f1d5d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 01:02:37,244 - lava_callback - INFO - Received callback for node 68d736e8a6a7b6615d4c47d4 INFO: 172.21.0.1:57584 - "POST /node/68d736e8a6a7b6615d4c47d4 HTTP/1.0" 202 Accepted 2025-09-27 01:02:37,250 - lava_callback - INFO - Starting async job submit for node 68d736e8a6a7b6615d4c47d4 2025-09-27 01:02:37,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:37,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e8a6a7b6615d4c47d4 HTTP/1.1" 200 None 2025-09-27 01:02:37,313 - lava_callback - DEBUG - Processing node 68d736e8a6a7b6615d4c47d4: baseline-arm64-baylibre INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:02:37,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:37,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:37,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e8a6a7b6615d4c47d4/log.txt.gz 2025-09-27 01:02:37,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:37,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:37,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e8a6a7b6615d4c47d4/lava_callback.json.gz 2025-09-27 01:02:37,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:37,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e8a6a7b6615d4c47d4 HTTP/1.1" 200 None 2025-09-27 01:02:37,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:37,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:02:37,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:37,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e8a6a7b6615d4c47d4 HTTP/1.1" 200 None 2025-09-27 01:02:37,930 - lava_callback - INFO - Completed processing callback for node 68d736e8a6a7b6615d4c47d4 INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:02:56,098 - lava_callback - INFO - Received callback for node 68d7370ea6a7b6615d4c48a7 INFO: 172.21.0.1:55654 - "POST /node/68d7370ea6a7b6615d4c48a7 HTTP/1.0" 202 Accepted 2025-09-27 01:02:56,105 - lava_callback - INFO - Starting async job submit for node 68d7370ea6a7b6615d4c48a7 2025-09-27 01:02:56,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:56,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ea6a7b6615d4c48a7 HTTP/1.1" 200 None 2025-09-27 01:02:56,175 - lava_callback - DEBUG - Processing node 68d7370ea6a7b6615d4c48a7: baseline-arm64-kontron 2025-09-27 01:02:56,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:02:56,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:56,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d7370ea6a7b6615d4c48a7/log.txt.gz 2025-09-27 01:02:56,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:02:56,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:02:56,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d7370ea6a7b6615d4c48a7/lava_callback.json.gz 2025-09-27 01:02:56,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:56,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ea6a7b6615d4c48a7 HTTP/1.1" 200 None 2025-09-27 01:02:56,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:56,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:02:56,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:02:56,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370ea6a7b6615d4c48a7 HTTP/1.1" 200 None 2025-09-27 01:02:56,890 - lava_callback - INFO - Completed processing callback for node 68d7370ea6a7b6615d4c48a7 INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:03:05,995 - lava_callback - INFO - Received callback for node 68d73705a6a7b6615d4c4877 INFO: 172.21.0.1:37396 - "POST /node/68d73705a6a7b6615d4c4877 HTTP/1.0" 202 Accepted 2025-09-27 01:03:06,003 - lava_callback - INFO - Starting async job submit for node 68d73705a6a7b6615d4c4877 2025-09-27 01:03:06,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:06,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73705a6a7b6615d4c4877 HTTP/1.1" 200 None 2025-09-27 01:03:06,057 - lava_callback - DEBUG - Processing node 68d73705a6a7b6615d4c4877: baseline-arm64 2025-09-27 01:03:06,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:03:06,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:06,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73705a6a7b6615d4c4877/log.txt.gz 2025-09-27 01:03:06,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:03:06,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:06,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73705a6a7b6615d4c4877/lava_callback.json.gz 2025-09-27 01:03:06,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:06,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73705a6a7b6615d4c4877 HTTP/1.1" 200 None 2025-09-27 01:03:06,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:06,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:03:06,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:06,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73705a6a7b6615d4c4877 HTTP/1.1" 200 None 2025-09-27 01:03:06,876 - lava_callback - INFO - Completed processing callback for node 68d73705a6a7b6615d4c4877 2025-09-27 01:03:12,976 - lava_callback - INFO - Received callback for node 68d73704a6a7b6615d4c4874 INFO: 172.21.0.1:39946 - "POST /node/68d73704a6a7b6615d4c4874 HTTP/1.0" 202 Accepted 2025-09-27 01:03:12,986 - lava_callback - INFO - Starting async job submit for node 68d73704a6a7b6615d4c4874 2025-09-27 01:03:13,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:13,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73704a6a7b6615d4c4874 HTTP/1.1" 200 None 2025-09-27 01:03:13,031 - lava_callback - DEBUG - Processing node 68d73704a6a7b6615d4c4874: baseline-arm64 2025-09-27 01:03:13,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:03:13,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:13,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73704a6a7b6615d4c4874/log.txt.gz 2025-09-27 01:03:13,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:03:13,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:13,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73704a6a7b6615d4c4874/lava_callback.json.gz 2025-09-27 01:03:13,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:13,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73704a6a7b6615d4c4874 HTTP/1.1" 200 None 2025-09-27 01:03:13,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:13,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:03:13,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:13,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73704a6a7b6615d4c4874 HTTP/1.1" 200 None 2025-09-27 01:03:13,856 - lava_callback - INFO - Completed processing callback for node 68d73704a6a7b6615d4c4874 INFO: 172.21.0.1:39952 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 01:03:16,037 - lava_callback - INFO - Received callback for node 68d736e6a6a7b6615d4c47c8 INFO: 172.21.0.1:39956 - "POST /node/68d736e6a6a7b6615d4c47c8 HTTP/1.0" 202 Accepted 2025-09-27 01:03:16,043 - lava_callback - INFO - Starting async job submit for node 68d736e6a6a7b6615d4c47c8 2025-09-27 01:03:16,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:16,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e6a6a7b6615d4c47c8 HTTP/1.1" 200 None 2025-09-27 01:03:16,094 - lava_callback - DEBUG - Processing node 68d736e6a6a7b6615d4c47c8: baseline-arm64-baylibre 2025-09-27 01:03:16,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:03:16,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:16,644 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e6a6a7b6615d4c47c8/log.txt.gz 2025-09-27 01:03:16,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:03:16,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:16,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e6a6a7b6615d4c47c8/lava_callback.json.gz 2025-09-27 01:03:16,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:16,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e6a6a7b6615d4c47c8 HTTP/1.1" 200 None 2025-09-27 01:03:16,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:16,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:03:16,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:16,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e6a6a7b6615d4c47c8 HTTP/1.1" 200 None 2025-09-27 01:03:16,846 - lava_callback - INFO - Completed processing callback for node 68d736e6a6a7b6615d4c47c8 INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:03:31,720 - lava_callback - INFO - Received callback for node 68d736dea6a7b6615d4c4796 INFO: 172.21.0.1:53102 - "POST /node/68d736dea6a7b6615d4c4796 HTTP/1.0" 202 Accepted 2025-09-27 01:03:31,731 - lava_callback - INFO - Starting async job submit for node 68d736dea6a7b6615d4c4796 2025-09-27 01:03:31,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:31,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dea6a7b6615d4c4796 HTTP/1.1" 200 None 2025-09-27 01:03:31,784 - lava_callback - DEBUG - Processing node 68d736dea6a7b6615d4c4796: baseline-arm64 2025-09-27 01:03:32,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:03:32,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:32,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dea6a7b6615d4c4796/log.txt.gz 2025-09-27 01:03:32,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:03:32,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:32,532 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dea6a7b6615d4c4796/lava_callback.json.gz 2025-09-27 01:03:32,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:32,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dea6a7b6615d4c4796 HTTP/1.1" 200 None 2025-09-27 01:03:32,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:32,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:03:32,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:32,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736dea6a7b6615d4c4796 HTTP/1.1" 200 None 2025-09-27 01:03:32,645 - lava_callback - INFO - Completed processing callback for node 68d736dea6a7b6615d4c4796 INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59724 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:03:50,872 - lava_callback - INFO - Received callback for node 68d736e6a6a7b6615d4c47c5 INFO: 172.21.0.1:42712 - "POST /node/68d736e6a6a7b6615d4c47c5 HTTP/1.0" 202 Accepted 2025-09-27 01:03:50,878 - lava_callback - INFO - Starting async job submit for node 68d736e6a6a7b6615d4c47c5 2025-09-27 01:03:50,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:50,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e6a6a7b6615d4c47c5 HTTP/1.1" 200 None 2025-09-27 01:03:50,913 - lava_callback - DEBUG - Processing node 68d736e6a6a7b6615d4c47c5: baseline-arm64-baylibre 2025-09-27 01:03:51,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:03:51,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:51,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e6a6a7b6615d4c47c5/log.txt.gz 2025-09-27 01:03:51,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:03:51,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:03:51,430 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e6a6a7b6615d4c47c5/lava_callback.json.gz 2025-09-27 01:03:51,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:51,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e6a6a7b6615d4c47c5 HTTP/1.1" 200 None 2025-09-27 01:03:51,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:51,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:03:51,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:03:51,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e6a6a7b6615d4c47c5 HTTP/1.1" 200 None 2025-09-27 01:03:51,513 - lava_callback - INFO - Completed processing callback for node 68d736e6a6a7b6615d4c47c5 INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:04:02,741 - lava_callback - INFO - Received callback for node 68d52302b70fb2a1e20f1e62 INFO: 172.21.0.1:44256 - "POST /node/68d52302b70fb2a1e20f1e62 HTTP/1.0" 202 Accepted 2025-09-27 01:04:02,749 - lava_callback - INFO - Starting async job submit for node 68d52302b70fb2a1e20f1e62 2025-09-27 01:04:02,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:02,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52302b70fb2a1e20f1e62 HTTP/1.1" 200 None 2025-09-27 01:04:02,783 - lava_callback - DEBUG - Processing node 68d52302b70fb2a1e20f1e62: baseline-arm64 2025-09-27 01:04:03,130 - lava_callback - ERROR - Error processing callback for node 68d52302b70fb2a1e20f1e62: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:04:07,426 - lava_callback - INFO - Received callback for node 68d736e7a6a7b6615d4c47d1 INFO: 172.21.0.1:44276 - "POST /node/68d736e7a6a7b6615d4c47d1 HTTP/1.0" 202 Accepted 2025-09-27 01:04:07,432 - lava_callback - INFO - Starting async job submit for node 68d736e7a6a7b6615d4c47d1 2025-09-27 01:04:07,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:07,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e7a6a7b6615d4c47d1 HTTP/1.1" 200 None 2025-09-27 01:04:07,488 - lava_callback - DEBUG - Processing node 68d736e7a6a7b6615d4c47d1: baseline-arm64-baylibre 2025-09-27 01:04:07,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:07,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:07,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e7a6a7b6615d4c47d1/log.txt.gz 2025-09-27 01:04:07,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:08,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:08,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e7a6a7b6615d4c47d1/lava_callback.json.gz 2025-09-27 01:04:08,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:08,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e7a6a7b6615d4c47d1 HTTP/1.1" 200 None 2025-09-27 01:04:08,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:08,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:04:08,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:08,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e7a6a7b6615d4c47d1 HTTP/1.1" 200 None 2025-09-27 01:04:08,111 - lava_callback - INFO - Completed processing callback for node 68d736e7a6a7b6615d4c47d1 2025-09-27 01:04:12,982 - lava_callback - INFO - Received callback for node 68d733b0a6a7b6615d4c4629 INFO: 172.21.0.1:54746 - "POST /node/68d733b0a6a7b6615d4c4629 HTTP/1.0" 202 Accepted 2025-09-27 01:04:12,989 - lava_callback - INFO - Starting async job submit for node 68d733b0a6a7b6615d4c4629 2025-09-27 01:04:13,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:13,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b0a6a7b6615d4c4629 HTTP/1.1" 200 None 2025-09-27 01:04:13,056 - lava_callback - DEBUG - Processing node 68d733b0a6a7b6615d4c4629: baseline-arm 2025-09-27 01:04:13,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:13,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:13,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b0a6a7b6615d4c4629/log.txt.gz 2025-09-27 01:04:13,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:13,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:13,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b0a6a7b6615d4c4629/lava_callback.json.gz DEBUG: Setup failed for 68d733b0a6a7b6615d4c4629. Transitting job node result: incomplete -> fail 2025-09-27 01:04:13,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:13,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b0a6a7b6615d4c4629 HTTP/1.1" 200 None 2025-09-27 01:04:13,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:13,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 01:04:13,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:13,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733b0a6a7b6615d4c4629 HTTP/1.1" 200 None 2025-09-27 01:04:13,765 - lava_callback - INFO - Completed processing callback for node 68d733b0a6a7b6615d4c4629 INFO: 172.21.0.1:54760 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 01:04:16,446 - lava_callback - INFO - Received callback for node 68d733b8a6a7b6615d4c4646 INFO: 172.21.0.1:54774 - "POST /node/68d733b8a6a7b6615d4c4646 HTTP/1.0" 202 Accepted 2025-09-27 01:04:16,452 - lava_callback - INFO - Starting async job submit for node 68d733b8a6a7b6615d4c4646 2025-09-27 01:04:16,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:16,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b8a6a7b6615d4c4646 HTTP/1.1" 200 None 2025-09-27 01:04:16,495 - lava_callback - DEBUG - Processing node 68d733b8a6a7b6615d4c4646: baseline-arm INFO: 172.21.0.1:54784 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:04:16,719 - lava_callback - INFO - Received callback for node 68d736e7a6a7b6615d4c47cb INFO: 172.21.0.1:54788 - "POST /node/68d736e7a6a7b6615d4c47cb HTTP/1.0" 202 Accepted 2025-09-27 01:04:16,730 - lava_callback - INFO - Starting async job submit for node 68d736e7a6a7b6615d4c47cb 2025-09-27 01:04:16,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:16,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e7a6a7b6615d4c47cb HTTP/1.1" 200 None 2025-09-27 01:04:16,863 - lava_callback - DEBUG - Processing node 68d736e7a6a7b6615d4c47cb: baseline-arm64-baylibre 2025-09-27 01:04:16,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:17,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:17,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b8a6a7b6615d4c4646/log.txt.gz 2025-09-27 01:04:17,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:17,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:17,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:17,379 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d733b8a6a7b6615d4c4646/lava_callback.json.gz 2025-09-27 01:04:17,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 DEBUG: Setup failed for 68d733b8a6a7b6615d4c4646. Transitting job node result: incomplete -> fail 2025-09-27 01:04:17,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:17,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e7a6a7b6615d4c47cb/log.txt.gz 2025-09-27 01:04:17,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:17,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d733b8a6a7b6615d4c4646 HTTP/1.1" 200 None 2025-09-27 01:04:17,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:17,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 01:04:17,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:17,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d733b8a6a7b6615d4c4646 HTTP/1.1" 200 None 2025-09-27 01:04:17,510 - lava_callback - INFO - Completed processing callback for node 68d733b8a6a7b6615d4c4646 2025-09-27 01:04:17,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:17,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e7a6a7b6615d4c47cb/lava_callback.json.gz 2025-09-27 01:04:17,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:17,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e7a6a7b6615d4c47cb HTTP/1.1" 200 None 2025-09-27 01:04:17,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:17,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:04:17,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:17,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e7a6a7b6615d4c47cb HTTP/1.1" 200 None 2025-09-27 01:04:17,741 - lava_callback - INFO - Completed processing callback for node 68d736e7a6a7b6615d4c47cb 2025-09-27 01:04:18,653 - lava_callback - INFO - Received callback for node 68d736e9a6a7b6615d4c47e0 INFO: 172.21.0.1:54802 - "POST /node/68d736e9a6a7b6615d4c47e0 HTTP/1.0" 202 Accepted 2025-09-27 01:04:18,660 - lava_callback - INFO - Starting async job submit for node 68d736e9a6a7b6615d4c47e0 2025-09-27 01:04:18,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:18,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e9a6a7b6615d4c47e0 HTTP/1.1" 200 None 2025-09-27 01:04:18,713 - lava_callback - DEBUG - Processing node 68d736e9a6a7b6615d4c47e0: baseline-arm64-baylibre 2025-09-27 01:04:19,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:19,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:19,260 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e9a6a7b6615d4c47e0/log.txt.gz 2025-09-27 01:04:19,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:19,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:19,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e9a6a7b6615d4c47e0/lava_callback.json.gz 2025-09-27 01:04:19,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:19,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e9a6a7b6615d4c47e0 HTTP/1.1" 200 None 2025-09-27 01:04:19,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:19,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:04:19,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:19,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e9a6a7b6615d4c47e0 HTTP/1.1" 200 None 2025-09-27 01:04:19,554 - lava_callback - INFO - Completed processing callback for node 68d736e9a6a7b6615d4c47e0 2025-09-27 01:04:25,355 - lava_callback - INFO - Received callback for node 68d736e3a6a7b6615d4c47b3 INFO: 172.21.0.1:50214 - "POST /node/68d736e3a6a7b6615d4c47b3 HTTP/1.0" 202 Accepted 2025-09-27 01:04:25,361 - lava_callback - INFO - Starting async job submit for node 68d736e3a6a7b6615d4c47b3 2025-09-27 01:04:25,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:25,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e3a6a7b6615d4c47b3 HTTP/1.1" 200 None 2025-09-27 01:04:25,407 - lava_callback - DEBUG - Processing node 68d736e3a6a7b6615d4c47b3: baseline-arm64 2025-09-27 01:04:25,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:25,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:25,981 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e3a6a7b6615d4c47b3/log.txt.gz 2025-09-27 01:04:25,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:04:26,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:04:26,108 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e3a6a7b6615d4c47b3/lava_callback.json.gz 2025-09-27 01:04:26,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:26,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e3a6a7b6615d4c47b3 HTTP/1.1" 200 None 2025-09-27 01:04:26,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:26,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:04:26,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:04:26,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e3a6a7b6615d4c47b3 HTTP/1.1" 200 None 2025-09-27 01:04:26,188 - lava_callback - INFO - Completed processing callback for node 68d736e3a6a7b6615d4c47b3 INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:05:04,422 - lava_callback - INFO - Received callback for node 68d736e9a6a7b6615d4c47dd INFO: 172.21.0.1:44702 - "POST /node/68d736e9a6a7b6615d4c47dd HTTP/1.0" 202 Accepted 2025-09-27 01:05:04,428 - lava_callback - INFO - Starting async job submit for node 68d736e9a6a7b6615d4c47dd 2025-09-27 01:05:04,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:04,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e9a6a7b6615d4c47dd HTTP/1.1" 200 None 2025-09-27 01:05:04,462 - lava_callback - DEBUG - Processing node 68d736e9a6a7b6615d4c47dd: baseline-arm64-baylibre 2025-09-27 01:05:04,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:05:04,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:05:04,860 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e9a6a7b6615d4c47dd/log.txt.gz 2025-09-27 01:05:04,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:05:04,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:05:04,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d736e9a6a7b6615d4c47dd/lava_callback.json.gz 2025-09-27 01:05:05,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:05,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e9a6a7b6615d4c47dd HTTP/1.1" 200 None 2025-09-27 01:05:05,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:05,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:05:05,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:05,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e9a6a7b6615d4c47dd HTTP/1.1" 200 None 2025-09-27 01:05:05,081 - lava_callback - INFO - Completed processing callback for node 68d736e9a6a7b6615d4c47dd INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:05:13,786 - lava_callback - INFO - Received callback for node 68d736f0a6a7b6615d4c480a INFO: 172.21.0.1:46996 - "POST /node/68d736f0a6a7b6615d4c480a HTTP/1.0" 202 Accepted 2025-09-27 01:05:13,791 - lava_callback - INFO - Starting async job submit for node 68d736f0a6a7b6615d4c480a 2025-09-27 01:05:13,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:13,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f0a6a7b6615d4c480a HTTP/1.1" 200 None 2025-09-27 01:05:13,839 - lava_callback - DEBUG - Processing node 68d736f0a6a7b6615d4c480a: baseline-arm64-broonie 2025-09-27 01:05:14,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:05:14,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:05:14,143 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736f0a6a7b6615d4c480a/log.txt.gz 2025-09-27 01:05:14,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:05:14,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:05:14,260 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736f0a6a7b6615d4c480a/lava_callback.json.gz 2025-09-27 01:05:14,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:14,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f0a6a7b6615d4c480a HTTP/1.1" 200 None 2025-09-27 01:05:14,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:14,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:05:14,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:14,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736f0a6a7b6615d4c480a HTTP/1.1" 200 None 2025-09-27 01:05:14,349 - lava_callback - INFO - Completed processing callback for node 68d736f0a6a7b6615d4c480a INFO: 172.21.0.1:47006 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 01:05:16,332 - lava_callback - INFO - Received callback for node 68d7374ba6a7b6615d4c48cd INFO: 172.21.0.1:47020 - "POST /node/68d7374ba6a7b6615d4c48cd HTTP/1.0" 202 Accepted 2025-09-27 01:05:16,339 - lava_callback - INFO - Starting async job submit for node 68d7374ba6a7b6615d4c48cd 2025-09-27 01:05:16,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:16,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7374ba6a7b6615d4c48cd HTTP/1.1" 200 None 2025-09-27 01:05:16,397 - lava_callback - DEBUG - Processing node 68d7374ba6a7b6615d4c48cd: baseline-arm64-kontron INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:05:16,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:05:16,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:05:16,857 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d7374ba6a7b6615d4c48cd/log.txt.gz 2025-09-27 01:05:16,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:05:16,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:05:16,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d7374ba6a7b6615d4c48cd/lava_callback.json.gz 2025-09-27 01:05:17,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:17,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7374ba6a7b6615d4c48cd HTTP/1.1" 200 None 2025-09-27 01:05:17,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:17,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:05:17,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:17,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7374ba6a7b6615d4c48cd HTTP/1.1" 200 None 2025-09-27 01:05:17,086 - lava_callback - INFO - Completed processing callback for node 68d7374ba6a7b6615d4c48cd 2025-09-27 01:05:17,192 - lava_callback - INFO - Received callback for node 68d52302b70fb2a1e20f1e65 INFO: 172.21.0.1:47040 - "POST /node/68d52302b70fb2a1e20f1e65 HTTP/1.0" 202 Accepted 2025-09-27 01:05:17,202 - lava_callback - INFO - Starting async job submit for node 68d52302b70fb2a1e20f1e65 2025-09-27 01:05:17,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:17,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52302b70fb2a1e20f1e65 HTTP/1.1" 200 None 2025-09-27 01:05:17,243 - lava_callback - DEBUG - Processing node 68d52302b70fb2a1e20f1e65: baseline-arm64 2025-09-27 01:05:17,656 - lava_callback - ERROR - Error processing callback for node 68d52302b70fb2a1e20f1e65: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:05:46,899 - lava_callback - INFO - Received callback for node 68d73704a6a7b6615d4c4871 INFO: 172.21.0.1:48810 - "POST /node/68d73704a6a7b6615d4c4871 HTTP/1.0" 202 Accepted 2025-09-27 01:05:46,905 - lava_callback - INFO - Starting async job submit for node 68d73704a6a7b6615d4c4871 2025-09-27 01:05:46,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:46,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73704a6a7b6615d4c4871 HTTP/1.1" 200 None 2025-09-27 01:05:46,939 - lava_callback - DEBUG - Processing node 68d73704a6a7b6615d4c4871: baseline-arm64 2025-09-27 01:05:47,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:05:47,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:05:47,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73704a6a7b6615d4c4871/log.txt.gz 2025-09-27 01:05:47,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:05:47,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:05:47,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73704a6a7b6615d4c4871/lava_callback.json.gz 2025-09-27 01:05:47,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:47,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73704a6a7b6615d4c4871 HTTP/1.1" 200 None 2025-09-27 01:05:47,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:47,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:05:47,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:05:47,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73704a6a7b6615d4c4871 HTTP/1.1" 200 None 2025-09-27 01:05:47,882 - lava_callback - INFO - Completed processing callback for node 68d73704a6a7b6615d4c4871 INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:06:45,666 - lava_callback - INFO - Received callback for node 68d52306b70fb2a1e20f1e68 INFO: 172.21.0.1:53384 - "POST /node/68d52306b70fb2a1e20f1e68 HTTP/1.0" 202 Accepted 2025-09-27 01:06:45,672 - lava_callback - INFO - Starting async job submit for node 68d52306b70fb2a1e20f1e68 2025-09-27 01:06:45,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:06:45,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52306b70fb2a1e20f1e68 HTTP/1.1" 200 None 2025-09-27 01:06:45,725 - lava_callback - DEBUG - Processing node 68d52306b70fb2a1e20f1e68: baseline-arm64 2025-09-27 01:06:46,059 - lava_callback - ERROR - Error processing callback for node 68d52306b70fb2a1e20f1e68: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:07:33,583 - lava_callback - INFO - Received callback for node 68d7370ca6a7b6615d4c489e INFO: 172.21.0.1:42686 - "POST /node/68d7370ca6a7b6615d4c489e HTTP/1.0" 202 Accepted 2025-09-27 01:07:33,589 - lava_callback - INFO - Starting async job submit for node 68d7370ca6a7b6615d4c489e 2025-09-27 01:07:33,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:07:33,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ca6a7b6615d4c489e HTTP/1.1" 200 None 2025-09-27 01:07:33,630 - lava_callback - DEBUG - Processing node 68d7370ca6a7b6615d4c489e: baseline-arm64-broonie 2025-09-27 01:07:33,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:07:33,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:07:33,977 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370ca6a7b6615d4c489e/log.txt.gz 2025-09-27 01:07:33,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:07:34,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:07:34,099 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370ca6a7b6615d4c489e/lava_callback.json.gz 2025-09-27 01:07:34,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:07:34,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ca6a7b6615d4c489e HTTP/1.1" 200 None 2025-09-27 01:07:34,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:07:34,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:07:34,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:07:34,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370ca6a7b6615d4c489e HTTP/1.1" 200 None 2025-09-27 01:07:34,189 - lava_callback - INFO - Completed processing callback for node 68d7370ca6a7b6615d4c489e 2025-09-27 01:07:36,402 - lava_callback - INFO - Received callback for node 68d737c1a6a7b6615d4c4951 INFO: 172.21.0.1:42694 - "POST /node/68d737c1a6a7b6615d4c4951 HTTP/1.0" 202 Accepted 2025-09-27 01:07:36,408 - lava_callback - INFO - Starting async job submit for node 68d737c1a6a7b6615d4c4951 2025-09-27 01:07:36,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:07:36,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d737c1a6a7b6615d4c4951 HTTP/1.1" 200 None 2025-09-27 01:07:36,455 - lava_callback - DEBUG - Processing node 68d737c1a6a7b6615d4c4951: baseline-arm64-kontron INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:07:36,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:07:36,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:07:36,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d737c1a6a7b6615d4c4951/log.txt.gz 2025-09-27 01:07:36,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:07:36,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:07:36,927 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d737c1a6a7b6615d4c4951/lava_callback.json.gz 2025-09-27 01:07:36,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:07:36,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d737c1a6a7b6615d4c4951 HTTP/1.1" 200 None 2025-09-27 01:07:36,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:07:37,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:07:37,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:07:37,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d737c1a6a7b6615d4c4951 HTTP/1.1" 200 None 2025-09-27 01:07:37,030 - lava_callback - INFO - Completed processing callback for node 68d737c1a6a7b6615d4c4951 INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:08:01,735 - lava_callback - INFO - Received callback for node 68d52307b70fb2a1e20f1e6b INFO: 172.21.0.1:33894 - "POST /node/68d52307b70fb2a1e20f1e6b HTTP/1.0" 202 Accepted 2025-09-27 01:08:01,741 - lava_callback - INFO - Starting async job submit for node 68d52307b70fb2a1e20f1e6b 2025-09-27 01:08:01,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:01,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52307b70fb2a1e20f1e6b HTTP/1.1" 200 None 2025-09-27 01:08:01,774 - lava_callback - DEBUG - Processing node 68d52307b70fb2a1e20f1e6b: baseline-arm64 2025-09-27 01:08:02,113 - lava_callback - ERROR - Error processing callback for node 68d52307b70fb2a1e20f1e6b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50794 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 01:08:15,743 - lava_callback - INFO - Received callback for node 68d736dfa6a7b6615d4c479c INFO: 172.21.0.1:50806 - "POST /node/68d736dfa6a7b6615d4c479c HTTP/1.0" 202 Accepted 2025-09-27 01:08:15,749 - lava_callback - INFO - Starting async job submit for node 68d736dfa6a7b6615d4c479c 2025-09-27 01:08:15,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:15,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dfa6a7b6615d4c479c HTTP/1.1" 200 None 2025-09-27 01:08:15,789 - lava_callback - DEBUG - Processing node 68d736dfa6a7b6615d4c479c: baseline-arm64 2025-09-27 01:08:16,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:08:16,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:08:16,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dfa6a7b6615d4c479c/log.txt.gz 2025-09-27 01:08:16,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:08:16,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:08:16,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dfa6a7b6615d4c479c/lava_callback.json.gz 2025-09-27 01:08:16,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:16,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dfa6a7b6615d4c479c HTTP/1.1" 200 None 2025-09-27 01:08:16,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:16,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:08:16,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:16,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736dfa6a7b6615d4c479c HTTP/1.1" 200 None 2025-09-27 01:08:16,435 - lava_callback - INFO - Completed processing callback for node 68d736dfa6a7b6615d4c479c INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:08:24,822 - lava_callback - INFO - Received callback for node 68d736dca6a7b6615d4c478a INFO: 172.21.0.1:54214 - "POST /node/68d736dca6a7b6615d4c478a HTTP/1.0" 202 Accepted 2025-09-27 01:08:24,828 - lava_callback - INFO - Starting async job submit for node 68d736dca6a7b6615d4c478a 2025-09-27 01:08:24,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dca6a7b6615d4c478a HTTP/1.1" 200 None 2025-09-27 01:08:24,867 - lava_callback - DEBUG - Processing node 68d736dca6a7b6615d4c478a: baseline-arm64 2025-09-27 01:08:25,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:08:25,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:08:25,242 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dca6a7b6615d4c478a/log.txt.gz 2025-09-27 01:08:25,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:08:25,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:08:25,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dca6a7b6615d4c478a/lava_callback.json.gz 2025-09-27 01:08:25,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:25,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dca6a7b6615d4c478a HTTP/1.1" 200 None 2025-09-27 01:08:25,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:25,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:08:25,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:08:25,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736dca6a7b6615d4c478a HTTP/1.1" 200 None 2025-09-27 01:08:25,462 - lava_callback - INFO - Completed processing callback for node 68d736dca6a7b6615d4c478a INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:09:19,899 - lava_callback - INFO - Received callback for node 68d52309b70fb2a1e20f1e6e INFO: 172.21.0.1:39754 - "POST /node/68d52309b70fb2a1e20f1e6e HTTP/1.0" 202 Accepted 2025-09-27 01:09:19,905 - lava_callback - INFO - Starting async job submit for node 68d52309b70fb2a1e20f1e6e 2025-09-27 01:09:19,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:19,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52309b70fb2a1e20f1e6e HTTP/1.1" 200 None 2025-09-27 01:09:19,943 - lava_callback - DEBUG - Processing node 68d52309b70fb2a1e20f1e6e: baseline-arm64 2025-09-27 01:09:20,270 - lava_callback - ERROR - Error processing callback for node 68d52309b70fb2a1e20f1e6e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:09:27,237 - lava_callback - INFO - Received callback for node 68d736f1a6a7b6615d4c4810 INFO: 172.21.0.1:39766 - "POST /node/68d736f1a6a7b6615d4c4810 HTTP/1.0" 202 Accepted 2025-09-27 01:09:27,243 - lava_callback - INFO - Starting async job submit for node 68d736f1a6a7b6615d4c4810 2025-09-27 01:09:27,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:27,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f1a6a7b6615d4c4810 HTTP/1.1" 200 None 2025-09-27 01:09:27,291 - lava_callback - DEBUG - Processing node 68d736f1a6a7b6615d4c4810: baseline-arm64-broonie 2025-09-27 01:09:27,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:09:27,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:09:27,708 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736f1a6a7b6615d4c4810/log.txt.gz 2025-09-27 01:09:27,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:09:27,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:09:27,862 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736f1a6a7b6615d4c4810/lava_callback.json.gz 2025-09-27 01:09:27,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:27,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f1a6a7b6615d4c4810 HTTP/1.1" 200 None 2025-09-27 01:09:27,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:27,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:09:27,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:27,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736f1a6a7b6615d4c4810 HTTP/1.1" 200 None 2025-09-27 01:09:27,937 - lava_callback - INFO - Completed processing callback for node 68d736f1a6a7b6615d4c4810 INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:09:43,970 - lava_callback - INFO - Received callback for node 68d7370da6a7b6615d4c48a4 INFO: 172.21.0.1:38384 - "POST /node/68d7370da6a7b6615d4c48a4 HTTP/1.0" 202 Accepted 2025-09-27 01:09:43,976 - lava_callback - INFO - Starting async job submit for node 68d7370da6a7b6615d4c48a4 2025-09-27 01:09:44,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:44,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370da6a7b6615d4c48a4 HTTP/1.1" 200 None 2025-09-27 01:09:44,019 - lava_callback - DEBUG - Processing node 68d7370da6a7b6615d4c48a4: baseline-arm64-broonie 2025-09-27 01:09:44,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:09:44,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:09:44,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370da6a7b6615d4c48a4/log.txt.gz 2025-09-27 01:09:44,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:09:44,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:09:44,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370da6a7b6615d4c48a4/lava_callback.json.gz 2025-09-27 01:09:44,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:44,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370da6a7b6615d4c48a4 HTTP/1.1" 200 None 2025-09-27 01:09:44,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:44,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:09:44,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:44,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370da6a7b6615d4c48a4 HTTP/1.1" 200 None 2025-09-27 01:09:44,628 - lava_callback - INFO - Completed processing callback for node 68d7370da6a7b6615d4c48a4 INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:09:56,358 - lava_callback - INFO - Received callback for node 68d7384ea6a7b6615d4c498f INFO: 172.21.0.1:45106 - "POST /node/68d7384ea6a7b6615d4c498f HTTP/1.0" 202 Accepted 2025-09-27 01:09:56,364 - lava_callback - INFO - Starting async job submit for node 68d7384ea6a7b6615d4c498f 2025-09-27 01:09:56,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:56,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7384ea6a7b6615d4c498f HTTP/1.1" 200 None 2025-09-27 01:09:56,412 - lava_callback - DEBUG - Processing node 68d7384ea6a7b6615d4c498f: baseline-arm64-kontron INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:09:56,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:09:56,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:09:56,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d7384ea6a7b6615d4c498f/log.txt.gz 2025-09-27 01:09:56,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:09:56,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:09:56,876 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d7384ea6a7b6615d4c498f/lava_callback.json.gz 2025-09-27 01:09:56,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:56,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7384ea6a7b6615d4c498f HTTP/1.1" 200 None 2025-09-27 01:09:56,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:56,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:09:56,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:09:56,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7384ea6a7b6615d4c498f HTTP/1.1" 200 None 2025-09-27 01:09:56,972 - lava_callback - INFO - Completed processing callback for node 68d7384ea6a7b6615d4c498f INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:10:42,769 - lava_callback - INFO - Received callback for node 68d5230ab70fb2a1e20f1e71 INFO: 172.21.0.1:43672 - "POST /node/68d5230ab70fb2a1e20f1e71 HTTP/1.0" 202 Accepted 2025-09-27 01:10:42,775 - lava_callback - INFO - Starting async job submit for node 68d5230ab70fb2a1e20f1e71 2025-09-27 01:10:42,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:10:42,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5230ab70fb2a1e20f1e71 HTTP/1.1" 200 None 2025-09-27 01:10:42,809 - lava_callback - DEBUG - Processing node 68d5230ab70fb2a1e20f1e71: baseline-arm64 2025-09-27 01:10:43,167 - lava_callback - ERROR - Error processing callback for node 68d5230ab70fb2a1e20f1e71: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:11:19,827 - lava_callback - INFO - Received callback for node 68d734f9a6a7b6615d4c476f INFO: 172.21.0.1:36814 - "POST /node/68d734f9a6a7b6615d4c476f HTTP/1.0" 202 Accepted 2025-09-27 01:11:19,833 - lava_callback - INFO - Starting async job submit for node 68d734f9a6a7b6615d4c476f 2025-09-27 01:11:19,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:19,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d734f9a6a7b6615d4c476f HTTP/1.1" 200 None 2025-09-27 01:11:19,875 - lava_callback - DEBUG - Processing node 68d734f9a6a7b6615d4c476f: baseline-x86-kcidebug-intel 2025-09-27 01:11:20,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:11:20,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:11:20,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d734f9a6a7b6615d4c476f/log.txt.gz 2025-09-27 01:11:20,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:11:20,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:11:20,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d734f9a6a7b6615d4c476f/lava_callback.json.gz DEBUG: Setup failed for 68d734f9a6a7b6615d4c476f. Transitting job node result: incomplete -> fail 2025-09-27 01:11:20,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:20,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d734f9a6a7b6615d4c476f HTTP/1.1" 200 None 2025-09-27 01:11:20,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:20,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a4d3c94e462c68828c2 HTTP/1.1" 200 None 2025-09-27 01:11:20,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d734f9a6a7b6615d4c476f HTTP/1.1" 200 None 2025-09-27 01:11:20,561 - lava_callback - INFO - Completed processing callback for node 68d734f9a6a7b6615d4c476f 2025-09-27 01:11:23,381 - lava_callback - INFO - Received callback for node 68d56e262be2da466069933c INFO: 172.21.0.1:36816 - "POST /node/68d56e262be2da466069933c HTTP/1.0" 202 Accepted 2025-09-27 01:11:23,387 - lava_callback - INFO - Starting async job submit for node 68d56e262be2da466069933c 2025-09-27 01:11:23,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:23,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e262be2da466069933c HTTP/1.1" 200 None 2025-09-27 01:11:23,427 - lava_callback - DEBUG - Processing node 68d56e262be2da466069933c: baseline-arm 2025-09-27 01:11:23,659 - lava_callback - ERROR - Error processing callback for node 68d56e262be2da466069933c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:11:39,016 - lava_callback - INFO - Received callback for node 68d521ccb70fb2a1e20f1ba5 INFO: 172.21.0.1:52978 - "POST /node/68d521ccb70fb2a1e20f1ba5 HTTP/1.0" 202 Accepted 2025-09-27 01:11:39,023 - lava_callback - INFO - Starting async job submit for node 68d521ccb70fb2a1e20f1ba5 2025-09-27 01:11:39,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:39,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d521ccb70fb2a1e20f1ba5 HTTP/1.1" 200 None 2025-09-27 01:11:39,078 - lava_callback - DEBUG - Processing node 68d521ccb70fb2a1e20f1ba5: baseline-arm64 2025-09-27 01:11:39,898 - lava_callback - ERROR - Error processing callback for node 68d521ccb70fb2a1e20f1ba5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:11:56,995 - lava_callback - INFO - Received callback for node 68d73473a6a7b6615d4c4759 INFO: 172.21.0.1:60396 - "POST /node/68d73473a6a7b6615d4c4759 HTTP/1.0" 202 Accepted 2025-09-27 01:11:57,003 - lava_callback - INFO - Starting async job submit for node 68d73473a6a7b6615d4c4759 2025-09-27 01:11:57,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:57,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73473a6a7b6615d4c4759 HTTP/1.1" 200 None 2025-09-27 01:11:57,039 - lava_callback - DEBUG - Processing node 68d73473a6a7b6615d4c4759: blktests-ddp-x86 2025-09-27 01:11:57,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:11:58,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:11:58,021 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d73473a6a7b6615d4c4759/log.txt.gz 2025-09-27 01:11:58,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:11:58,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:11:58,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d73473a6a7b6615d4c4759/lava_callback.json.gz 2025-09-27 01:11:58,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:58,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73473a6a7b6615d4c4759 HTTP/1.1" 200 None 2025-09-27 01:11:58,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:58,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 01:11:58,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:11:58,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73473a6a7b6615d4c4759 HTTP/1.1" 200 None 2025-09-27 01:11:58,387 - lava_callback - INFO - Completed processing callback for node 68d73473a6a7b6615d4c4759 2025-09-27 01:12:00,549 - lava_callback - INFO - Received callback for node 68d5230cb70fb2a1e20f1e74 INFO: 172.21.0.1:37556 - "POST /node/68d5230cb70fb2a1e20f1e74 HTTP/1.0" 202 Accepted 2025-09-27 01:12:00,562 - lava_callback - INFO - Starting async job submit for node 68d5230cb70fb2a1e20f1e74 2025-09-27 01:12:00,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:00,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5230cb70fb2a1e20f1e74 HTTP/1.1" 200 None 2025-09-27 01:12:00,614 - lava_callback - DEBUG - Processing node 68d5230cb70fb2a1e20f1e74: baseline-arm64 2025-09-27 01:12:01,242 - lava_callback - ERROR - Error processing callback for node 68d5230cb70fb2a1e20f1e74: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:12:11,568 - lava_callback - INFO - Received callback for node 68d521d5b70fb2a1e20f1bc7 INFO: 172.21.0.1:43600 - "POST /node/68d521d5b70fb2a1e20f1bc7 HTTP/1.0" 202 Accepted 2025-09-27 01:12:11,580 - lava_callback - INFO - Starting async job submit for node 68d521d5b70fb2a1e20f1bc7 2025-09-27 01:12:11,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:11,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d521d5b70fb2a1e20f1bc7 HTTP/1.1" 200 None 2025-09-27 01:12:11,671 - lava_callback - DEBUG - Processing node 68d521d5b70fb2a1e20f1bc7: baseline-arm64 2025-09-27 01:12:12,791 - lava_callback - ERROR - Error processing callback for node 68d521d5b70fb2a1e20f1bc7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43616 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 01:12:16,433 - lava_callback - INFO - Received callback for node 68d738d9a6a7b6615d4c499c INFO: 172.21.0.1:43620 - "POST /node/68d738d9a6a7b6615d4c499c HTTP/1.0" 202 Accepted 2025-09-27 01:12:16,441 - lava_callback - INFO - Starting async job submit for node 68d738d9a6a7b6615d4c499c 2025-09-27 01:12:16,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:16,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d738d9a6a7b6615d4c499c HTTP/1.1" 200 None 2025-09-27 01:12:16,494 - lava_callback - DEBUG - Processing node 68d738d9a6a7b6615d4c499c: baseline-arm64-kontron INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:12:16,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:12:16,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:12:16,870 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d738d9a6a7b6615d4c499c/log.txt.gz 2025-09-27 01:12:16,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:12:17,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:12:17,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d738d9a6a7b6615d4c499c/lava_callback.json.gz 2025-09-27 01:12:17,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:17,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d738d9a6a7b6615d4c499c HTTP/1.1" 200 None 2025-09-27 01:12:17,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:17,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:12:17,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:17,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d738d9a6a7b6615d4c499c HTTP/1.1" 200 None 2025-09-27 01:12:17,127 - lava_callback - INFO - Completed processing callback for node 68d738d9a6a7b6615d4c499c 2025-09-27 01:12:25,321 - lava_callback - INFO - Received callback for node 68d7384aa6a7b6615d4c498b INFO: 172.21.0.1:46736 - "POST /node/68d7384aa6a7b6615d4c498b HTTP/1.0" 202 Accepted 2025-09-27 01:12:25,327 - lava_callback - INFO - Starting async job submit for node 68d7384aa6a7b6615d4c498b 2025-09-27 01:12:25,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:25,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7384aa6a7b6615d4c498b HTTP/1.1" 200 None 2025-09-27 01:12:25,436 - lava_callback - DEBUG - Processing node 68d7384aa6a7b6615d4c498b: baseline-arm64-broonie 2025-09-27 01:12:25,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:12:25,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:12:25,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7384aa6a7b6615d4c498b/log.txt.gz 2025-09-27 01:12:25,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:12:25,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:12:25,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7384aa6a7b6615d4c498b/lava_callback.json.gz 2025-09-27 01:12:26,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:26,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7384aa6a7b6615d4c498b HTTP/1.1" 200 None 2025-09-27 01:12:26,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:26,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:12:26,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:26,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7384aa6a7b6615d4c498b HTTP/1.1" 200 None 2025-09-27 01:12:26,076 - lava_callback - INFO - Completed processing callback for node 68d7384aa6a7b6615d4c498b INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:12:45,823 - lava_callback - INFO - Received callback for node 68d5230db70fb2a1e20f1e77 INFO: 172.21.0.1:38232 - "POST /node/68d5230db70fb2a1e20f1e77 HTTP/1.0" 202 Accepted 2025-09-27 01:12:45,830 - lava_callback - INFO - Starting async job submit for node 68d5230db70fb2a1e20f1e77 2025-09-27 01:12:45,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:12:45,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5230db70fb2a1e20f1e77 HTTP/1.1" 200 None 2025-09-27 01:12:45,865 - lava_callback - DEBUG - Processing node 68d5230db70fb2a1e20f1e77: baseline-arm64 2025-09-27 01:12:46,289 - lava_callback - ERROR - Error processing callback for node 68d5230db70fb2a1e20f1e77: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:13:22,370 - lava_callback - INFO - Received callback for node 68d56e282be2da4660699348 INFO: 172.21.0.1:47748 - "POST /node/68d56e282be2da4660699348 HTTP/1.0" 202 Accepted 2025-09-27 01:13:22,376 - lava_callback - INFO - Starting async job submit for node 68d56e282be2da4660699348 2025-09-27 01:13:22,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:13:22,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e282be2da4660699348 HTTP/1.1" 200 None 2025-09-27 01:13:22,444 - lava_callback - DEBUG - Processing node 68d56e282be2da4660699348: baseline-arm 2025-09-27 01:13:22,731 - lava_callback - ERROR - Error processing callback for node 68d56e282be2da4660699348: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:14:36,540 - lava_callback - INFO - Received callback for node 68d73965a6a7b6615d4c49c6 INFO: 172.21.0.1:34744 - "POST /node/68d73965a6a7b6615d4c49c6 HTTP/1.0" 202 Accepted 2025-09-27 01:14:36,548 - lava_callback - INFO - Starting async job submit for node 68d73965a6a7b6615d4c49c6 2025-09-27 01:14:36,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:14:36,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73965a6a7b6615d4c49c6 HTTP/1.1" 200 None 2025-09-27 01:14:36,606 - lava_callback - DEBUG - Processing node 68d73965a6a7b6615d4c49c6: baseline-arm64-kontron 2025-09-27 01:14:36,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:14:36,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:14:36,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d73965a6a7b6615d4c49c6/log.txt.gz 2025-09-27 01:14:36,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:14:37,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:14:37,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d73965a6a7b6615d4c49c6/lava_callback.json.gz 2025-09-27 01:14:37,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:14:37,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73965a6a7b6615d4c49c6 HTTP/1.1" 200 None 2025-09-27 01:14:37,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:14:37,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:14:37,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:14:37,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73965a6a7b6615d4c49c6 HTTP/1.1" 200 None 2025-09-27 01:14:37,397 - lava_callback - INFO - Completed processing callback for node 68d73965a6a7b6615d4c49c6 INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:15:09,226 - lava_callback - INFO - Received callback for node 68d49787a5c2c05277bcef8b INFO: 172.21.0.1:41438 - "POST /node/68d49787a5c2c05277bcef8b HTTP/1.0" 202 Accepted 2025-09-27 01:15:09,232 - lava_callback - INFO - Starting async job submit for node 68d49787a5c2c05277bcef8b 2025-09-27 01:15:09,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:15:09,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49787a5c2c05277bcef8b HTTP/1.1" 200 None 2025-09-27 01:15:09,245 - lava_callback - DEBUG - Processing node 68d49787a5c2c05277bcef8b: baseline-arm 2025-09-27 01:15:09,245 - lava_callback - ERROR - Error processing callback for node 68d49787a5c2c05277bcef8b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:38110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:15:24,063 - lava_callback - INFO - Received callback for node 68d5710d2be2da46606994ad INFO: 172.21.0.1:51756 - "POST /node/68d5710d2be2da46606994ad HTTP/1.0" 202 Accepted 2025-09-27 01:15:24,069 - lava_callback - INFO - Starting async job submit for node 68d5710d2be2da46606994ad 2025-09-27 01:15:24,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:15:24,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5710d2be2da46606994ad HTTP/1.1" 200 None 2025-09-27 01:15:24,103 - lava_callback - DEBUG - Processing node 68d5710d2be2da46606994ad: baseline-arm 2025-09-27 01:15:24,335 - lava_callback - ERROR - Error processing callback for node 68d5710d2be2da46606994ad: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:16:56,608 - lava_callback - INFO - Received callback for node 68d739f2a6a7b6615d4c49de INFO: 172.21.0.1:44620 - "POST /node/68d739f2a6a7b6615d4c49de HTTP/1.0" 202 Accepted 2025-09-27 01:16:56,614 - lava_callback - INFO - Starting async job submit for node 68d739f2a6a7b6615d4c49de 2025-09-27 01:16:56,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:16:56,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d739f2a6a7b6615d4c49de HTTP/1.1" 200 None 2025-09-27 01:16:56,685 - lava_callback - DEBUG - Processing node 68d739f2a6a7b6615d4c49de: baseline-arm64-kontron 2025-09-27 01:16:56,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:16:57,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:16:57,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d739f2a6a7b6615d4c49de/log.txt.gz 2025-09-27 01:16:57,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:16:57,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:16:57,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d739f2a6a7b6615d4c49de/lava_callback.json.gz 2025-09-27 01:16:57,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:16:57,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d739f2a6a7b6615d4c49de HTTP/1.1" 200 None 2025-09-27 01:16:57,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:16:57,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:16:57,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:16:57,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d739f2a6a7b6615d4c49de HTTP/1.1" 200 None 2025-09-27 01:16:57,341 - lava_callback - INFO - Completed processing callback for node 68d739f2a6a7b6615d4c49de INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:17:18,077 - lava_callback - INFO - Received callback for node 68d5710f2be2da46606994b9 INFO: 172.21.0.1:54144 - "POST /node/68d5710f2be2da46606994b9 HTTP/1.0" 202 Accepted 2025-09-27 01:17:18,083 - lava_callback - INFO - Starting async job submit for node 68d5710f2be2da46606994b9 2025-09-27 01:17:18,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:17:18,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5710f2be2da46606994b9 HTTP/1.1" 200 None 2025-09-27 01:17:18,116 - lava_callback - DEBUG - Processing node 68d5710f2be2da46606994b9: baseline-arm 2025-09-27 01:17:18,345 - lava_callback - ERROR - Error processing callback for node 68d5710f2be2da46606994b9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:17:45,647 - lava_callback - INFO - Received callback for node 68d736eda6a7b6615d4c47f8 INFO: 172.21.0.1:55614 - "POST /node/68d736eda6a7b6615d4c47f8 HTTP/1.0" 202 Accepted 2025-09-27 01:17:45,653 - lava_callback - INFO - Starting async job submit for node 68d736eda6a7b6615d4c47f8 2025-09-27 01:17:45,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:17:45,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eda6a7b6615d4c47f8 HTTP/1.1" 200 None 2025-09-27 01:17:45,699 - lava_callback - DEBUG - Processing node 68d736eda6a7b6615d4c47f8: baseline-arm64-broonie 2025-09-27 01:17:45,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:17:46,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:17:46,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eda6a7b6615d4c47f8/log.txt.gz 2025-09-27 01:17:46,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:17:46,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:17:46,199 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eda6a7b6615d4c47f8/lava_callback.json.gz 2025-09-27 01:17:46,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:17:46,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eda6a7b6615d4c47f8 HTTP/1.1" 200 None 2025-09-27 01:17:46,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:17:46,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:17:46,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:17:46,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eda6a7b6615d4c47f8 HTTP/1.1" 200 None 2025-09-27 01:17:46,288 - lava_callback - INFO - Completed processing callback for node 68d736eda6a7b6615d4c47f8 INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:18:06,679 - lava_callback - INFO - Received callback for node 68d739faa6a7b6615d4c49e2 INFO: 172.21.0.1:42436 - "POST /node/68d739faa6a7b6615d4c49e2 HTTP/1.0" 202 Accepted 2025-09-27 01:18:06,684 - lava_callback - INFO - Starting async job submit for node 68d739faa6a7b6615d4c49e2 2025-09-27 01:18:06,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:06,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d739faa6a7b6615d4c49e2 HTTP/1.1" 200 None 2025-09-27 01:18:06,736 - lava_callback - DEBUG - Processing node 68d739faa6a7b6615d4c49e2: baseline-arm64-broonie 2025-09-27 01:18:06,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:18:07,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:18:07,056 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d739faa6a7b6615d4c49e2/log.txt.gz 2025-09-27 01:18:07,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:18:07,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:18:07,201 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d739faa6a7b6615d4c49e2/lava_callback.json.gz 2025-09-27 01:18:07,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:07,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d739faa6a7b6615d4c49e2 HTTP/1.1" 200 None 2025-09-27 01:18:07,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:07,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:18:07,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:07,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d739faa6a7b6615d4c49e2 HTTP/1.1" 200 None 2025-09-27 01:18:07,293 - lava_callback - INFO - Completed processing callback for node 68d739faa6a7b6615d4c49e2 INFO: 172.21.0.1:49308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:18:28,945 - lava_callback - INFO - Received callback for node 68d736eea6a7b6615d4c4803 INFO: 172.21.0.1:38482 - "POST /node/68d736eea6a7b6615d4c4803 HTTP/1.0" 202 Accepted 2025-09-27 01:18:28,950 - lava_callback - INFO - Starting async job submit for node 68d736eea6a7b6615d4c4803 2025-09-27 01:18:28,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:29,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eea6a7b6615d4c4803 HTTP/1.1" 200 None 2025-09-27 01:18:29,008 - lava_callback - DEBUG - Processing node 68d736eea6a7b6615d4c4803: baseline-arm64-broonie 2025-09-27 01:18:29,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:18:29,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:18:29,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eea6a7b6615d4c4803/log.txt.gz 2025-09-27 01:18:29,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:18:29,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:18:29,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eea6a7b6615d4c4803/lava_callback.json.gz 2025-09-27 01:18:29,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:29,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eea6a7b6615d4c4803 HTTP/1.1" 200 None 2025-09-27 01:18:29,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:29,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:18:29,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:29,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eea6a7b6615d4c4803 HTTP/1.1" 200 None 2025-09-27 01:18:29,644 - lava_callback - INFO - Completed processing callback for node 68d736eea6a7b6615d4c4803 INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:18:46,642 - lava_callback - INFO - Received callback for node 68d49785a5c2c05277bcef88 INFO: 172.21.0.1:53632 - "POST /node/68d49785a5c2c05277bcef88 HTTP/1.0" 202 Accepted 2025-09-27 01:18:46,648 - lava_callback - INFO - Starting async job submit for node 68d49785a5c2c05277bcef88 2025-09-27 01:18:46,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:18:46,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49785a5c2c05277bcef88 HTTP/1.1" 200 None 2025-09-27 01:18:46,695 - lava_callback - DEBUG - Processing node 68d49785a5c2c05277bcef88: baseline-arm 2025-09-27 01:18:46,957 - lava_callback - ERROR - Error processing callback for node 68d49785a5c2c05277bcef88: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:19:23,726 - lava_callback - INFO - Received callback for node 68d573b42be2da4660699656 INFO: 172.21.0.1:37550 - "POST /node/68d573b42be2da4660699656 HTTP/1.0" 202 Accepted 2025-09-27 01:19:23,736 - lava_callback - INFO - Starting async job submit for node 68d573b42be2da4660699656 2025-09-27 01:19:23,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:19:23,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573b42be2da4660699656 HTTP/1.1" 200 None 2025-09-27 01:19:23,788 - lava_callback - DEBUG - Processing node 68d573b42be2da4660699656: baseline-arm 2025-09-27 01:19:24,207 - lava_callback - ERROR - Error processing callback for node 68d573b42be2da4660699656: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:19:43,981 - lava_callback - INFO - Received callback for node 68d73b4fa6a7b6615d4c49ef INFO: 172.21.0.1:60378 - "POST /node/68d73b4fa6a7b6615d4c49ef HTTP/1.0" 202 Accepted 2025-09-27 01:19:43,991 - lava_callback - INFO - Starting async job submit for node 68d73b4fa6a7b6615d4c49ef 2025-09-27 01:19:44,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:19:44,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73b4fa6a7b6615d4c49ef HTTP/1.1" 200 None 2025-09-27 01:19:44,047 - lava_callback - DEBUG - Processing node 68d73b4fa6a7b6615d4c49ef: baseline-arm64-broonie 2025-09-27 01:19:44,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:19:44,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:19:44,676 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73b4fa6a7b6615d4c49ef/log.txt.gz 2025-09-27 01:19:44,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:19:44,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:19:44,880 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73b4fa6a7b6615d4c49ef/lava_callback.json.gz 2025-09-27 01:19:44,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:19:44,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73b4fa6a7b6615d4c49ef HTTP/1.1" 200 None 2025-09-27 01:19:44,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:19:44,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:19:44,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:19:45,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73b4fa6a7b6615d4c49ef HTTP/1.1" 200 None 2025-09-27 01:19:45,008 - lava_callback - INFO - Completed processing callback for node 68d73b4fa6a7b6615d4c49ef INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:20:30,753 - lava_callback - INFO - Received callback for node 68d7370ba6a7b6615d4c4898 INFO: 172.21.0.1:57690 - "POST /node/68d7370ba6a7b6615d4c4898 HTTP/1.0" 202 Accepted 2025-09-27 01:20:30,759 - lava_callback - INFO - Starting async job submit for node 68d7370ba6a7b6615d4c4898 2025-09-27 01:20:30,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:20:30,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ba6a7b6615d4c4898 HTTP/1.1" 200 None 2025-09-27 01:20:30,920 - lava_callback - DEBUG - Processing node 68d7370ba6a7b6615d4c4898: baseline-arm64-broonie 2025-09-27 01:20:31,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:20:31,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:20:31,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370ba6a7b6615d4c4898/log.txt.gz 2025-09-27 01:20:31,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:20:31,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:20:31,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370ba6a7b6615d4c4898/lava_callback.json.gz 2025-09-27 01:20:31,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:20:31,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ba6a7b6615d4c4898 HTTP/1.1" 200 None 2025-09-27 01:20:31,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:20:31,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:20:31,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:20:31,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370ba6a7b6615d4c4898 HTTP/1.1" 200 None 2025-09-27 01:20:31,559 - lava_callback - INFO - Completed processing callback for node 68d7370ba6a7b6615d4c4898 INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:21:46,305 - lava_callback - INFO - Received callback for node 68d573b52be2da4660699659 INFO: 172.21.0.1:58662 - "POST /node/68d573b52be2da4660699659 HTTP/1.0" 202 Accepted 2025-09-27 01:21:46,311 - lava_callback - INFO - Starting async job submit for node 68d573b52be2da4660699659 2025-09-27 01:21:46,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:21:46,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573b52be2da4660699659 HTTP/1.1" 200 None 2025-09-27 01:21:46,349 - lava_callback - DEBUG - Processing node 68d573b52be2da4660699659: baseline-arm INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:21:46,608 - lava_callback - ERROR - Error processing callback for node 68d573b52be2da4660699659: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:22:53,278 - lava_callback - INFO - Received callback for node 68d73811a6a7b6615d4c497b INFO: 172.21.0.1:34722 - "POST /node/68d73811a6a7b6615d4c497b HTTP/1.0" 202 Accepted 2025-09-27 01:22:53,285 - lava_callback - INFO - Starting async job submit for node 68d73811a6a7b6615d4c497b 2025-09-27 01:22:53,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:22:53,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73811a6a7b6615d4c497b HTTP/1.1" 200 None 2025-09-27 01:22:53,330 - lava_callback - DEBUG - Processing node 68d73811a6a7b6615d4c497b: baseline-arm 2025-09-27 01:22:53,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:22:53,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:22:53,848 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d73811a6a7b6615d4c497b/log.txt.gz 2025-09-27 01:22:53,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:22:54,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:22:54,030 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d73811a6a7b6615d4c497b/lava_callback.json.gz DEBUG: Setup failed for 68d73811a6a7b6615d4c497b. Transitting job node result: incomplete -> fail 2025-09-27 01:22:54,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:22:54,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73811a6a7b6615d4c497b HTTP/1.1" 200 None 2025-09-27 01:22:54,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:22:54,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 01:22:54,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:22:54,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73811a6a7b6615d4c497b HTTP/1.1" 200 None 2025-09-27 01:22:54,189 - lava_callback - INFO - Completed processing callback for node 68d73811a6a7b6615d4c497b 2025-09-27 01:22:56,123 - lava_callback - INFO - Received callback for node 68d7380da6a7b6615d4c4971 INFO: 172.21.0.1:34732 - "POST /node/68d7380da6a7b6615d4c4971 HTTP/1.0" 202 Accepted 2025-09-27 01:22:56,133 - lava_callback - INFO - Starting async job submit for node 68d7380da6a7b6615d4c4971 2025-09-27 01:22:56,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:22:56,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7380da6a7b6615d4c4971 HTTP/1.1" 200 None 2025-09-27 01:22:56,210 - lava_callback - DEBUG - Processing node 68d7380da6a7b6615d4c4971: baseline-arm INFO: 172.21.0.1:34738 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:22:56,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:22:56,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:22:56,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7380da6a7b6615d4c4971/log.txt.gz 2025-09-27 01:22:56,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:22:56,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:22:56,897 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7380da6a7b6615d4c4971/lava_callback.json.gz DEBUG: Setup failed for 68d7380da6a7b6615d4c4971. Transitting job node result: incomplete -> fail 2025-09-27 01:22:56,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:22:56,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7380da6a7b6615d4c4971 HTTP/1.1" 200 None 2025-09-27 01:22:56,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:22:56,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 01:22:56,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:22:57,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7380da6a7b6615d4c4971 HTTP/1.1" 200 None 2025-09-27 01:22:57,019 - lava_callback - INFO - Completed processing callback for node 68d7380da6a7b6615d4c4971 INFO: 172.21.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:23:08,756 - lava_callback - INFO - Received callback for node 68d73383a6a7b6615d4c4608 INFO: 172.21.0.1:53732 - "POST /node/68d73383a6a7b6615d4c4608 HTTP/1.0" 202 Accepted 2025-09-27 01:23:08,806 - lava_callback - INFO - Starting async job submit for node 68d73383a6a7b6615d4c4608 2025-09-27 01:23:08,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:08,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73383a6a7b6615d4c4608 HTTP/1.1" 200 None 2025-09-27 01:23:08,889 - lava_callback - DEBUG - Processing node 68d73383a6a7b6615d4c4608: baseline-x86 2025-09-27 01:23:09,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:23:09,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:23:09,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d73383a6a7b6615d4c4608/log.txt.gz 2025-09-27 01:23:09,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:23:09,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:23:09,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d73383a6a7b6615d4c4608/lava_callback.json.gz 2025-09-27 01:23:09,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:09,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73383a6a7b6615d4c4608 HTTP/1.1" 200 None 2025-09-27 01:23:09,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:09,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 01:23:09,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:09,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73383a6a7b6615d4c4608 HTTP/1.1" 200 None 2025-09-27 01:23:09,408 - lava_callback - INFO - Completed processing callback for node 68d73383a6a7b6615d4c4608 INFO: 172.21.0.1:43328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:23:28,793 - lava_callback - INFO - Received callback for node 68d49987a5c2c05277bcef97 INFO: 172.21.0.1:34212 - "POST /node/68d49987a5c2c05277bcef97 HTTP/1.0" 202 Accepted 2025-09-27 01:23:28,799 - lava_callback - INFO - Starting async job submit for node 68d49987a5c2c05277bcef97 2025-09-27 01:23:28,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:28,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49987a5c2c05277bcef97 HTTP/1.1" 200 None 2025-09-27 01:23:28,812 - lava_callback - DEBUG - Processing node 68d49987a5c2c05277bcef97: baseline-arm 2025-09-27 01:23:28,812 - lava_callback - ERROR - Error processing callback for node 68d49987a5c2c05277bcef97: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 01:23:29,429 - lava_callback - INFO - Received callback for node 68d49988a5c2c05277bcef9a INFO: 172.21.0.1:46458 - "POST /node/68d49988a5c2c05277bcef9a HTTP/1.0" 202 Accepted 2025-09-27 01:23:29,435 - lava_callback - INFO - Starting async job submit for node 68d49988a5c2c05277bcef9a 2025-09-27 01:23:29,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:29,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49988a5c2c05277bcef9a HTTP/1.1" 200 None 2025-09-27 01:23:29,475 - lava_callback - DEBUG - Processing node 68d49988a5c2c05277bcef9a: baseline-arm 2025-09-27 01:23:29,476 - lava_callback - ERROR - Error processing callback for node 68d49988a5c2c05277bcef9a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 01:23:30,090 - lava_callback - INFO - Received callback for node 68d49989a5c2c05277bcef9d INFO: 172.21.0.1:46462 - "POST /node/68d49989a5c2c05277bcef9d HTTP/1.0" 202 Accepted 2025-09-27 01:23:30,096 - lava_callback - INFO - Starting async job submit for node 68d49989a5c2c05277bcef9d 2025-09-27 01:23:30,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:30,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49989a5c2c05277bcef9d HTTP/1.1" 200 None 2025-09-27 01:23:30,113 - lava_callback - DEBUG - Processing node 68d49989a5c2c05277bcef9d: baseline-arm 2025-09-27 01:23:30,113 - lava_callback - ERROR - Error processing callback for node 68d49989a5c2c05277bcef9d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 01:23:30,735 - lava_callback - INFO - Received callback for node 68d4998da5c2c05277bcefa0 INFO: 172.21.0.1:46476 - "POST /node/68d4998da5c2c05277bcefa0 HTTP/1.0" 202 Accepted 2025-09-27 01:23:30,740 - lava_callback - INFO - Starting async job submit for node 68d4998da5c2c05277bcefa0 2025-09-27 01:23:30,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:30,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4998da5c2c05277bcefa0 HTTP/1.1" 200 None 2025-09-27 01:23:30,753 - lava_callback - DEBUG - Processing node 68d4998da5c2c05277bcefa0: baseline-arm 2025-09-27 01:23:30,753 - lava_callback - ERROR - Error processing callback for node 68d4998da5c2c05277bcefa0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:23:44,999 - lava_callback - INFO - Received callback for node 68d573bc2be2da466069966e INFO: 172.21.0.1:45458 - "POST /node/68d573bc2be2da466069966e HTTP/1.0" 202 Accepted 2025-09-27 01:23:45,005 - lava_callback - INFO - Starting async job submit for node 68d573bc2be2da466069966e 2025-09-27 01:23:45,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:45,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573bc2be2da466069966e HTTP/1.1" 200 None 2025-09-27 01:23:45,045 - lava_callback - DEBUG - Processing node 68d573bc2be2da466069966e: baseline-arm 2025-09-27 01:23:45,364 - lava_callback - ERROR - Error processing callback for node 68d573bc2be2da466069966e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:23:48,967 - lava_callback - INFO - Received callback for node 68d4998ea5c2c05277bcefa3 INFO: 172.21.0.1:45488 - "POST /node/68d4998ea5c2c05277bcefa3 HTTP/1.0" 202 Accepted 2025-09-27 01:23:48,976 - lava_callback - INFO - Starting async job submit for node 68d4998ea5c2c05277bcefa3 2025-09-27 01:23:48,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:48,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4998ea5c2c05277bcefa3 HTTP/1.1" 200 None 2025-09-27 01:23:48,991 - lava_callback - DEBUG - Processing node 68d4998ea5c2c05277bcefa3: baseline-arm 2025-09-27 01:23:48,991 - lava_callback - ERROR - Error processing callback for node 68d4998ea5c2c05277bcefa3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 01:23:49,587 - lava_callback - INFO - Received callback for node 68d49992a5c2c05277bcefa6 INFO: 172.21.0.1:34870 - "POST /node/68d49992a5c2c05277bcefa6 HTTP/1.0" 202 Accepted 2025-09-27 01:23:49,592 - lava_callback - INFO - Starting async job submit for node 68d49992a5c2c05277bcefa6 2025-09-27 01:23:49,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:49,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49992a5c2c05277bcefa6 HTTP/1.1" 200 None 2025-09-27 01:23:49,619 - lava_callback - DEBUG - Processing node 68d49992a5c2c05277bcefa6: baseline-arm 2025-09-27 01:23:49,619 - lava_callback - ERROR - Error processing callback for node 68d49992a5c2c05277bcefa6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 01:23:50,226 - lava_callback - INFO - Received callback for node 68d49993a5c2c05277bcefa9 INFO: 172.21.0.1:34872 - "POST /node/68d49993a5c2c05277bcefa9 HTTP/1.0" 202 Accepted 2025-09-27 01:23:50,232 - lava_callback - INFO - Starting async job submit for node 68d49993a5c2c05277bcefa9 2025-09-27 01:23:50,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:50,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49993a5c2c05277bcefa9 HTTP/1.1" 200 None 2025-09-27 01:23:50,249 - lava_callback - DEBUG - Processing node 68d49993a5c2c05277bcefa9: baseline-arm 2025-09-27 01:23:50,249 - lava_callback - ERROR - Error processing callback for node 68d49993a5c2c05277bcefa9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:23:59,830 - lava_callback - INFO - Received callback for node 68d736ffa6a7b6615d4c4855 INFO: 172.21.0.1:53684 - "POST /node/68d736ffa6a7b6615d4c4855 HTTP/1.0" 202 Accepted 2025-09-27 01:23:59,839 - lava_callback - INFO - Starting async job submit for node 68d736ffa6a7b6615d4c4855 2025-09-27 01:23:59,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:23:59,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736ffa6a7b6615d4c4855 HTTP/1.1" 200 None 2025-09-27 01:23:59,928 - lava_callback - DEBUG - Processing node 68d736ffa6a7b6615d4c4855: baseline-arm64 2025-09-27 01:24:00,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:24:00,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:24:00,589 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736ffa6a7b6615d4c4855/log.txt.gz 2025-09-27 01:24:00,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:24:00,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:24:00,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736ffa6a7b6615d4c4855/lava_callback.json.gz DEBUG: Setup failed for 68d736ffa6a7b6615d4c4855. Transitting job node result: incomplete -> fail 2025-09-27 01:24:00,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:24:00,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736ffa6a7b6615d4c4855 HTTP/1.1" 200 None 2025-09-27 01:24:00,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:24:00,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:24:00,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:24:00,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736ffa6a7b6615d4c4855 HTTP/1.1" 200 None 2025-09-27 01:24:00,889 - lava_callback - INFO - Completed processing callback for node 68d736ffa6a7b6615d4c4855 INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:25:28,456 - lava_callback - INFO - Received callback for node 68d73cb1a6a7b6615d4c4a20 INFO: 172.21.0.1:40800 - "POST /node/68d73cb1a6a7b6615d4c4a20 HTTP/1.0" 202 Accepted 2025-09-27 01:25:28,462 - lava_callback - INFO - Starting async job submit for node 68d73cb1a6a7b6615d4c4a20 2025-09-27 01:25:28,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:28,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73cb1a6a7b6615d4c4a20 HTTP/1.1" 200 None 2025-09-27 01:25:28,496 - lava_callback - DEBUG - Processing node 68d73cb1a6a7b6615d4c4a20: baseline-arm64 2025-09-27 01:25:28,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:25:29,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:25:29,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73cb1a6a7b6615d4c4a20/log.txt.gz 2025-09-27 01:25:29,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:25:29,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:25:29,212 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73cb1a6a7b6615d4c4a20/lava_callback.json.gz 2025-09-27 01:25:29,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:29,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73cb1a6a7b6615d4c4a20 HTTP/1.1" 200 None 2025-09-27 01:25:29,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:29,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:25:29,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:29,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73cb1a6a7b6615d4c4a20 HTTP/1.1" 200 None 2025-09-27 01:25:29,288 - lava_callback - INFO - Completed processing callback for node 68d73cb1a6a7b6615d4c4a20 2025-09-27 01:25:29,712 - lava_callback - INFO - Received callback for node 68d73cb1a6a7b6615d4c4a23 INFO: 172.21.0.1:36984 - "POST /node/68d73cb1a6a7b6615d4c4a23 HTTP/1.0" 202 Accepted 2025-09-27 01:25:29,718 - lava_callback - INFO - Starting async job submit for node 68d73cb1a6a7b6615d4c4a23 2025-09-27 01:25:29,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:29,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73cb1a6a7b6615d4c4a23 HTTP/1.1" 200 None 2025-09-27 01:25:29,759 - lava_callback - DEBUG - Processing node 68d73cb1a6a7b6615d4c4a23: baseline-arm64 2025-09-27 01:25:30,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:25:30,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:25:30,287 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73cb1a6a7b6615d4c4a23/log.txt.gz 2025-09-27 01:25:30,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:25:30,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:25:30,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73cb1a6a7b6615d4c4a23/lava_callback.json.gz 2025-09-27 01:25:30,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:30,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73cb1a6a7b6615d4c4a23 HTTP/1.1" 200 None 2025-09-27 01:25:30,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:30,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:25:30,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:30,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73cb1a6a7b6615d4c4a23 HTTP/1.1" 200 None 2025-09-27 01:25:30,510 - lava_callback - INFO - Completed processing callback for node 68d73cb1a6a7b6615d4c4a23 INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:25:43,895 - lava_callback - INFO - Received callback for node 68d573bd2be2da4660699671 INFO: 172.21.0.1:54650 - "POST /node/68d573bd2be2da4660699671 HTTP/1.0" 202 Accepted 2025-09-27 01:25:43,900 - lava_callback - INFO - Starting async job submit for node 68d573bd2be2da4660699671 2025-09-27 01:25:43,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:25:43,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573bd2be2da4660699671 HTTP/1.1" 200 None 2025-09-27 01:25:43,934 - lava_callback - DEBUG - Processing node 68d573bd2be2da4660699671: baseline-arm 2025-09-27 01:25:44,159 - lava_callback - ERROR - Error processing callback for node 68d573bd2be2da4660699671: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:26:32,504 - lava_callback - INFO - Received callback for node 68d73383a6a7b6615d4c460b INFO: 172.21.0.1:52698 - "POST /node/68d73383a6a7b6615d4c460b HTTP/1.0" 202 Accepted 2025-09-27 01:26:32,511 - lava_callback - INFO - Starting async job submit for node 68d73383a6a7b6615d4c460b 2025-09-27 01:26:32,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:26:32,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73383a6a7b6615d4c460b HTTP/1.1" 200 None 2025-09-27 01:26:32,569 - lava_callback - DEBUG - Processing node 68d73383a6a7b6615d4c460b: baseline-x86 2025-09-27 01:26:33,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:26:33,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:26:33,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d73383a6a7b6615d4c460b/log.txt.gz 2025-09-27 01:26:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:26:33,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:26:33,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d73383a6a7b6615d4c460b/lava_callback.json.gz DEBUG: Setup failed for 68d73383a6a7b6615d4c460b. Transitting job node result: incomplete -> fail 2025-09-27 01:26:33,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:26:33,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73383a6a7b6615d4c460b HTTP/1.1" 200 None 2025-09-27 01:26:33,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:26:33,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 01:26:33,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:26:33,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73383a6a7b6615d4c460b HTTP/1.1" 200 None 2025-09-27 01:26:33,772 - lava_callback - INFO - Completed processing callback for node 68d73383a6a7b6615d4c460b INFO: 172.21.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:27:43,749 - lava_callback - INFO - Received callback for node 68d5895e2be2da4660699a88 INFO: 172.21.0.1:52808 - "POST /node/68d5895e2be2da4660699a88 HTTP/1.0" 202 Accepted 2025-09-27 01:27:43,755 - lava_callback - INFO - Starting async job submit for node 68d5895e2be2da4660699a88 2025-09-27 01:27:43,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:27:43,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5895e2be2da4660699a88 HTTP/1.1" 200 None 2025-09-27 01:27:43,788 - lava_callback - DEBUG - Processing node 68d5895e2be2da4660699a88: baseline-arm 2025-09-27 01:27:44,008 - lava_callback - ERROR - Error processing callback for node 68d5895e2be2da4660699a88: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:29:34,664 - lava_callback - INFO - Received callback for node 68d73709a6a7b6615d4c488f INFO: 172.21.0.1:37982 - "POST /node/68d73709a6a7b6615d4c488f HTTP/1.0" 202 Accepted 2025-09-27 01:29:34,670 - lava_callback - INFO - Starting async job submit for node 68d73709a6a7b6615d4c488f 2025-09-27 01:29:34,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:34,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73709a6a7b6615d4c488f HTTP/1.1" 200 None 2025-09-27 01:29:34,719 - lava_callback - DEBUG - Processing node 68d73709a6a7b6615d4c488f: baseline-arm64-broonie 2025-09-27 01:29:35,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:29:35,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:29:35,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73709a6a7b6615d4c488f/log.txt.gz 2025-09-27 01:29:35,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:29:35,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:29:35,526 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73709a6a7b6615d4c488f/lava_callback.json.gz 2025-09-27 01:29:35,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:35,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73709a6a7b6615d4c488f HTTP/1.1" 200 None 2025-09-27 01:29:35,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:35,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:29:35,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:35,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73709a6a7b6615d4c488f HTTP/1.1" 200 None 2025-09-27 01:29:35,619 - lava_callback - INFO - Completed processing callback for node 68d73709a6a7b6615d4c488f INFO: 172.21.0.1:37996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:29:43,543 - lava_callback - INFO - Received callback for node 68d5895f2be2da4660699a92 INFO: 172.21.0.1:33580 - "POST /node/68d5895f2be2da4660699a92 HTTP/1.0" 202 Accepted 2025-09-27 01:29:43,549 - lava_callback - INFO - Starting async job submit for node 68d5895f2be2da4660699a92 2025-09-27 01:29:43,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:43,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5895f2be2da4660699a92 HTTP/1.1" 200 None 2025-09-27 01:29:43,583 - lava_callback - DEBUG - Processing node 68d5895f2be2da4660699a92: baseline-arm 2025-09-27 01:29:43,817 - lava_callback - ERROR - Error processing callback for node 68d5895f2be2da4660699a92: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:29:53,431 - lava_callback - INFO - Received callback for node 68d7367ea6a7b6615d4c4782 INFO: 172.21.0.1:53302 - "POST /node/68d7367ea6a7b6615d4c4782 HTTP/1.0" 202 Accepted 2025-09-27 01:29:53,438 - lava_callback - INFO - Starting async job submit for node 68d7367ea6a7b6615d4c4782 2025-09-27 01:29:53,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:53,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7367ea6a7b6615d4c4782 HTTP/1.1" 200 None 2025-09-27 01:29:53,520 - lava_callback - DEBUG - Processing node 68d7367ea6a7b6615d4c4782: ltp-smoketest 2025-09-27 01:29:54,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:29:54,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:29:54,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d7367ea6a7b6615d4c4782/log.txt.gz 2025-09-27 01:29:54,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:29:54,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:29:54,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d7367ea6a7b6615d4c4782/lava_callback.json.gz 2025-09-27 01:29:54,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:54,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7367ea6a7b6615d4c4782 HTTP/1.1" 200 None 2025-09-27 01:29:54,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:54,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e46a6a7b6615d4c4169 HTTP/1.1" 200 None 2025-09-27 01:29:54,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:29:54,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7367ea6a7b6615d4c4782 HTTP/1.1" 200 None 2025-09-27 01:29:54,457 - lava_callback - INFO - Completed processing callback for node 68d7367ea6a7b6615d4c4782 INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:30:49,405 - lava_callback - INFO - Received callback for node 68d736eca6a7b6615d4c47f5 INFO: 172.21.0.1:46538 - "POST /node/68d736eca6a7b6615d4c47f5 HTTP/1.0" 202 Accepted 2025-09-27 01:30:49,411 - lava_callback - INFO - Starting async job submit for node 68d736eca6a7b6615d4c47f5 2025-09-27 01:30:49,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:30:49,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eca6a7b6615d4c47f5 HTTP/1.1" 200 None 2025-09-27 01:30:49,464 - lava_callback - DEBUG - Processing node 68d736eca6a7b6615d4c47f5: baseline-arm64-broonie 2025-09-27 01:30:49,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:30:49,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:30:49,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eca6a7b6615d4c47f5/log.txt.gz 2025-09-27 01:30:49,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:30:49,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:30:49,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eca6a7b6615d4c47f5/lava_callback.json.gz 2025-09-27 01:30:49,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:30:49,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eca6a7b6615d4c47f5 HTTP/1.1" 200 None 2025-09-27 01:30:49,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:30:50,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:30:50,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:30:50,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eca6a7b6615d4c47f5 HTTP/1.1" 200 None 2025-09-27 01:30:50,029 - lava_callback - INFO - Completed processing callback for node 68d736eca6a7b6615d4c47f5 INFO: 172.21.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:31:29,363 - lava_callback - INFO - Received callback for node 68d736f0a6a7b6615d4c480d INFO: 172.21.0.1:46106 - "POST /node/68d736f0a6a7b6615d4c480d HTTP/1.0" 202 Accepted 2025-09-27 01:31:29,372 - lava_callback - INFO - Starting async job submit for node 68d736f0a6a7b6615d4c480d 2025-09-27 01:31:29,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:29,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f0a6a7b6615d4c480d HTTP/1.1" 200 None 2025-09-27 01:31:29,416 - lava_callback - DEBUG - Processing node 68d736f0a6a7b6615d4c480d: baseline-arm64-broonie 2025-09-27 01:31:29,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:31:29,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:31:29,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736f0a6a7b6615d4c480d/log.txt.gz 2025-09-27 01:31:29,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:31:29,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:31:29,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736f0a6a7b6615d4c480d/lava_callback.json.gz 2025-09-27 01:31:29,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:29,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736f0a6a7b6615d4c480d HTTP/1.1" 200 None 2025-09-27 01:31:29,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:30,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:31:30,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:30,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736f0a6a7b6615d4c480d HTTP/1.1" 200 None 2025-09-27 01:31:30,041 - lava_callback - INFO - Completed processing callback for node 68d736f0a6a7b6615d4c480d INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:31:42,796 - lava_callback - INFO - Received callback for node 68d589602be2da4660699a95 INFO: 172.21.0.1:34128 - "POST /node/68d589602be2da4660699a95 HTTP/1.0" 202 Accepted 2025-09-27 01:31:42,802 - lava_callback - INFO - Starting async job submit for node 68d589602be2da4660699a95 2025-09-27 01:31:42,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:42,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589602be2da4660699a95 HTTP/1.1" 200 None 2025-09-27 01:31:42,858 - lava_callback - DEBUG - Processing node 68d589602be2da4660699a95: baseline-arm 2025-09-27 01:31:43,155 - lava_callback - ERROR - Error processing callback for node 68d589602be2da4660699a95: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:31:54,845 - lava_callback - INFO - Received callback for node 68d739b8a6a7b6615d4c49d3 INFO: 172.21.0.1:60936 - "POST /node/68d739b8a6a7b6615d4c49d3 HTTP/1.0" 202 Accepted 2025-09-27 01:31:54,850 - lava_callback - INFO - Starting async job submit for node 68d739b8a6a7b6615d4c49d3 2025-09-27 01:31:54,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:54,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d739b8a6a7b6615d4c49d3 HTTP/1.1" 200 None 2025-09-27 01:31:54,894 - lava_callback - DEBUG - Processing node 68d739b8a6a7b6615d4c49d3: baseline-x86-kcidebug-intel 2025-09-27 01:31:55,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:31:55,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:31:55,306 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d739b8a6a7b6615d4c49d3/log.txt.gz 2025-09-27 01:31:55,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:31:55,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:31:55,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d739b8a6a7b6615d4c49d3/lava_callback.json.gz DEBUG: Setup failed for 68d739b8a6a7b6615d4c49d3. Transitting job node result: incomplete -> fail 2025-09-27 01:31:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:55,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d739b8a6a7b6615d4c49d3 HTTP/1.1" 200 None 2025-09-27 01:31:55,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:55,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a4d3c94e462c68828c2 HTTP/1.1" 200 None 2025-09-27 01:31:55,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:31:55,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d739b8a6a7b6615d4c49d3 HTTP/1.1" 200 None 2025-09-27 01:31:55,563 - lava_callback - INFO - Completed processing callback for node 68d739b8a6a7b6615d4c49d3 INFO: 172.21.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:32:49,663 - lava_callback - INFO - Received callback for node 68d73708a6a7b6615d4c488c INFO: 172.21.0.1:38686 - "POST /node/68d73708a6a7b6615d4c488c HTTP/1.0" 202 Accepted 2025-09-27 01:32:49,669 - lava_callback - INFO - Starting async job submit for node 68d73708a6a7b6615d4c488c 2025-09-27 01:32:49,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:32:49,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73708a6a7b6615d4c488c HTTP/1.1" 200 None 2025-09-27 01:32:49,720 - lava_callback - DEBUG - Processing node 68d73708a6a7b6615d4c488c: baseline-arm64-broonie 2025-09-27 01:32:50,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:32:50,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:32:50,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73708a6a7b6615d4c488c/log.txt.gz 2025-09-27 01:32:50,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:32:50,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:32:50,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73708a6a7b6615d4c488c/lava_callback.json.gz 2025-09-27 01:32:50,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:32:50,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73708a6a7b6615d4c488c HTTP/1.1" 200 None 2025-09-27 01:32:50,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:32:50,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:32:50,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:32:50,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73708a6a7b6615d4c488c HTTP/1.1" 200 None 2025-09-27 01:32:50,427 - lava_callback - INFO - Completed processing callback for node 68d73708a6a7b6615d4c488c INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:33:44,411 - lava_callback - INFO - Received callback for node 68d589612be2da4660699a98 INFO: 172.21.0.1:36770 - "POST /node/68d589612be2da4660699a98 HTTP/1.0" 202 Accepted 2025-09-27 01:33:44,417 - lava_callback - INFO - Starting async job submit for node 68d589612be2da4660699a98 2025-09-27 01:33:44,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:33:44,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589612be2da4660699a98 HTTP/1.1" 200 None 2025-09-27 01:33:44,450 - lava_callback - DEBUG - Processing node 68d589612be2da4660699a98: baseline-arm 2025-09-27 01:33:44,675 - lava_callback - ERROR - Error processing callback for node 68d589612be2da4660699a98: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:33:51,739 - lava_callback - INFO - Received callback for node 68d7370ca6a7b6615d4c48a1 INFO: 172.21.0.1:54942 - "POST /node/68d7370ca6a7b6615d4c48a1 HTTP/1.0" 202 Accepted 2025-09-27 01:33:51,745 - lava_callback - INFO - Starting async job submit for node 68d7370ca6a7b6615d4c48a1 2025-09-27 01:33:51,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:33:51,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ca6a7b6615d4c48a1 HTTP/1.1" 200 None 2025-09-27 01:33:51,795 - lava_callback - DEBUG - Processing node 68d7370ca6a7b6615d4c48a1: baseline-arm64-broonie 2025-09-27 01:33:52,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:33:52,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:33:52,164 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370ca6a7b6615d4c48a1/log.txt.gz 2025-09-27 01:33:52,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:33:52,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:33:52,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370ca6a7b6615d4c48a1/lava_callback.json.gz 2025-09-27 01:33:52,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:33:52,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ca6a7b6615d4c48a1 HTTP/1.1" 200 None 2025-09-27 01:33:52,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:33:52,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:33:52,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:33:52,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370ca6a7b6615d4c48a1 HTTP/1.1" 200 None 2025-09-27 01:33:52,391 - lava_callback - INFO - Completed processing callback for node 68d7370ca6a7b6615d4c48a1 INFO: 172.21.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:34:58,317 - lava_callback - INFO - Received callback for node 68d739e3a6a7b6615d4c49da INFO: 172.21.0.1:37214 - "POST /node/68d739e3a6a7b6615d4c49da HTTP/1.0" 202 Accepted 2025-09-27 01:34:58,325 - lava_callback - INFO - Starting async job submit for node 68d739e3a6a7b6615d4c49da 2025-09-27 01:34:58,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:34:58,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d739e3a6a7b6615d4c49da HTTP/1.1" 200 None 2025-09-27 01:34:58,359 - lava_callback - DEBUG - Processing node 68d739e3a6a7b6615d4c49da: blktests-ddp-x86 2025-09-27 01:34:59,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:34:59,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:34:59,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d739e3a6a7b6615d4c49da/log.txt.gz 2025-09-27 01:34:59,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:34:59,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:34:59,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d739e3a6a7b6615d4c49da/lava_callback.json.gz 2025-09-27 01:34:59,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:34:59,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d739e3a6a7b6615d4c49da HTTP/1.1" 200 None 2025-09-27 01:34:59,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:34:59,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 01:34:59,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:34:59,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d739e3a6a7b6615d4c49da HTTP/1.1" 200 None 2025-09-27 01:34:59,636 - lava_callback - INFO - Completed processing callback for node 68d739e3a6a7b6615d4c49da INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:35:44,598 - lava_callback - INFO - Received callback for node 68d589622be2da4660699a9b INFO: 172.21.0.1:43152 - "POST /node/68d589622be2da4660699a9b HTTP/1.0" 202 Accepted 2025-09-27 01:35:44,604 - lava_callback - INFO - Starting async job submit for node 68d589622be2da4660699a9b 2025-09-27 01:35:44,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:35:44,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589622be2da4660699a9b HTTP/1.1" 200 None 2025-09-27 01:35:44,650 - lava_callback - DEBUG - Processing node 68d589622be2da4660699a9b: baseline-arm 2025-09-27 01:35:44,906 - lava_callback - ERROR - Error processing callback for node 68d589622be2da4660699a9b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:37:46,939 - lava_callback - INFO - Received callback for node 68d589632be2da4660699a9e INFO: 172.21.0.1:37446 - "POST /node/68d589632be2da4660699a9e HTTP/1.0" 202 Accepted 2025-09-27 01:37:46,945 - lava_callback - INFO - Starting async job submit for node 68d589632be2da4660699a9e 2025-09-27 01:37:46,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:37:47,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589632be2da4660699a9e HTTP/1.1" 200 None 2025-09-27 01:37:47,010 - lava_callback - DEBUG - Processing node 68d589632be2da4660699a9e: baseline-arm 2025-09-27 01:37:47,236 - lava_callback - ERROR - Error processing callback for node 68d589632be2da4660699a9e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:38:06,151 - lava_callback - INFO - Received callback for node 68d49985a5c2c05277bcef94 INFO: 172.21.0.1:45492 - "POST /node/68d49985a5c2c05277bcef94 HTTP/1.0" 202 Accepted 2025-09-27 01:38:06,157 - lava_callback - INFO - Starting async job submit for node 68d49985a5c2c05277bcef94 2025-09-27 01:38:06,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:38:06,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49985a5c2c05277bcef94 HTTP/1.1" 200 None 2025-09-27 01:38:06,201 - lava_callback - DEBUG - Processing node 68d49985a5c2c05277bcef94: baseline-arm 2025-09-27 01:38:06,466 - lava_callback - ERROR - Error processing callback for node 68d49985a5c2c05277bcef94: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:38:29,956 - lava_callback - INFO - Received callback for node 68d49d0ea5c2c05277bcf181 INFO: 172.21.0.1:44588 - "POST /node/68d49d0ea5c2c05277bcf181 HTTP/1.0" 202 Accepted 2025-09-27 01:38:29,962 - lava_callback - INFO - Starting async job submit for node 68d49d0ea5c2c05277bcf181 2025-09-27 01:38:29,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:38:29,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49d0ea5c2c05277bcf181 HTTP/1.1" 200 None 2025-09-27 01:38:29,997 - lava_callback - DEBUG - Processing node 68d49d0ea5c2c05277bcf181: baseline-arm 2025-09-27 01:38:29,997 - lava_callback - ERROR - Error processing callback for node 68d49d0ea5c2c05277bcf181: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 01:38:30,638 - lava_callback - INFO - Received callback for node 68d49d11a5c2c05277bcf184 INFO: 172.21.0.1:44602 - "POST /node/68d49d11a5c2c05277bcf184 HTTP/1.0" 202 Accepted 2025-09-27 01:38:30,644 - lava_callback - INFO - Starting async job submit for node 68d49d11a5c2c05277bcf184 2025-09-27 01:38:30,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:38:30,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49d11a5c2c05277bcf184 HTTP/1.1" 200 None 2025-09-27 01:38:30,684 - lava_callback - DEBUG - Processing node 68d49d11a5c2c05277bcf184: baseline-arm 2025-09-27 01:38:30,684 - lava_callback - ERROR - Error processing callback for node 68d49d11a5c2c05277bcf184: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 01:38:31,311 - lava_callback - INFO - Received callback for node 68d49d13a5c2c05277bcf187 INFO: 172.21.0.1:44608 - "POST /node/68d49d13a5c2c05277bcf187 HTTP/1.0" 202 Accepted 2025-09-27 01:38:31,316 - lava_callback - INFO - Starting async job submit for node 68d49d13a5c2c05277bcf187 2025-09-27 01:38:31,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:38:31,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49d13a5c2c05277bcf187 HTTP/1.1" 200 None 2025-09-27 01:38:31,329 - lava_callback - DEBUG - Processing node 68d49d13a5c2c05277bcf187: baseline-arm 2025-09-27 01:38:31,330 - lava_callback - ERROR - Error processing callback for node 68d49d13a5c2c05277bcf187: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:39:45,549 - lava_callback - INFO - Received callback for node 68d589642be2da4660699aa1 INFO: 172.21.0.1:56932 - "POST /node/68d589642be2da4660699aa1 HTTP/1.0" 202 Accepted 2025-09-27 01:39:45,555 - lava_callback - INFO - Starting async job submit for node 68d589642be2da4660699aa1 2025-09-27 01:39:45,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:39:45,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589642be2da4660699aa1 HTTP/1.1" 200 None 2025-09-27 01:39:45,592 - lava_callback - DEBUG - Processing node 68d589642be2da4660699aa1: baseline-arm 2025-09-27 01:39:45,813 - lava_callback - ERROR - Error processing callback for node 68d589642be2da4660699aa1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52356 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:41:34,400 - lava_callback - INFO - Received callback for node 68d73c6ea6a7b6615d4c4a05 INFO: 172.21.0.1:41452 - "POST /node/68d73c6ea6a7b6615d4c4a05 HTTP/1.0" 202 Accepted 2025-09-27 01:41:34,407 - lava_callback - INFO - Starting async job submit for node 68d73c6ea6a7b6615d4c4a05 2025-09-27 01:41:34,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:34,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73c6ea6a7b6615d4c4a05 HTTP/1.1" 200 None 2025-09-27 01:41:34,457 - lava_callback - DEBUG - Processing node 68d73c6ea6a7b6615d4c4a05: baseline-arm 2025-09-27 01:41:34,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:41:34,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:41:34,946 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d73c6ea6a7b6615d4c4a05/log.txt.gz 2025-09-27 01:41:34,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:41:35,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:41:35,102 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d73c6ea6a7b6615d4c4a05/lava_callback.json.gz DEBUG: Setup failed for 68d73c6ea6a7b6615d4c4a05. Transitting job node result: incomplete -> fail 2025-09-27 01:41:35,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:35,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73c6ea6a7b6615d4c4a05 HTTP/1.1" 200 None 2025-09-27 01:41:35,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:35,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 01:41:35,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:35,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73c6ea6a7b6615d4c4a05 HTTP/1.1" 200 None 2025-09-27 01:41:35,221 - lava_callback - INFO - Completed processing callback for node 68d73c6ea6a7b6615d4c4a05 INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:41:37,046 - lava_callback - INFO - Received callback for node 68d73c71a6a7b6615d4c4a0b INFO: 172.21.0.1:41456 - "POST /node/68d73c71a6a7b6615d4c4a0b HTTP/1.0" 202 Accepted 2025-09-27 01:41:37,054 - lava_callback - INFO - Starting async job submit for node 68d73c71a6a7b6615d4c4a0b 2025-09-27 01:41:37,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:37,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73c71a6a7b6615d4c4a0b HTTP/1.1" 200 None 2025-09-27 01:41:37,106 - lava_callback - DEBUG - Processing node 68d73c71a6a7b6615d4c4a0b: baseline-arm 2025-09-27 01:41:37,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:41:37,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:41:37,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d73c71a6a7b6615d4c4a0b/log.txt.gz 2025-09-27 01:41:37,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:41:37,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:41:37,759 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d73c71a6a7b6615d4c4a0b/lava_callback.json.gz DEBUG: Setup failed for 68d73c71a6a7b6615d4c4a0b. Transitting job node result: incomplete -> fail 2025-09-27 01:41:37,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:37,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73c71a6a7b6615d4c4a0b HTTP/1.1" 200 None 2025-09-27 01:41:37,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:37,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 01:41:37,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:37,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73c71a6a7b6615d4c4a0b HTTP/1.1" 200 None 2025-09-27 01:41:37,878 - lava_callback - INFO - Completed processing callback for node 68d73c71a6a7b6615d4c4a0b INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:41:44,225 - lava_callback - INFO - Received callback for node 68d589652be2da4660699aa4 INFO: 172.21.0.1:49818 - "POST /node/68d589652be2da4660699aa4 HTTP/1.0" 202 Accepted 2025-09-27 01:41:44,231 - lava_callback - INFO - Starting async job submit for node 68d589652be2da4660699aa4 2025-09-27 01:41:44,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:41:44,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589652be2da4660699aa4 HTTP/1.1" 200 None 2025-09-27 01:41:44,267 - lava_callback - DEBUG - Processing node 68d589652be2da4660699aa4: baseline-arm 2025-09-27 01:41:44,516 - lava_callback - ERROR - Error processing callback for node 68d589652be2da4660699aa4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:42:45,387 - lava_callback - INFO - Received callback for node 68d7376da6a7b6615d4c48f8 INFO: 172.21.0.1:56090 - "POST /node/68d7376da6a7b6615d4c48f8 HTTP/1.0" 202 Accepted 2025-09-27 01:42:45,393 - lava_callback - INFO - Starting async job submit for node 68d7376da6a7b6615d4c48f8 2025-09-27 01:42:45,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:42:45,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7376da6a7b6615d4c48f8 HTTP/1.1" 200 None 2025-09-27 01:42:45,449 - lava_callback - DEBUG - Processing node 68d7376da6a7b6615d4c48f8: baseline-x86 2025-09-27 01:42:46,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:42:46,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:42:46,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d7376da6a7b6615d4c48f8/log.txt.gz 2025-09-27 01:42:46,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:42:46,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:42:46,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d7376da6a7b6615d4c48f8/lava_callback.json.gz DEBUG: Setup failed for 68d7376da6a7b6615d4c48f8. Transitting job node result: incomplete -> fail 2025-09-27 01:42:46,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56106 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:42:46,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7376da6a7b6615d4c48f8 HTTP/1.1" 200 None 2025-09-27 01:42:46,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:42:46,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 01:42:46,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:42:46,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7376da6a7b6615d4c48f8 HTTP/1.1" 200 None 2025-09-27 01:42:46,597 - lava_callback - INFO - Completed processing callback for node 68d7376da6a7b6615d4c48f8 INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:43:45,366 - lava_callback - INFO - Received callback for node 68d589a32be2da4660699b00 INFO: 172.21.0.1:51594 - "POST /node/68d589a32be2da4660699b00 HTTP/1.0" 202 Accepted 2025-09-27 01:43:45,372 - lava_callback - INFO - Starting async job submit for node 68d589a32be2da4660699b00 2025-09-27 01:43:45,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:43:45,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589a32be2da4660699b00 HTTP/1.1" 200 None 2025-09-27 01:43:45,415 - lava_callback - DEBUG - Processing node 68d589a32be2da4660699b00: baseline-arm 2025-09-27 01:43:45,645 - lava_callback - ERROR - Error processing callback for node 68d589a32be2da4660699b00: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:44:50,648 - lava_callback - INFO - Received callback for node 68d736eca6a7b6615d4c47f2 INFO: 172.21.0.1:40204 - "POST /node/68d736eca6a7b6615d4c47f2 HTTP/1.0" 202 Accepted 2025-09-27 01:44:50,654 - lava_callback - INFO - Starting async job submit for node 68d736eca6a7b6615d4c47f2 2025-09-27 01:44:50,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:44:50,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eca6a7b6615d4c47f2 HTTP/1.1" 200 None 2025-09-27 01:44:50,709 - lava_callback - DEBUG - Processing node 68d736eca6a7b6615d4c47f2: baseline-arm64-broonie 2025-09-27 01:44:50,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:44:51,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:44:51,111 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eca6a7b6615d4c47f2/log.txt.gz 2025-09-27 01:44:51,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:44:51,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:44:51,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eca6a7b6615d4c47f2/lava_callback.json.gz 2025-09-27 01:44:51,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:44:51,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eca6a7b6615d4c47f2 HTTP/1.1" 200 None 2025-09-27 01:44:51,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:44:51,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:44:51,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:44:51,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eca6a7b6615d4c47f2 HTTP/1.1" 200 None 2025-09-27 01:44:51,330 - lava_callback - INFO - Completed processing callback for node 68d736eca6a7b6615d4c47f2 INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:45:44,564 - lava_callback - INFO - Received callback for node 68d589a42be2da4660699b03 INFO: 172.21.0.1:44248 - "POST /node/68d589a42be2da4660699b03 HTTP/1.0" 202 Accepted 2025-09-27 01:45:44,570 - lava_callback - INFO - Starting async job submit for node 68d589a42be2da4660699b03 2025-09-27 01:45:44,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:45:44,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589a42be2da4660699b03 HTTP/1.1" 200 None 2025-09-27 01:45:44,624 - lava_callback - DEBUG - Processing node 68d589a42be2da4660699b03: baseline-arm 2025-09-27 01:45:44,872 - lava_callback - ERROR - Error processing callback for node 68d589a42be2da4660699b03: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:47:44,883 - lava_callback - INFO - Received callback for node 68d589a52be2da4660699b06 INFO: 172.21.0.1:55920 - "POST /node/68d589a52be2da4660699b06 HTTP/1.0" 202 Accepted 2025-09-27 01:47:44,889 - lava_callback - INFO - Starting async job submit for node 68d589a52be2da4660699b06 2025-09-27 01:47:44,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:47:44,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589a52be2da4660699b06 HTTP/1.1" 200 None 2025-09-27 01:47:44,923 - lava_callback - DEBUG - Processing node 68d589a52be2da4660699b06: baseline-arm 2025-09-27 01:47:45,152 - lava_callback - ERROR - Error processing callback for node 68d589a52be2da4660699b06: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:48:16,531 - lava_callback - INFO - Received callback for node 68d73ca3a6a7b6615d4c4a18 INFO: 172.21.0.1:42798 - "POST /node/68d73ca3a6a7b6615d4c4a18 HTTP/1.0" 202 Accepted 2025-09-27 01:48:16,537 - lava_callback - INFO - Starting async job submit for node 68d73ca3a6a7b6615d4c4a18 2025-09-27 01:48:16,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:48:16,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73ca3a6a7b6615d4c4a18 HTTP/1.1" 200 None 2025-09-27 01:48:16,580 - lava_callback - DEBUG - Processing node 68d73ca3a6a7b6615d4c4a18: baseline-x86 2025-09-27 01:48:16,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:48:17,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:48:17,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d73ca3a6a7b6615d4c4a18/log.txt.gz 2025-09-27 01:48:17,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:48:17,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:48:17,307 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d73ca3a6a7b6615d4c4a18/lava_callback.json.gz DEBUG: Setup failed for 68d73ca3a6a7b6615d4c4a18. Transitting job node result: incomplete -> fail 2025-09-27 01:48:17,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:48:17,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73ca3a6a7b6615d4c4a18 HTTP/1.1" 200 None 2025-09-27 01:48:17,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:48:17,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 01:48:17,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:48:17,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73ca3a6a7b6615d4c4a18 HTTP/1.1" 200 None 2025-09-27 01:48:17,419 - lava_callback - INFO - Completed processing callback for node 68d73ca3a6a7b6615d4c4a18 INFO: 172.21.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:48:54,566 - lava_callback - INFO - Received callback for node 68d73e12a6a7b6615d4c4a8b INFO: 172.21.0.1:49412 - "POST /node/68d73e12a6a7b6615d4c4a8b HTTP/1.0" 202 Accepted 2025-09-27 01:48:54,573 - lava_callback - INFO - Starting async job submit for node 68d73e12a6a7b6615d4c4a8b 2025-09-27 01:48:54,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:48:54,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73e12a6a7b6615d4c4a8b HTTP/1.1" 200 None 2025-09-27 01:48:54,645 - lava_callback - DEBUG - Processing node 68d73e12a6a7b6615d4c4a8b: ltp-smoketest 2025-09-27 01:48:55,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:48:55,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:48:55,290 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d73e12a6a7b6615d4c4a8b/log.txt.gz 2025-09-27 01:48:55,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:48:55,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:48:55,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d73e12a6a7b6615d4c4a8b/lava_callback.json.gz 2025-09-27 01:48:55,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:48:55,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73e12a6a7b6615d4c4a8b HTTP/1.1" 200 None 2025-09-27 01:48:55,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:48:55,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e46a6a7b6615d4c4169 HTTP/1.1" 200 None 2025-09-27 01:48:55,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:48:55,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73e12a6a7b6615d4c4a8b HTTP/1.1" 200 None 2025-09-27 01:48:55,581 - lava_callback - INFO - Completed processing callback for node 68d73e12a6a7b6615d4c4a8b INFO: 172.21.0.1:49422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:49:44,443 - lava_callback - INFO - Received callback for node 68d589a62be2da4660699b09 INFO: 172.21.0.1:59736 - "POST /node/68d589a62be2da4660699b09 HTTP/1.0" 202 Accepted 2025-09-27 01:49:44,449 - lava_callback - INFO - Starting async job submit for node 68d589a62be2da4660699b09 2025-09-27 01:49:44,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:49:44,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589a62be2da4660699b09 HTTP/1.1" 200 None 2025-09-27 01:49:44,482 - lava_callback - DEBUG - Processing node 68d589a62be2da4660699b09: baseline-arm 2025-09-27 01:49:44,711 - lava_callback - ERROR - Error processing callback for node 68d589a62be2da4660699b09: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48750 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:51:46,834 - lava_callback - INFO - Received callback for node 68d589a82be2da4660699b0c INFO: 172.21.0.1:48764 - "POST /node/68d589a82be2da4660699b0c HTTP/1.0" 202 Accepted 2025-09-27 01:51:46,840 - lava_callback - INFO - Starting async job submit for node 68d589a82be2da4660699b0c 2025-09-27 01:51:46,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:51:46,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589a82be2da4660699b0c HTTP/1.1" 200 None 2025-09-27 01:51:46,874 - lava_callback - DEBUG - Processing node 68d589a82be2da4660699b0c: baseline-arm 2025-09-27 01:51:47,117 - lava_callback - ERROR - Error processing callback for node 68d589a82be2da4660699b0c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:53:40,205 - lava_callback - INFO - Received callback for node 68d589a82be2da4660699b0f INFO: 172.21.0.1:38846 - "POST /node/68d589a82be2da4660699b0f HTTP/1.0" 202 Accepted 2025-09-27 01:53:40,210 - lava_callback - INFO - Starting async job submit for node 68d589a82be2da4660699b0f 2025-09-27 01:53:40,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:53:40,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589a82be2da4660699b0f HTTP/1.1" 200 None 2025-09-27 01:53:40,257 - lava_callback - DEBUG - Processing node 68d589a82be2da4660699b0f: baseline-arm 2025-09-27 01:53:40,490 - lava_callback - ERROR - Error processing callback for node 68d589a82be2da4660699b0f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:55:47,273 - lava_callback - INFO - Received callback for node 68d589aa2be2da4660699b12 INFO: 172.21.0.1:52102 - "POST /node/68d589aa2be2da4660699b12 HTTP/1.0" 202 Accepted 2025-09-27 01:55:47,278 - lava_callback - INFO - Starting async job submit for node 68d589aa2be2da4660699b12 2025-09-27 01:55:47,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:55:47,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589aa2be2da4660699b12 HTTP/1.1" 200 None 2025-09-27 01:55:47,331 - lava_callback - DEBUG - Processing node 68d589aa2be2da4660699b12: baseline-arm 2025-09-27 01:55:47,563 - lava_callback - ERROR - Error processing callback for node 68d589aa2be2da4660699b12: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:57:27,530 - lava_callback - INFO - Received callback for node 68d49d0ba5c2c05277bcf17e INFO: 172.21.0.1:34532 - "POST /node/68d49d0ba5c2c05277bcf17e HTTP/1.0" 202 Accepted 2025-09-27 01:57:27,536 - lava_callback - INFO - Starting async job submit for node 68d49d0ba5c2c05277bcf17e 2025-09-27 01:57:27,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:57:27,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d49d0ba5c2c05277bcf17e HTTP/1.1" 200 None 2025-09-27 01:57:27,579 - lava_callback - DEBUG - Processing node 68d49d0ba5c2c05277bcf17e: baseline-arm 2025-09-27 01:57:27,867 - lava_callback - ERROR - Error processing callback for node 68d49d0ba5c2c05277bcf17e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:57:44,098 - lava_callback - INFO - Received callback for node 68d589aa2be2da4660699b15 INFO: 172.21.0.1:53420 - "POST /node/68d589aa2be2da4660699b15 HTTP/1.0" 202 Accepted 2025-09-27 01:57:44,104 - lava_callback - INFO - Starting async job submit for node 68d589aa2be2da4660699b15 2025-09-27 01:57:44,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:57:44,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589aa2be2da4660699b15 HTTP/1.1" 200 None 2025-09-27 01:57:44,137 - lava_callback - DEBUG - Processing node 68d589aa2be2da4660699b15: baseline-arm 2025-09-27 01:57:44,364 - lava_callback - ERROR - Error processing callback for node 68d589aa2be2da4660699b15: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:57:58,351 - lava_callback - INFO - Received callback for node 68d73f47a6a7b6615d4c4b95 INFO: 172.21.0.1:58564 - "POST /node/68d73f47a6a7b6615d4c4b95 HTTP/1.0" 202 Accepted 2025-09-27 01:57:58,359 - lava_callback - INFO - Starting async job submit for node 68d73f47a6a7b6615d4c4b95 2025-09-27 01:57:58,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:57:58,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73f47a6a7b6615d4c4b95 HTTP/1.1" 200 None 2025-09-27 01:57:58,413 - lava_callback - DEBUG - Processing node 68d73f47a6a7b6615d4c4b95: blktests-ddp-x86 2025-09-27 01:57:59,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:57:59,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:57:59,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d73f47a6a7b6615d4c4b95/log.txt.gz 2025-09-27 01:57:59,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:57:59,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:57:59,533 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d73f47a6a7b6615d4c4b95/lava_callback.json.gz 2025-09-27 01:57:59,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:57:59,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73f47a6a7b6615d4c4b95 HTTP/1.1" 200 None 2025-09-27 01:57:59,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:57:59,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a493c94e462c68828bf HTTP/1.1" 200 None 2025-09-27 01:57:59,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:57:59,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73f47a6a7b6615d4c4b95 HTTP/1.1" 200 None 2025-09-27 01:57:59,628 - lava_callback - INFO - Completed processing callback for node 68d73f47a6a7b6615d4c4b95 INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:58:10,465 - lava_callback - INFO - Received callback for node 68d736eda6a7b6615d4c47fb INFO: 172.21.0.1:35700 - "POST /node/68d736eda6a7b6615d4c47fb HTTP/1.0" 202 Accepted 2025-09-27 01:58:10,471 - lava_callback - INFO - Starting async job submit for node 68d736eda6a7b6615d4c47fb 2025-09-27 01:58:10,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:58:10,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eda6a7b6615d4c47fb HTTP/1.1" 200 None 2025-09-27 01:58:10,511 - lava_callback - DEBUG - Processing node 68d736eda6a7b6615d4c47fb: baseline-arm64-broonie 2025-09-27 01:58:10,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:58:10,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:58:10,852 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eda6a7b6615d4c47fb/log.txt.gz 2025-09-27 01:58:10,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:58:10,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:58:10,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eda6a7b6615d4c47fb/lava_callback.json.gz 2025-09-27 01:58:10,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:58:11,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eda6a7b6615d4c47fb HTTP/1.1" 200 None 2025-09-27 01:58:11,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:58:11,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 01:58:11,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:58:11,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eda6a7b6615d4c47fb HTTP/1.1" 200 None 2025-09-27 01:58:11,051 - lava_callback - INFO - Completed processing callback for node 68d736eda6a7b6615d4c47fb INFO: 172.21.0.1:35710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:59:43,446 - lava_callback - INFO - Received callback for node 68d5a59b2be2da466069a122 INFO: 172.21.0.1:46694 - "POST /node/68d5a59b2be2da466069a122 HTTP/1.0" 202 Accepted 2025-09-27 01:59:43,452 - lava_callback - INFO - Starting async job submit for node 68d5a59b2be2da466069a122 2025-09-27 01:59:43,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:59:43,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a59b2be2da466069a122 HTTP/1.1" 200 None 2025-09-27 01:59:43,485 - lava_callback - DEBUG - Processing node 68d5a59b2be2da466069a122: baseline-arm 2025-09-27 01:59:43,738 - lava_callback - ERROR - Error processing callback for node 68d5a59b2be2da466069a122: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK 2025-09-27 01:59:50,423 - lava_callback - INFO - Received callback for node 68d7370aa6a7b6615d4c4892 INFO: 172.21.0.1:43014 - "POST /node/68d7370aa6a7b6615d4c4892 HTTP/1.0" 202 Accepted 2025-09-27 01:59:50,429 - lava_callback - INFO - Starting async job submit for node 68d7370aa6a7b6615d4c4892 2025-09-27 01:59:50,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:59:50,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370aa6a7b6615d4c4892 HTTP/1.1" 200 None 2025-09-27 01:59:50,464 - lava_callback - DEBUG - Processing node 68d7370aa6a7b6615d4c4892: baseline-arm64-broonie 2025-09-27 01:59:50,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:59:50,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:59:50,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370aa6a7b6615d4c4892/log.txt.gz 2025-09-27 01:59:50,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 01:59:50,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 01:59:50,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370aa6a7b6615d4c4892/lava_callback.json.gz 2025-09-27 01:59:50,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:59:50,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370aa6a7b6615d4c4892 HTTP/1.1" 200 None 2025-09-27 01:59:51,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:59:51,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 01:59:51,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 01:59:51,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370aa6a7b6615d4c4892 HTTP/1.1" 200 None 2025-09-27 01:59:51,066 - lava_callback - INFO - Completed processing callback for node 68d7370aa6a7b6615d4c4892 INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57788 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:00:08,505 - lava_callback - INFO - Received callback for node 68d73d4da6a7b6615d4c4a3c INFO: 172.21.0.1:57796 - "POST /node/68d73d4da6a7b6615d4c4a3c HTTP/1.0" 202 Accepted 2025-09-27 02:00:08,511 - lava_callback - INFO - Starting async job submit for node 68d73d4da6a7b6615d4c4a3c 2025-09-27 02:00:08,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:00:08,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d4da6a7b6615d4c4a3c HTTP/1.1" 200 None 2025-09-27 02:00:08,568 - lava_callback - DEBUG - Processing node 68d73d4da6a7b6615d4c4a3c: baseline-x86 2025-09-27 02:00:09,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:00:09,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:00:09,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d73d4da6a7b6615d4c4a3c/log.txt.gz 2025-09-27 02:00:09,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:00:09,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:00:09,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d73d4da6a7b6615d4c4a3c/lava_callback.json.gz DEBUG: Setup failed for 68d73d4da6a7b6615d4c4a3c. Transitting job node result: incomplete -> fail 2025-09-27 02:00:09,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:00:09,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d4da6a7b6615d4c4a3c HTTP/1.1" 200 None 2025-09-27 02:00:09,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:00:09,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 02:00:09,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:00:09,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73d4da6a7b6615d4c4a3c HTTP/1.1" 200 None 2025-09-27 02:00:09,875 - lava_callback - INFO - Completed processing callback for node 68d73d4da6a7b6615d4c4a3c INFO: 172.21.0.1:39622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:00:31,801 - lava_callback - INFO - Received callback for node 68d73708a6a7b6615d4c4889 INFO: 172.21.0.1:54788 - "POST /node/68d73708a6a7b6615d4c4889 HTTP/1.0" 202 Accepted 2025-09-27 02:00:31,808 - lava_callback - INFO - Starting async job submit for node 68d73708a6a7b6615d4c4889 2025-09-27 02:00:31,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:00:31,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73708a6a7b6615d4c4889 HTTP/1.1" 200 None 2025-09-27 02:00:31,868 - lava_callback - DEBUG - Processing node 68d73708a6a7b6615d4c4889: baseline-arm64-broonie 2025-09-27 02:00:32,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:00:32,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:00:32,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73708a6a7b6615d4c4889/log.txt.gz 2025-09-27 02:00:32,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:00:32,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:00:32,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73708a6a7b6615d4c4889/lava_callback.json.gz DEBUG: 68d73708a6a7b6615d4c4889 Transitting job node result: pass -> incomplete 2025-09-27 02:00:32,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:00:32,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73708a6a7b6615d4c4889 HTTP/1.1" 200 None 2025-09-27 02:00:32,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:00:32,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:00:32,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:00:32,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73708a6a7b6615d4c4889 HTTP/1.1" 200 None 2025-09-27 02:00:32,971 - lava_callback - INFO - Completed processing callback for node 68d73708a6a7b6615d4c4889 INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:01:17,822 - lava_callback - INFO - Received callback for node 68d740cfa6a7b6615d4c4b9c INFO: 172.21.0.1:50790 - "POST /node/68d740cfa6a7b6615d4c4b9c HTTP/1.0" 202 Accepted 2025-09-27 02:01:17,828 - lava_callback - INFO - Starting async job submit for node 68d740cfa6a7b6615d4c4b9c 2025-09-27 02:01:17,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:01:17,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d740cfa6a7b6615d4c4b9c HTTP/1.1" 200 None 2025-09-27 02:01:17,875 - lava_callback - DEBUG - Processing node 68d740cfa6a7b6615d4c4b9c: baseline-arm 2025-09-27 02:01:18,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:01:18,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:01:18,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d740cfa6a7b6615d4c4b9c/log.txt.gz 2025-09-27 02:01:18,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:01:18,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:01:18,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d740cfa6a7b6615d4c4b9c/lava_callback.json.gz DEBUG: Setup failed for 68d740cfa6a7b6615d4c4b9c. Transitting job node result: incomplete -> fail 2025-09-27 02:01:18,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:01:18,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d740cfa6a7b6615d4c4b9c HTTP/1.1" 200 None 2025-09-27 02:01:18,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:01:18,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 02:01:18,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:01:18,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d740cfa6a7b6615d4c4b9c HTTP/1.1" 200 None 2025-09-27 02:01:18,616 - lava_callback - INFO - Completed processing callback for node 68d740cfa6a7b6615d4c4b9c INFO: 172.21.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:01:39,781 - lava_callback - INFO - Received callback for node 68d5a59c2be2da466069a125 INFO: 172.21.0.1:60790 - "POST /node/68d5a59c2be2da466069a125 HTTP/1.0" 202 Accepted 2025-09-27 02:01:39,787 - lava_callback - INFO - Starting async job submit for node 68d5a59c2be2da466069a125 2025-09-27 02:01:39,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:01:39,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a59c2be2da466069a125 HTTP/1.1" 200 None 2025-09-27 02:01:39,824 - lava_callback - DEBUG - Processing node 68d5a59c2be2da466069a125: baseline-arm 2025-09-27 02:01:40,077 - lava_callback - ERROR - Error processing callback for node 68d5a59c2be2da466069a125: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:02:50,580 - lava_callback - INFO - Received callback for node 68d7454ca6a7b6615d4c4bd3 INFO: 172.21.0.1:45498 - "POST /node/68d7454ca6a7b6615d4c4bd3 HTTP/1.0" 202 Accepted 2025-09-27 02:02:50,586 - lava_callback - INFO - Starting async job submit for node 68d7454ca6a7b6615d4c4bd3 2025-09-27 02:02:50,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:02:50,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7454ca6a7b6615d4c4bd3 HTTP/1.1" 200 None 2025-09-27 02:02:50,628 - lava_callback - DEBUG - Processing node 68d7454ca6a7b6615d4c4bd3: baseline-arm64-broonie 2025-09-27 02:02:50,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:02:51,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:02:51,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7454ca6a7b6615d4c4bd3/log.txt.gz 2025-09-27 02:02:51,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:02:51,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:02:51,180 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7454ca6a7b6615d4c4bd3/lava_callback.json.gz 2025-09-27 02:02:51,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:02:51,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7454ca6a7b6615d4c4bd3 HTTP/1.1" 200 None 2025-09-27 02:02:51,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:02:51,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:02:51,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:02:51,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7454ca6a7b6615d4c4bd3 HTTP/1.1" 200 None 2025-09-27 02:02:51,282 - lava_callback - INFO - Completed processing callback for node 68d7454ca6a7b6615d4c4bd3 INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:03:13,955 - lava_callback - INFO - Received callback for node 68d736efa6a7b6615d4c4807 INFO: 172.21.0.1:59110 - "POST /node/68d736efa6a7b6615d4c4807 HTTP/1.0" 202 Accepted 2025-09-27 02:03:13,962 - lava_callback - INFO - Starting async job submit for node 68d736efa6a7b6615d4c4807 2025-09-27 02:03:13,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:03:14,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736efa6a7b6615d4c4807 HTTP/1.1" 200 None 2025-09-27 02:03:14,004 - lava_callback - DEBUG - Processing node 68d736efa6a7b6615d4c4807: baseline-arm64-broonie 2025-09-27 02:03:14,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:03:14,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:03:14,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736efa6a7b6615d4c4807/log.txt.gz 2025-09-27 02:03:14,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:03:14,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:03:14,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736efa6a7b6615d4c4807/lava_callback.json.gz 2025-09-27 02:03:14,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:03:14,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736efa6a7b6615d4c4807 HTTP/1.1" 200 None 2025-09-27 02:03:14,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:03:14,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 02:03:14,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:03:14,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736efa6a7b6615d4c4807 HTTP/1.1" 200 None 2025-09-27 02:03:14,831 - lava_callback - INFO - Completed processing callback for node 68d736efa6a7b6615d4c4807 INFO: 172.21.0.1:59124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:03:44,807 - lava_callback - INFO - Received callback for node 68d5a59e2be2da466069a128 INFO: 172.21.0.1:38252 - "POST /node/68d5a59e2be2da466069a128 HTTP/1.0" 202 Accepted 2025-09-27 02:03:44,813 - lava_callback - INFO - Starting async job submit for node 68d5a59e2be2da466069a128 2025-09-27 02:03:44,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:03:44,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a59e2be2da466069a128 HTTP/1.1" 200 None 2025-09-27 02:03:44,848 - lava_callback - DEBUG - Processing node 68d5a59e2be2da466069a128: baseline-arm 2025-09-27 02:03:45,103 - lava_callback - ERROR - Error processing callback for node 68d5a59e2be2da466069a128: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:05:45,614 - lava_callback - INFO - Received callback for node 68d5a59e2be2da466069a12b INFO: 172.21.0.1:59738 - "POST /node/68d5a59e2be2da466069a12b HTTP/1.0" 202 Accepted 2025-09-27 02:05:45,620 - lava_callback - INFO - Starting async job submit for node 68d5a59e2be2da466069a12b 2025-09-27 02:05:45,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:05:45,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a59e2be2da466069a12b HTTP/1.1" 200 None 2025-09-27 02:05:45,688 - lava_callback - DEBUG - Processing node 68d5a59e2be2da466069a12b: baseline-arm 2025-09-27 02:05:45,915 - lava_callback - ERROR - Error processing callback for node 68d5a59e2be2da466069a12b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:06:34,451 - lava_callback - INFO - Received callback for node 68d736eea6a7b6615d4c47fe INFO: 172.21.0.1:45046 - "POST /node/68d736eea6a7b6615d4c47fe HTTP/1.0" 202 Accepted 2025-09-27 02:06:34,458 - lava_callback - INFO - Starting async job submit for node 68d736eea6a7b6615d4c47fe 2025-09-27 02:06:34,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:06:34,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eea6a7b6615d4c47fe HTTP/1.1" 200 None 2025-09-27 02:06:34,512 - lava_callback - DEBUG - Processing node 68d736eea6a7b6615d4c47fe: baseline-arm64-broonie 2025-09-27 02:06:35,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:06:35,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:06:35,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eea6a7b6615d4c47fe/log.txt.gz 2025-09-27 02:06:35,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:06:35,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:06:35,471 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eea6a7b6615d4c47fe/lava_callback.json.gz 2025-09-27 02:06:35,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:06:35,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eea6a7b6615d4c47fe HTTP/1.1" 200 None 2025-09-27 02:06:35,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:06:35,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 02:06:35,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:06:35,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eea6a7b6615d4c47fe HTTP/1.1" 200 None 2025-09-27 02:06:35,576 - lava_callback - INFO - Completed processing callback for node 68d736eea6a7b6615d4c47fe INFO: 172.21.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49676 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:07:12,996 - lava_callback - INFO - Received callback for node 68d74287a6a7b6615d4c4bb8 INFO: 172.21.0.1:48644 - "POST /node/68d74287a6a7b6615d4c4bb8 HTTP/1.0" 202 Accepted 2025-09-27 02:07:13,003 - lava_callback - INFO - Starting async job submit for node 68d74287a6a7b6615d4c4bb8 2025-09-27 02:07:13,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:07:13,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74287a6a7b6615d4c4bb8 HTTP/1.1" 200 None 2025-09-27 02:07:13,074 - lava_callback - DEBUG - Processing node 68d74287a6a7b6615d4c4bb8: ltp-smoketest 2025-09-27 02:07:13,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:07:13,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:07:13,671 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d74287a6a7b6615d4c4bb8/log.txt.gz 2025-09-27 02:07:13,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:07:13,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:07:13,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d74287a6a7b6615d4c4bb8/lava_callback.json.gz 2025-09-27 02:07:13,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:07:13,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74287a6a7b6615d4c4bb8 HTTP/1.1" 200 None 2025-09-27 02:07:13,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:07:13,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e46a6a7b6615d4c4169 HTTP/1.1" 200 None 2025-09-27 02:07:13,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:07:14,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74287a6a7b6615d4c4bb8 HTTP/1.1" 200 None 2025-09-27 02:07:14,011 - lava_callback - INFO - Completed processing callback for node 68d74287a6a7b6615d4c4bb8 INFO: 172.21.0.1:48654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32906 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:08:09,117 - lava_callback - INFO - Received callback for node 68d7370ba6a7b6615d4c489b INFO: 172.21.0.1:32920 - "POST /node/68d7370ba6a7b6615d4c489b HTTP/1.0" 202 Accepted 2025-09-27 02:08:09,123 - lava_callback - INFO - Starting async job submit for node 68d7370ba6a7b6615d4c489b 2025-09-27 02:08:09,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:08:09,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ba6a7b6615d4c489b HTTP/1.1" 200 None 2025-09-27 02:08:09,189 - lava_callback - DEBUG - Processing node 68d7370ba6a7b6615d4c489b: baseline-arm64-broonie 2025-09-27 02:08:09,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:08:09,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:08:09,759 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370ba6a7b6615d4c489b/log.txt.gz 2025-09-27 02:08:09,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:08:09,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:08:09,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370ba6a7b6615d4c489b/lava_callback.json.gz 2025-09-27 02:08:09,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:08:09,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370ba6a7b6615d4c489b HTTP/1.1" 200 None 2025-09-27 02:08:09,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:08:09,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:08:09,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:08:09,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370ba6a7b6615d4c489b HTTP/1.1" 200 None 2025-09-27 02:08:09,966 - lava_callback - INFO - Completed processing callback for node 68d7370ba6a7b6615d4c489b INFO: 172.21.0.1:45084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:08:42,505 - lava_callback - INFO - Received callback for node 68d5a5db2be2da466069a176 INFO: 172.21.0.1:50198 - "POST /node/68d5a5db2be2da466069a176 HTTP/1.0" 202 Accepted 2025-09-27 02:08:42,511 - lava_callback - INFO - Starting async job submit for node 68d5a5db2be2da466069a176 2025-09-27 02:08:42,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:08:42,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5db2be2da466069a176 HTTP/1.1" 200 None 2025-09-27 02:08:42,550 - lava_callback - DEBUG - Processing node 68d5a5db2be2da466069a176: baseline-arm 2025-09-27 02:08:42,793 - lava_callback - ERROR - Error processing callback for node 68d5a5db2be2da466069a176: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:09:10,219 - lava_callback - INFO - Received callback for node 68d7370aa6a7b6615d4c4895 INFO: 172.21.0.1:36176 - "POST /node/68d7370aa6a7b6615d4c4895 HTTP/1.0" 202 Accepted 2025-09-27 02:09:10,225 - lava_callback - INFO - Starting async job submit for node 68d7370aa6a7b6615d4c4895 2025-09-27 02:09:10,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:09:10,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370aa6a7b6615d4c4895 HTTP/1.1" 200 None 2025-09-27 02:09:10,259 - lava_callback - DEBUG - Processing node 68d7370aa6a7b6615d4c4895: baseline-arm64-broonie 2025-09-27 02:09:10,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:09:10,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:09:10,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370aa6a7b6615d4c4895/log.txt.gz 2025-09-27 02:09:10,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:09:10,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:09:10,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7370aa6a7b6615d4c4895/lava_callback.json.gz 2025-09-27 02:09:10,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:09:10,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7370aa6a7b6615d4c4895 HTTP/1.1" 200 None 2025-09-27 02:09:10,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:09:10,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:09:10,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:09:10,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7370aa6a7b6615d4c4895 HTTP/1.1" 200 None 2025-09-27 02:09:10,978 - lava_callback - INFO - Completed processing callback for node 68d7370aa6a7b6615d4c4895 INFO: 172.21.0.1:36178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:09:45,840 - lava_callback - INFO - Received callback for node 68d74265a6a7b6615d4c4bb1 INFO: 172.21.0.1:34142 - "POST /node/68d74265a6a7b6615d4c4bb1 HTTP/1.0" 202 Accepted 2025-09-27 02:09:45,887 - lava_callback - INFO - Starting async job submit for node 68d74265a6a7b6615d4c4bb1 2025-09-27 02:09:45,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:09:45,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74265a6a7b6615d4c4bb1 HTTP/1.1" 200 None 2025-09-27 02:09:45,924 - lava_callback - DEBUG - Processing node 68d74265a6a7b6615d4c4bb1: baseline-x86 2025-09-27 02:09:46,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:09:46,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:09:46,139 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d74265a6a7b6615d4c4bb1/log.txt.gz 2025-09-27 02:09:46,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:09:46,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:09:46,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d74265a6a7b6615d4c4bb1/lava_callback.json.gz 2025-09-27 02:09:46,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:09:46,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74265a6a7b6615d4c4bb1 HTTP/1.1" 200 None 2025-09-27 02:09:46,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:09:46,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 02:09:46,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:09:46,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74265a6a7b6615d4c4bb1 HTTP/1.1" 200 None 2025-09-27 02:09:46,327 - lava_callback - INFO - Completed processing callback for node 68d74265a6a7b6615d4c4bb1 INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:10:08,628 - lava_callback - INFO - Received callback for node 68d52795b70fb2a1e20f1ff1 INFO: 172.21.0.1:44262 - "POST /node/68d52795b70fb2a1e20f1ff1 HTTP/1.0" 202 Accepted 2025-09-27 02:10:08,633 - lava_callback - INFO - Starting async job submit for node 68d52795b70fb2a1e20f1ff1 2025-09-27 02:10:08,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:10:08,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d52795b70fb2a1e20f1ff1 HTTP/1.1" 200 None 2025-09-27 02:10:08,664 - lava_callback - DEBUG - Processing node 68d52795b70fb2a1e20f1ff1: baseline-arm64-broonie 2025-09-27 02:10:08,989 - lava_callback - ERROR - Error processing callback for node 68d52795b70fb2a1e20f1ff1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:10:45,202 - lava_callback - INFO - Received callback for node 68d5a5dc2be2da466069a179 INFO: 172.21.0.1:55554 - "POST /node/68d5a5dc2be2da466069a179 HTTP/1.0" 202 Accepted 2025-09-27 02:10:45,207 - lava_callback - INFO - Starting async job submit for node 68d5a5dc2be2da466069a179 2025-09-27 02:10:45,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:10:45,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5dc2be2da466069a179 HTTP/1.1" 200 None 2025-09-27 02:10:45,241 - lava_callback - DEBUG - Processing node 68d5a5dc2be2da466069a179: baseline-arm 2025-09-27 02:10:45,464 - lava_callback - ERROR - Error processing callback for node 68d5a5dc2be2da466069a179: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:13:06,395 - lava_callback - INFO - Received callback for node 68d5a5dd2be2da466069a17c INFO: 172.21.0.1:54536 - "POST /node/68d5a5dd2be2da466069a17c HTTP/1.0" 202 Accepted 2025-09-27 02:13:06,400 - lava_callback - INFO - Starting async job submit for node 68d5a5dd2be2da466069a17c 2025-09-27 02:13:06,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:13:06,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5dd2be2da466069a17c HTTP/1.1" 200 None 2025-09-27 02:13:06,435 - lava_callback - DEBUG - Processing node 68d5a5dd2be2da466069a17c: baseline-arm INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:13:06,694 - lava_callback - ERROR - Error processing callback for node 68d5a5dd2be2da466069a17c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39550 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 02:13:15,633 - lava_callback - INFO - Received callback for node 68d7470aa6a7b6615d4c4bf0 INFO: 172.21.0.1:39566 - "POST /node/68d7470aa6a7b6615d4c4bf0 HTTP/1.0" 202 Accepted 2025-09-27 02:13:15,639 - lava_callback - INFO - Starting async job submit for node 68d7470aa6a7b6615d4c4bf0 2025-09-27 02:13:15,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:13:15,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7470aa6a7b6615d4c4bf0 HTTP/1.1" 200 None 2025-09-27 02:13:15,686 - lava_callback - DEBUG - Processing node 68d7470aa6a7b6615d4c4bf0: baseline-arm64-broonie 2025-09-27 02:13:16,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:13:16,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:13:16,305 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7470aa6a7b6615d4c4bf0/log.txt.gz 2025-09-27 02:13:16,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:13:16,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:13:16,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7470aa6a7b6615d4c4bf0/lava_callback.json.gz 2025-09-27 02:13:16,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:13:16,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7470aa6a7b6615d4c4bf0 HTTP/1.1" 200 None 2025-09-27 02:13:16,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:13:16,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:13:16,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:13:16,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7470aa6a7b6615d4c4bf0 HTTP/1.1" 200 None 2025-09-27 02:13:16,596 - lava_callback - INFO - Completed processing callback for node 68d7470aa6a7b6615d4c4bf0 INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:13:51,320 - lava_callback - INFO - Received callback for node 68d4a558a5c2c05277bcf70d INFO: 172.21.0.1:45258 - "POST /node/68d4a558a5c2c05277bcf70d HTTP/1.0" 202 Accepted 2025-09-27 02:13:51,325 - lava_callback - INFO - Starting async job submit for node 68d4a558a5c2c05277bcf70d 2025-09-27 02:13:51,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:13:51,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a558a5c2c05277bcf70d HTTP/1.1" 200 None 2025-09-27 02:13:51,340 - lava_callback - DEBUG - Processing node 68d4a558a5c2c05277bcf70d: baseline-arm 2025-09-27 02:13:51,340 - lava_callback - ERROR - Error processing callback for node 68d4a558a5c2c05277bcf70d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:13:51,958 - lava_callback - INFO - Received callback for node 68d4a558a5c2c05277bcf710 INFO: 172.21.0.1:45268 - "POST /node/68d4a558a5c2c05277bcf710 HTTP/1.0" 202 Accepted 2025-09-27 02:13:51,963 - lava_callback - INFO - Starting async job submit for node 68d4a558a5c2c05277bcf710 2025-09-27 02:13:51,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:13:51,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a558a5c2c05277bcf710 HTTP/1.1" 200 None 2025-09-27 02:13:51,977 - lava_callback - DEBUG - Processing node 68d4a558a5c2c05277bcf710: baseline-arm 2025-09-27 02:13:51,977 - lava_callback - ERROR - Error processing callback for node 68d4a558a5c2c05277bcf710: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58088 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:15:05,286 - lava_callback - INFO - Received callback for node 68d5a5de2be2da466069a17f INFO: 172.21.0.1:39102 - "POST /node/68d5a5de2be2da466069a17f HTTP/1.0" 202 Accepted 2025-09-27 02:15:05,292 - lava_callback - INFO - Starting async job submit for node 68d5a5de2be2da466069a17f 2025-09-27 02:15:05,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:15:05,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5de2be2da466069a17f HTTP/1.1" 200 None 2025-09-27 02:15:05,330 - lava_callback - DEBUG - Processing node 68d5a5de2be2da466069a17f: baseline-arm 2025-09-27 02:15:05,560 - lava_callback - ERROR - Error processing callback for node 68d5a5de2be2da466069a17f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:15:09,579 - lava_callback - INFO - Received callback for node 68d4a9caa5c2c05277bcf7d2 INFO: 172.21.0.1:50356 - "POST /node/68d4a9caa5c2c05277bcf7d2 HTTP/1.0" 202 Accepted 2025-09-27 02:15:09,585 - lava_callback - INFO - Starting async job submit for node 68d4a9caa5c2c05277bcf7d2 2025-09-27 02:15:09,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:15:09,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9caa5c2c05277bcf7d2 HTTP/1.1" 200 None 2025-09-27 02:15:09,620 - lava_callback - DEBUG - Processing node 68d4a9caa5c2c05277bcf7d2: baseline-arm-broonie 2025-09-27 02:15:09,836 - lava_callback - ERROR - Error processing callback for node 68d4a9caa5c2c05277bcf7d2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:15:49,885 - lava_callback - INFO - Received callback for node 68d746aca6a7b6615d4c4be7 INFO: 172.21.0.1:45286 - "POST /node/68d746aca6a7b6615d4c4be7 HTTP/1.0" 202 Accepted 2025-09-27 02:15:49,891 - lava_callback - INFO - Starting async job submit for node 68d746aca6a7b6615d4c4be7 2025-09-27 02:15:49,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:15:49,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d746aca6a7b6615d4c4be7 HTTP/1.1" 200 None 2025-09-27 02:15:49,962 - lava_callback - DEBUG - Processing node 68d746aca6a7b6615d4c4be7: baseline-arm64-broonie 2025-09-27 02:15:50,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:15:50,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:15:50,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d746aca6a7b6615d4c4be7/log.txt.gz 2025-09-27 02:15:50,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:15:50,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:15:50,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d746aca6a7b6615d4c4be7/lava_callback.json.gz 2025-09-27 02:15:50,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:15:50,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d746aca6a7b6615d4c4be7 HTTP/1.1" 200 None 2025-09-27 02:15:50,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:15:50,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 02:15:50,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:15:50,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d746aca6a7b6615d4c4be7 HTTP/1.1" 200 None 2025-09-27 02:15:50,927 - lava_callback - INFO - Completed processing callback for node 68d746aca6a7b6615d4c4be7 INFO: 172.21.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:16:54,367 - lava_callback - INFO - Received callback for node 68d74552a6a7b6615d4c4bd6 INFO: 172.21.0.1:52316 - "POST /node/68d74552a6a7b6615d4c4bd6 HTTP/1.0" 202 Accepted 2025-09-27 02:16:54,373 - lava_callback - INFO - Starting async job submit for node 68d74552a6a7b6615d4c4bd6 2025-09-27 02:16:54,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:16:54,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74552a6a7b6615d4c4bd6 HTTP/1.1" 200 None 2025-09-27 02:16:54,451 - lava_callback - DEBUG - Processing node 68d74552a6a7b6615d4c4bd6: baseline-x86 2025-09-27 02:16:55,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:16:55,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:16:55,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d74552a6a7b6615d4c4bd6/log.txt.gz 2025-09-27 02:16:55,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:16:55,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:16:55,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d74552a6a7b6615d4c4bd6/lava_callback.json.gz DEBUG: Setup failed for 68d74552a6a7b6615d4c4bd6. Transitting job node result: incomplete -> fail 2025-09-27 02:16:55,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:16:55,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74552a6a7b6615d4c4bd6 HTTP/1.1" 200 None 2025-09-27 02:16:55,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:16:55,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e66a6a7b6615d4c4181 HTTP/1.1" 200 None 2025-09-27 02:16:55,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:16:55,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74552a6a7b6615d4c4bd6 HTTP/1.1" 200 None 2025-09-27 02:16:55,667 - lava_callback - INFO - Completed processing callback for node 68d74552a6a7b6615d4c4bd6 2025-09-27 02:16:56,273 - lava_callback - INFO - Received callback for node 68d5a82f2be2da466069a1fd INFO: 172.21.0.1:52318 - "POST /node/68d5a82f2be2da466069a1fd HTTP/1.0" 202 Accepted 2025-09-27 02:16:56,279 - lava_callback - INFO - Starting async job submit for node 68d5a82f2be2da466069a1fd 2025-09-27 02:16:56,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:16:56,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a82f2be2da466069a1fd HTTP/1.1" 200 None 2025-09-27 02:16:56,316 - lava_callback - DEBUG - Processing node 68d5a82f2be2da466069a1fd: baseline-arm INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:16:56,561 - lava_callback - ERROR - Error processing callback for node 68d5a82f2be2da466069a1fd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:18:08,886 - lava_callback - INFO - Received callback for node 68d748d7a6a7b6615d4c4bfe INFO: 172.21.0.1:46990 - "POST /node/68d748d7a6a7b6615d4c4bfe HTTP/1.0" 202 Accepted 2025-09-27 02:18:08,892 - lava_callback - INFO - Starting async job submit for node 68d748d7a6a7b6615d4c4bfe 2025-09-27 02:18:08,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:09,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d748d7a6a7b6615d4c4bfe HTTP/1.1" 200 None 2025-09-27 02:18:09,022 - lava_callback - DEBUG - Processing node 68d748d7a6a7b6615d4c4bfe: baseline-arm64-broonie 2025-09-27 02:18:09,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:18:09,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:18:09,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d748d7a6a7b6615d4c4bfe/log.txt.gz 2025-09-27 02:18:09,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:18:09,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:18:09,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d748d7a6a7b6615d4c4bfe/lava_callback.json.gz 2025-09-27 02:18:09,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:09,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d748d7a6a7b6615d4c4bfe HTTP/1.1" 200 None 2025-09-27 02:18:09,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:09,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 02:18:09,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:09,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d748d7a6a7b6615d4c4bfe HTTP/1.1" 200 None 2025-09-27 02:18:09,723 - lava_callback - INFO - Completed processing callback for node 68d748d7a6a7b6615d4c4bfe INFO: 172.21.0.1:48104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:18:30,275 - lava_callback - INFO - Received callback for node 68d7483da6a7b6615d4c4bf9 INFO: 172.21.0.1:40258 - "POST /node/68d7483da6a7b6615d4c4bf9 HTTP/1.0" 202 Accepted 2025-09-27 02:18:30,282 - lava_callback - INFO - Starting async job submit for node 68d7483da6a7b6615d4c4bf9 2025-09-27 02:18:30,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:30,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7483da6a7b6615d4c4bf9 HTTP/1.1" 200 None 2025-09-27 02:18:30,334 - lava_callback - DEBUG - Processing node 68d7483da6a7b6615d4c4bf9: baseline-arm64-broonie 2025-09-27 02:18:30,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:18:30,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:18:30,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7483da6a7b6615d4c4bf9/log.txt.gz 2025-09-27 02:18:30,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:18:31,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:18:31,084 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7483da6a7b6615d4c4bf9/lava_callback.json.gz 2025-09-27 02:18:31,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:31,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7483da6a7b6615d4c4bf9 HTTP/1.1" 200 None 2025-09-27 02:18:31,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:31,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:18:31,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:31,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7483da6a7b6615d4c4bf9 HTTP/1.1" 200 None 2025-09-27 02:18:31,193 - lava_callback - INFO - Completed processing callback for node 68d7483da6a7b6615d4c4bf9 2025-09-27 02:18:31,373 - lava_callback - INFO - Received callback for node 68d4a66ea5c2c05277bcf715 INFO: 172.21.0.1:40264 - "POST /node/68d4a66ea5c2c05277bcf715 HTTP/1.0" 202 Accepted 2025-09-27 02:18:31,379 - lava_callback - INFO - Starting async job submit for node 68d4a66ea5c2c05277bcf715 2025-09-27 02:18:31,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:31,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a66ea5c2c05277bcf715 HTTP/1.1" 200 None 2025-09-27 02:18:31,393 - lava_callback - DEBUG - Processing node 68d4a66ea5c2c05277bcf715: baseline-arm 2025-09-27 02:18:31,393 - lava_callback - ERROR - Error processing callback for node 68d4a66ea5c2c05277bcf715: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:18:32,041 - lava_callback - INFO - Received callback for node 68d4a66fa5c2c05277bcf718 INFO: 172.21.0.1:40268 - "POST /node/68d4a66fa5c2c05277bcf718 HTTP/1.0" 202 Accepted 2025-09-27 02:18:32,047 - lava_callback - INFO - Starting async job submit for node 68d4a66fa5c2c05277bcf718 2025-09-27 02:18:32,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:32,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a66fa5c2c05277bcf718 HTTP/1.1" 200 None 2025-09-27 02:18:32,061 - lava_callback - DEBUG - Processing node 68d4a66fa5c2c05277bcf718: baseline-arm 2025-09-27 02:18:32,061 - lava_callback - ERROR - Error processing callback for node 68d4a66fa5c2c05277bcf718: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:18:32,683 - lava_callback - INFO - Received callback for node 68d4a670a5c2c05277bcf71b INFO: 172.21.0.1:40276 - "POST /node/68d4a670a5c2c05277bcf71b HTTP/1.0" 202 Accepted 2025-09-27 02:18:32,691 - lava_callback - INFO - Starting async job submit for node 68d4a670a5c2c05277bcf71b 2025-09-27 02:18:32,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:32,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a670a5c2c05277bcf71b HTTP/1.1" 200 None 2025-09-27 02:18:32,704 - lava_callback - DEBUG - Processing node 68d4a670a5c2c05277bcf71b: baseline-arm 2025-09-27 02:18:32,705 - lava_callback - ERROR - Error processing callback for node 68d4a670a5c2c05277bcf71b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:18:33,360 - lava_callback - INFO - Received callback for node 68d4a671a5c2c05277bcf71e INFO: 172.21.0.1:40280 - "POST /node/68d4a671a5c2c05277bcf71e HTTP/1.0" 202 Accepted 2025-09-27 02:18:33,366 - lava_callback - INFO - Starting async job submit for node 68d4a671a5c2c05277bcf71e 2025-09-27 02:18:33,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:18:33,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a671a5c2c05277bcf71e HTTP/1.1" 200 None 2025-09-27 02:18:33,380 - lava_callback - DEBUG - Processing node 68d4a671a5c2c05277bcf71e: baseline-arm 2025-09-27 02:18:33,380 - lava_callback - ERROR - Error processing callback for node 68d4a671a5c2c05277bcf71e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:19:06,362 - lava_callback - INFO - Received callback for node 68d5a82f2be2da466069a200 INFO: 172.21.0.1:46316 - "POST /node/68d5a82f2be2da466069a200 HTTP/1.0" 202 Accepted 2025-09-27 02:19:06,368 - lava_callback - INFO - Starting async job submit for node 68d5a82f2be2da466069a200 2025-09-27 02:19:06,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:19:06,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a82f2be2da466069a200 HTTP/1.1" 200 None 2025-09-27 02:19:06,401 - lava_callback - DEBUG - Processing node 68d5a82f2be2da466069a200: baseline-arm INFO: 172.21.0.1:46328 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:19:06,629 - lava_callback - ERROR - Error processing callback for node 68d5a82f2be2da466069a200: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:19:31,286 - lava_callback - INFO - Received callback for node 68d4a9dba5c2c05277bcf7ed INFO: 172.21.0.1:34986 - "POST /node/68d4a9dba5c2c05277bcf7ed HTTP/1.0" 202 Accepted 2025-09-27 02:19:31,293 - lava_callback - INFO - Starting async job submit for node 68d4a9dba5c2c05277bcf7ed 2025-09-27 02:19:31,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:19:31,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9dba5c2c05277bcf7ed HTTP/1.1" 200 None 2025-09-27 02:19:31,342 - lava_callback - DEBUG - Processing node 68d4a9dba5c2c05277bcf7ed: ltp-cap-bounds 2025-09-27 02:19:31,716 - lava_callback - ERROR - Error processing callback for node 68d4a9dba5c2c05277bcf7ed: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:20:28,845 - lava_callback - INFO - Received callback for node 68d74977a6a7b6615d4c4c0b INFO: 172.21.0.1:35944 - "POST /node/68d74977a6a7b6615d4c4c0b HTTP/1.0" 202 Accepted 2025-09-27 02:20:28,851 - lava_callback - INFO - Starting async job submit for node 68d74977a6a7b6615d4c4c0b 2025-09-27 02:20:28,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:20:28,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74977a6a7b6615d4c4c0b HTTP/1.1" 200 None 2025-09-27 02:20:28,886 - lava_callback - DEBUG - Processing node 68d74977a6a7b6615d4c4c0b: baseline-arm64-broonie 2025-09-27 02:20:29,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:20:29,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:20:29,376 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d74977a6a7b6615d4c4c0b/log.txt.gz 2025-09-27 02:20:29,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:20:29,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:20:29,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d74977a6a7b6615d4c4c0b/lava_callback.json.gz 2025-09-27 02:20:29,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:20:29,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74977a6a7b6615d4c4c0b HTTP/1.1" 200 None 2025-09-27 02:20:29,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:20:29,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:20:29,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:20:29,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74977a6a7b6615d4c4c0b HTTP/1.1" 200 None 2025-09-27 02:20:29,638 - lava_callback - INFO - Completed processing callback for node 68d74977a6a7b6615d4c4c0b 2025-09-27 02:20:31,514 - lava_callback - INFO - Received callback for node 68d4a891a5c2c05277bcf74e INFO: 172.21.0.1:46738 - "POST /node/68d4a891a5c2c05277bcf74e HTTP/1.0" 202 Accepted 2025-09-27 02:20:31,521 - lava_callback - INFO - Starting async job submit for node 68d4a891a5c2c05277bcf74e 2025-09-27 02:20:31,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:20:31,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a891a5c2c05277bcf74e HTTP/1.1" 200 None 2025-09-27 02:20:31,576 - lava_callback - DEBUG - Processing node 68d4a891a5c2c05277bcf74e: ltp-sched 2025-09-27 02:20:32,119 - lava_callback - ERROR - Error processing callback for node 68d4a891a5c2c05277bcf74e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:21:07,265 - lava_callback - INFO - Received callback for node 68d5a8312be2da466069a203 INFO: 172.21.0.1:52822 - "POST /node/68d5a8312be2da466069a203 HTTP/1.0" 202 Accepted 2025-09-27 02:21:07,271 - lava_callback - INFO - Starting async job submit for node 68d5a8312be2da466069a203 2025-09-27 02:21:07,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:21:07,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8312be2da466069a203 HTTP/1.1" 200 None 2025-09-27 02:21:07,306 - lava_callback - DEBUG - Processing node 68d5a8312be2da466069a203: baseline-arm 2025-09-27 02:21:07,605 - lava_callback - ERROR - Error processing callback for node 68d5a8312be2da466069a203: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:23:25,237 - lava_callback - INFO - Received callback for node 68d5a8322be2da466069a206 INFO: 172.21.0.1:54976 - "POST /node/68d5a8322be2da466069a206 HTTP/1.0" 202 Accepted 2025-09-27 02:23:25,243 - lava_callback - INFO - Starting async job submit for node 68d5a8322be2da466069a206 2025-09-27 02:23:25,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:23:25,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8322be2da466069a206 HTTP/1.1" 200 None 2025-09-27 02:23:25,281 - lava_callback - DEBUG - Processing node 68d5a8322be2da466069a206: baseline-arm 2025-09-27 02:23:25,572 - lava_callback - ERROR - Error processing callback for node 68d5a8322be2da466069a206: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55528 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:25:20,900 - lava_callback - INFO - Received callback for node 68d5a8732be2da466069a235 INFO: 172.21.0.1:33096 - "POST /node/68d5a8732be2da466069a235 HTTP/1.0" 202 Accepted 2025-09-27 02:25:20,906 - lava_callback - INFO - Starting async job submit for node 68d5a8732be2da466069a235 2025-09-27 02:25:20,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:25:20,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8732be2da466069a235 HTTP/1.1" 200 None 2025-09-27 02:25:20,961 - lava_callback - DEBUG - Processing node 68d5a8732be2da466069a235: baseline-arm 2025-09-27 02:25:21,205 - lava_callback - ERROR - Error processing callback for node 68d5a8732be2da466069a235: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:25:31,829 - lava_callback - INFO - Received callback for node 68d4a9dca5c2c05277bcf7f0 INFO: 172.21.0.1:40334 - "POST /node/68d4a9dca5c2c05277bcf7f0 HTTP/1.0" 202 Accepted 2025-09-27 02:25:31,836 - lava_callback - INFO - Starting async job submit for node 68d4a9dca5c2c05277bcf7f0 2025-09-27 02:25:31,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:25:31,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9dca5c2c05277bcf7f0 HTTP/1.1" 200 None 2025-09-27 02:25:31,953 - lava_callback - DEBUG - Processing node 68d4a9dca5c2c05277bcf7f0: ltp-containers 2025-09-27 02:25:32,838 - lava_callback - ERROR - Error processing callback for node 68d4a9dca5c2c05277bcf7f0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:26:31,574 - lava_callback - INFO - Received callback for node 68d4a84fa5c2c05277bcf736 INFO: 172.21.0.1:41712 - "POST /node/68d4a84fa5c2c05277bcf736 HTTP/1.0" 202 Accepted 2025-09-27 02:26:31,579 - lava_callback - INFO - Starting async job submit for node 68d4a84fa5c2c05277bcf736 2025-09-27 02:26:31,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:26:31,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a84fa5c2c05277bcf736 HTTP/1.1" 200 None 2025-09-27 02:26:31,593 - lava_callback - DEBUG - Processing node 68d4a84fa5c2c05277bcf736: baseline-arm 2025-09-27 02:26:31,593 - lava_callback - ERROR - Error processing callback for node 68d4a84fa5c2c05277bcf736: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:26:32,217 - lava_callback - INFO - Received callback for node 68d4a851a5c2c05277bcf739 INFO: 172.21.0.1:41720 - "POST /node/68d4a851a5c2c05277bcf739 HTTP/1.0" 202 Accepted 2025-09-27 02:26:32,223 - lava_callback - INFO - Starting async job submit for node 68d4a851a5c2c05277bcf739 2025-09-27 02:26:32,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:26:32,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a851a5c2c05277bcf739 HTTP/1.1" 200 None 2025-09-27 02:26:32,238 - lava_callback - DEBUG - Processing node 68d4a851a5c2c05277bcf739: baseline-arm 2025-09-27 02:26:32,238 - lava_callback - ERROR - Error processing callback for node 68d4a851a5c2c05277bcf739: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:26:32,867 - lava_callback - INFO - Received callback for node 68d4a851a5c2c05277bcf73c INFO: 172.21.0.1:41732 - "POST /node/68d4a851a5c2c05277bcf73c HTTP/1.0" 202 Accepted 2025-09-27 02:26:32,872 - lava_callback - INFO - Starting async job submit for node 68d4a851a5c2c05277bcf73c 2025-09-27 02:26:32,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:26:32,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a851a5c2c05277bcf73c HTTP/1.1" 200 None 2025-09-27 02:26:32,908 - lava_callback - DEBUG - Processing node 68d4a851a5c2c05277bcf73c: baseline-arm 2025-09-27 02:26:32,908 - lava_callback - ERROR - Error processing callback for node 68d4a851a5c2c05277bcf73c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:27:24,052 - lava_callback - INFO - Received callback for node 68d5a8742be2da466069a238 INFO: 172.21.0.1:45426 - "POST /node/68d5a8742be2da466069a238 HTTP/1.0" 202 Accepted 2025-09-27 02:27:24,058 - lava_callback - INFO - Starting async job submit for node 68d5a8742be2da466069a238 2025-09-27 02:27:24,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:27:24,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8742be2da466069a238 HTTP/1.1" 200 None 2025-09-27 02:27:24,092 - lava_callback - DEBUG - Processing node 68d5a8742be2da466069a238: baseline-arm 2025-09-27 02:27:24,322 - lava_callback - ERROR - Error processing callback for node 68d5a8742be2da466069a238: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:27:31,335 - lava_callback - INFO - Received callback for node 68d4a88ba5c2c05277bcf742 INFO: 172.21.0.1:33380 - "POST /node/68d4a88ba5c2c05277bcf742 HTTP/1.0" 202 Accepted 2025-09-27 02:27:31,341 - lava_callback - INFO - Starting async job submit for node 68d4a88ba5c2c05277bcf742 2025-09-27 02:27:31,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:27:31,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a88ba5c2c05277bcf742 HTTP/1.1" 200 None 2025-09-27 02:27:31,354 - lava_callback - DEBUG - Processing node 68d4a88ba5c2c05277bcf742: baseline-arm 2025-09-27 02:27:31,354 - lava_callback - ERROR - Error processing callback for node 68d4a88ba5c2c05277bcf742: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:27:31,992 - lava_callback - INFO - Received callback for node 68d4a88ba5c2c05277bcf745 INFO: 172.21.0.1:33386 - "POST /node/68d4a88ba5c2c05277bcf745 HTTP/1.0" 202 Accepted 2025-09-27 02:27:31,998 - lava_callback - INFO - Starting async job submit for node 68d4a88ba5c2c05277bcf745 2025-09-27 02:27:31,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:27:32,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a88ba5c2c05277bcf745 HTTP/1.1" 200 None 2025-09-27 02:27:32,023 - lava_callback - DEBUG - Processing node 68d4a88ba5c2c05277bcf745: baseline-arm 2025-09-27 02:27:32,023 - lava_callback - ERROR - Error processing callback for node 68d4a88ba5c2c05277bcf745: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:27:32,645 - lava_callback - INFO - Received callback for node 68d4a88da5c2c05277bcf748 INFO: 172.21.0.1:33392 - "POST /node/68d4a88da5c2c05277bcf748 HTTP/1.0" 202 Accepted 2025-09-27 02:27:32,650 - lava_callback - INFO - Starting async job submit for node 68d4a88da5c2c05277bcf748 2025-09-27 02:27:32,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:27:32,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a88da5c2c05277bcf748 HTTP/1.1" 200 None 2025-09-27 02:27:32,670 - lava_callback - DEBUG - Processing node 68d4a88da5c2c05277bcf748: baseline-arm 2025-09-27 02:27:32,670 - lava_callback - ERROR - Error processing callback for node 68d4a88da5c2c05277bcf748: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:27:33,321 - lava_callback - INFO - Received callback for node 68d4a88fa5c2c05277bcf74b INFO: 172.21.0.1:33402 - "POST /node/68d4a88fa5c2c05277bcf74b HTTP/1.0" 202 Accepted 2025-09-27 02:27:33,326 - lava_callback - INFO - Starting async job submit for node 68d4a88fa5c2c05277bcf74b 2025-09-27 02:27:33,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:27:33,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a88fa5c2c05277bcf74b HTTP/1.1" 200 None 2025-09-27 02:27:33,365 - lava_callback - DEBUG - Processing node 68d4a88fa5c2c05277bcf74b: baseline-arm 2025-09-27 02:27:33,365 - lava_callback - ERROR - Error processing callback for node 68d4a88fa5c2c05277bcf74b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:29:21,243 - lava_callback - INFO - Received callback for node 68d53c95b70fb2a1e20f22e9 INFO: 172.21.0.1:43544 - "POST /node/68d53c95b70fb2a1e20f22e9 HTTP/1.0" 202 Accepted 2025-09-27 02:29:21,249 - lava_callback - INFO - Starting async job submit for node 68d53c95b70fb2a1e20f22e9 2025-09-27 02:29:21,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:29:21,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53c95b70fb2a1e20f22e9 HTTP/1.1" 200 None 2025-09-27 02:29:21,282 - lava_callback - DEBUG - Processing node 68d53c95b70fb2a1e20f22e9: baseline-arm64 2025-09-27 02:29:21,635 - lava_callback - ERROR - Error processing callback for node 68d53c95b70fb2a1e20f22e9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:29:26,049 - lava_callback - INFO - Received callback for node 68d5a8752be2da466069a23b INFO: 172.21.0.1:43558 - "POST /node/68d5a8752be2da466069a23b HTTP/1.0" 202 Accepted 2025-09-27 02:29:26,055 - lava_callback - INFO - Starting async job submit for node 68d5a8752be2da466069a23b 2025-09-27 02:29:26,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:29:26,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8752be2da466069a23b HTTP/1.1" 200 None 2025-09-27 02:29:26,089 - lava_callback - DEBUG - Processing node 68d5a8752be2da466069a23b: baseline-arm 2025-09-27 02:29:26,314 - lava_callback - ERROR - Error processing callback for node 68d5a8752be2da466069a23b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43570 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:29:30,032 - lava_callback - INFO - Received callback for node 68d736eba6a7b6615d4c47e9 INFO: 172.21.0.1:43114 - "POST /node/68d736eba6a7b6615d4c47e9 HTTP/1.0" 202 Accepted 2025-09-27 02:29:30,038 - lava_callback - INFO - Starting async job submit for node 68d736eba6a7b6615d4c47e9 2025-09-27 02:29:30,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:29:30,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eba6a7b6615d4c47e9 HTTP/1.1" 200 None 2025-09-27 02:29:30,095 - lava_callback - DEBUG - Processing node 68d736eba6a7b6615d4c47e9: baseline-arm64-broonie 2025-09-27 02:29:30,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:29:30,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:29:30,472 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eba6a7b6615d4c47e9/log.txt.gz 2025-09-27 02:29:30,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:29:30,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:29:30,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eba6a7b6615d4c47e9/lava_callback.json.gz 2025-09-27 02:29:30,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:29:30,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eba6a7b6615d4c47e9 HTTP/1.1" 200 None 2025-09-27 02:29:30,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:29:30,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 02:29:30,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:29:30,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eba6a7b6615d4c47e9 HTTP/1.1" 200 None 2025-09-27 02:29:30,703 - lava_callback - INFO - Completed processing callback for node 68d736eba6a7b6615d4c47e9 INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:30:00,355 - lava_callback - INFO - Received callback for node 68d53c96b70fb2a1e20f22ec INFO: 172.21.0.1:39076 - "POST /node/68d53c96b70fb2a1e20f22ec HTTP/1.0" 202 Accepted 2025-09-27 02:30:00,361 - lava_callback - INFO - Starting async job submit for node 68d53c96b70fb2a1e20f22ec 2025-09-27 02:30:00,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:30:00,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53c96b70fb2a1e20f22ec HTTP/1.1" 200 None 2025-09-27 02:30:00,395 - lava_callback - DEBUG - Processing node 68d53c96b70fb2a1e20f22ec: baseline-arm64 2025-09-27 02:30:00,760 - lava_callback - ERROR - Error processing callback for node 68d53c96b70fb2a1e20f22ec: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49656 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:30:40,279 - lava_callback - INFO - Received callback for node 68d53c99b70fb2a1e20f22ef INFO: 172.21.0.1:56772 - "POST /node/68d53c99b70fb2a1e20f22ef HTTP/1.0" 202 Accepted 2025-09-27 02:30:40,286 - lava_callback - INFO - Starting async job submit for node 68d53c99b70fb2a1e20f22ef 2025-09-27 02:30:40,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:30:40,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53c99b70fb2a1e20f22ef HTTP/1.1" 200 None 2025-09-27 02:30:40,319 - lava_callback - DEBUG - Processing node 68d53c99b70fb2a1e20f22ef: baseline-arm64 2025-09-27 02:30:40,645 - lava_callback - ERROR - Error processing callback for node 68d53c99b70fb2a1e20f22ef: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:30:54,798 - lava_callback - INFO - Received callback for node 68d53c99b70fb2a1e20f22f2 INFO: 172.21.0.1:38508 - "POST /node/68d53c99b70fb2a1e20f22f2 HTTP/1.0" 202 Accepted 2025-09-27 02:30:54,805 - lava_callback - INFO - Starting async job submit for node 68d53c99b70fb2a1e20f22f2 2025-09-27 02:30:54,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:30:54,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53c99b70fb2a1e20f22f2 HTTP/1.1" 200 None 2025-09-27 02:30:54,842 - lava_callback - DEBUG - Processing node 68d53c99b70fb2a1e20f22f2: baseline-arm64 2025-09-27 02:30:55,181 - lava_callback - ERROR - Error processing callback for node 68d53c99b70fb2a1e20f22f2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38066 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:31:20,262 - lava_callback - INFO - Received callback for node 68d53cf3b70fb2a1e20f2373 INFO: 172.21.0.1:39618 - "POST /node/68d53cf3b70fb2a1e20f2373 HTTP/1.0" 202 Accepted 2025-09-27 02:31:20,268 - lava_callback - INFO - Starting async job submit for node 68d53cf3b70fb2a1e20f2373 2025-09-27 02:31:20,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:20,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53cf3b70fb2a1e20f2373 HTTP/1.1" 200 None 2025-09-27 02:31:20,303 - lava_callback - DEBUG - Processing node 68d53cf3b70fb2a1e20f2373: baseline-arm64 2025-09-27 02:31:20,657 - lava_callback - ERROR - Error processing callback for node 68d53cf3b70fb2a1e20f2373: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:31:26,633 - lava_callback - INFO - Received callback for node 68d5a8762be2da466069a23e INFO: 172.21.0.1:39640 - "POST /node/68d5a8762be2da466069a23e HTTP/1.0" 202 Accepted 2025-09-27 02:31:26,639 - lava_callback - INFO - Starting async job submit for node 68d5a8762be2da466069a23e 2025-09-27 02:31:26,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:26,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8762be2da466069a23e HTTP/1.1" 200 None 2025-09-27 02:31:26,673 - lava_callback - DEBUG - Processing node 68d5a8762be2da466069a23e: baseline-arm 2025-09-27 02:31:26,932 - lava_callback - ERROR - Error processing callback for node 68d5a8762be2da466069a23e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 02:31:29,540 - lava_callback - INFO - Received callback for node 68d73707a6a7b6615d4c4883 INFO: 172.21.0.1:42884 - "POST /node/68d73707a6a7b6615d4c4883 HTTP/1.0" 202 Accepted 2025-09-27 02:31:29,546 - lava_callback - INFO - Starting async job submit for node 68d73707a6a7b6615d4c4883 2025-09-27 02:31:29,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:29,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73707a6a7b6615d4c4883 HTTP/1.1" 200 None 2025-09-27 02:31:29,581 - lava_callback - DEBUG - Processing node 68d73707a6a7b6615d4c4883: baseline-arm64-broonie 2025-09-27 02:31:29,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:31:29,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:31:29,941 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73707a6a7b6615d4c4883/log.txt.gz 2025-09-27 02:31:29,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:31:30,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:31:30,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73707a6a7b6615d4c4883/lava_callback.json.gz 2025-09-27 02:31:30,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:30,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73707a6a7b6615d4c4883 HTTP/1.1" 200 None 2025-09-27 02:31:30,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:30,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:31:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:30,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73707a6a7b6615d4c4883 HTTP/1.1" 200 None 2025-09-27 02:31:30,179 - lava_callback - INFO - Completed processing callback for node 68d73707a6a7b6615d4c4883 INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:31:51,372 - lava_callback - INFO - Received callback for node 68d4a984a5c2c05277bcf775 INFO: 172.21.0.1:41554 - "POST /node/68d4a984a5c2c05277bcf775 HTTP/1.0" 202 Accepted 2025-09-27 02:31:51,377 - lava_callback - INFO - Starting async job submit for node 68d4a984a5c2c05277bcf775 2025-09-27 02:31:51,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:51,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a984a5c2c05277bcf775 HTTP/1.1" 200 None 2025-09-27 02:31:51,391 - lava_callback - DEBUG - Processing node 68d4a984a5c2c05277bcf775: baseline-arm 2025-09-27 02:31:51,391 - lava_callback - ERROR - Error processing callback for node 68d4a984a5c2c05277bcf775: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:31:52,032 - lava_callback - INFO - Received callback for node 68d4a984a5c2c05277bcf778 INFO: 172.21.0.1:41566 - "POST /node/68d4a984a5c2c05277bcf778 HTTP/1.0" 202 Accepted 2025-09-27 02:31:52,037 - lava_callback - INFO - Starting async job submit for node 68d4a984a5c2c05277bcf778 2025-09-27 02:31:52,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:52,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a984a5c2c05277bcf778 HTTP/1.1" 200 None 2025-09-27 02:31:52,058 - lava_callback - DEBUG - Processing node 68d4a984a5c2c05277bcf778: baseline-arm 2025-09-27 02:31:52,058 - lava_callback - ERROR - Error processing callback for node 68d4a984a5c2c05277bcf778: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:31:52,677 - lava_callback - INFO - Received callback for node 68d4a986a5c2c05277bcf77b INFO: 172.21.0.1:41580 - "POST /node/68d4a986a5c2c05277bcf77b HTTP/1.0" 202 Accepted 2025-09-27 02:31:52,682 - lava_callback - INFO - Starting async job submit for node 68d4a986a5c2c05277bcf77b 2025-09-27 02:31:52,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:52,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a986a5c2c05277bcf77b HTTP/1.1" 200 None 2025-09-27 02:31:52,715 - lava_callback - DEBUG - Processing node 68d4a986a5c2c05277bcf77b: baseline-arm 2025-09-27 02:31:52,715 - lava_callback - ERROR - Error processing callback for node 68d4a986a5c2c05277bcf77b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:31:53,314 - lava_callback - INFO - Received callback for node 68d4a987a5c2c05277bcf77e INFO: 172.21.0.1:41588 - "POST /node/68d4a987a5c2c05277bcf77e HTTP/1.0" 202 Accepted 2025-09-27 02:31:53,319 - lava_callback - INFO - Starting async job submit for node 68d4a987a5c2c05277bcf77e 2025-09-27 02:31:53,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:31:53,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a987a5c2c05277bcf77e HTTP/1.1" 200 None 2025-09-27 02:31:53,333 - lava_callback - DEBUG - Processing node 68d4a987a5c2c05277bcf77e: baseline-arm 2025-09-27 02:31:53,333 - lava_callback - ERROR - Error processing callback for node 68d4a987a5c2c05277bcf77e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:32:00,406 - lava_callback - INFO - Received callback for node 68d53cf3b70fb2a1e20f2376 INFO: 172.21.0.1:60006 - "POST /node/68d53cf3b70fb2a1e20f2376 HTTP/1.0" 202 Accepted 2025-09-27 02:32:00,412 - lava_callback - INFO - Starting async job submit for node 68d53cf3b70fb2a1e20f2376 2025-09-27 02:32:00,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:00,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53cf3b70fb2a1e20f2376 HTTP/1.1" 200 None 2025-09-27 02:32:00,467 - lava_callback - DEBUG - Processing node 68d53cf3b70fb2a1e20f2376: baseline-arm64 2025-09-27 02:32:00,812 - lava_callback - ERROR - Error processing callback for node 68d53cf3b70fb2a1e20f2376: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:32:09,586 - lava_callback - INFO - Received callback for node 68d736e0a6a7b6615d4c47a2 INFO: 172.21.0.1:58008 - "POST /node/68d736e0a6a7b6615d4c47a2 HTTP/1.0" 202 Accepted 2025-09-27 02:32:09,592 - lava_callback - INFO - Starting async job submit for node 68d736e0a6a7b6615d4c47a2 2025-09-27 02:32:09,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:09,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e0a6a7b6615d4c47a2 HTTP/1.1" 200 None 2025-09-27 02:32:09,627 - lava_callback - DEBUG - Processing node 68d736e0a6a7b6615d4c47a2: baseline-arm64 2025-09-27 02:32:09,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:32:09,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:32:09,985 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e0a6a7b6615d4c47a2/log.txt.gz 2025-09-27 02:32:09,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:32:10,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:32:10,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e0a6a7b6615d4c47a2/lava_callback.json.gz 2025-09-27 02:32:10,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:10,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e0a6a7b6615d4c47a2 HTTP/1.1" 200 None 2025-09-27 02:32:10,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:10,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 02:32:10,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:10,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e0a6a7b6615d4c47a2 HTTP/1.1" 200 None 2025-09-27 02:32:10,183 - lava_callback - INFO - Completed processing callback for node 68d736e0a6a7b6615d4c47a2 2025-09-27 02:32:12,578 - lava_callback - INFO - Received callback for node 68d53cf6b70fb2a1e20f2379 INFO: 172.21.0.1:58014 - "POST /node/68d53cf6b70fb2a1e20f2379 HTTP/1.0" 202 Accepted 2025-09-27 02:32:12,584 - lava_callback - INFO - Starting async job submit for node 68d53cf6b70fb2a1e20f2379 2025-09-27 02:32:12,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:12,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53cf6b70fb2a1e20f2379 HTTP/1.1" 200 None 2025-09-27 02:32:12,639 - lava_callback - DEBUG - Processing node 68d53cf6b70fb2a1e20f2379: baseline-arm64 2025-09-27 02:32:12,998 - lava_callback - ERROR - Error processing callback for node 68d53cf6b70fb2a1e20f2379: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:32:45,424 - lava_callback - INFO - Received callback for node 68d53cf7b70fb2a1e20f237c INFO: 172.21.0.1:60736 - "POST /node/68d53cf7b70fb2a1e20f237c HTTP/1.0" 202 Accepted 2025-09-27 02:32:45,431 - lava_callback - INFO - Starting async job submit for node 68d53cf7b70fb2a1e20f237c 2025-09-27 02:32:45,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:45,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53cf7b70fb2a1e20f237c HTTP/1.1" 200 None 2025-09-27 02:32:45,489 - lava_callback - DEBUG - Processing node 68d53cf7b70fb2a1e20f237c: baseline-arm64 2025-09-27 02:32:45,824 - lava_callback - ERROR - Error processing callback for node 68d53cf7b70fb2a1e20f237c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:32:51,981 - lava_callback - INFO - Received callback for node 68d4a9c1a5c2c05277bcf7ba INFO: 172.21.0.1:53962 - "POST /node/68d4a9c1a5c2c05277bcf7ba HTTP/1.0" 202 Accepted 2025-09-27 02:32:51,987 - lava_callback - INFO - Starting async job submit for node 68d4a9c1a5c2c05277bcf7ba 2025-09-27 02:32:51,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:51,992 - lava_callback - INFO - Received callback for node 68d4a9f8a5c2c05277bcf808 INFO: 172.21.0.1:53974 - "POST /node/68d4a9f8a5c2c05277bcf808 HTTP/1.0" 202 Accepted 2025-09-27 02:32:51,999 - lava_callback - INFO - Starting async job submit for node 68d4a9f8a5c2c05277bcf808 2025-09-27 02:32:52,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9c1a5c2c05277bcf7ba HTTP/1.1" 200 None 2025-09-27 02:32:52,046 - lava_callback - DEBUG - Processing node 68d4a9c1a5c2c05277bcf7ba: baseline-arm 2025-09-27 02:32:52,051 - lava_callback - ERROR - Error processing callback for node 68d4a9c1a5c2c05277bcf7ba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:32:52,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:52,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9f8a5c2c05277bcf808 HTTP/1.1" 200 None 2025-09-27 02:32:52,126 - lava_callback - DEBUG - Processing node 68d4a9f8a5c2c05277bcf808: ltp-fs-bind 2025-09-27 02:32:52,635 - lava_callback - INFO - Received callback for node 68d4a9c2a5c2c05277bcf7bd INFO: 172.21.0.1:53982 - "POST /node/68d4a9c2a5c2c05277bcf7bd HTTP/1.0" 202 Accepted 2025-09-27 02:32:52,651 - lava_callback - ERROR - Error processing callback for node 68d4a9f8a5c2c05277bcf808: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 02:32:52,651 - lava_callback - INFO - Starting async job submit for node 68d4a9c2a5c2c05277bcf7bd 2025-09-27 02:32:52,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:52,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9c2a5c2c05277bcf7bd HTTP/1.1" 200 None 2025-09-27 02:32:52,681 - lava_callback - DEBUG - Processing node 68d4a9c2a5c2c05277bcf7bd: baseline-arm 2025-09-27 02:32:52,681 - lava_callback - ERROR - Error processing callback for node 68d4a9c2a5c2c05277bcf7bd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:32:53,307 - lava_callback - INFO - Received callback for node 68d4a9c3a5c2c05277bcf7c0 INFO: 172.21.0.1:53990 - "POST /node/68d4a9c3a5c2c05277bcf7c0 HTTP/1.0" 202 Accepted 2025-09-27 02:32:53,312 - lava_callback - INFO - Starting async job submit for node 68d4a9c3a5c2c05277bcf7c0 2025-09-27 02:32:53,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:53,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9c3a5c2c05277bcf7c0 HTTP/1.1" 200 None 2025-09-27 02:32:53,362 - lava_callback - DEBUG - Processing node 68d4a9c3a5c2c05277bcf7c0: baseline-arm 2025-09-27 02:32:53,362 - lava_callback - ERROR - Error processing callback for node 68d4a9c3a5c2c05277bcf7c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:32:53,989 - lava_callback - INFO - Received callback for node 68d4a9c4a5c2c05277bcf7c3 INFO: 172.21.0.1:53998 - "POST /node/68d4a9c4a5c2c05277bcf7c3 HTTP/1.0" 202 Accepted 2025-09-27 02:32:53,995 - lava_callback - INFO - Starting async job submit for node 68d4a9c4a5c2c05277bcf7c3 2025-09-27 02:32:53,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:54,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9c4a5c2c05277bcf7c3 HTTP/1.1" 200 None 2025-09-27 02:32:54,028 - lava_callback - DEBUG - Processing node 68d4a9c4a5c2c05277bcf7c3: baseline-arm 2025-09-27 02:32:54,028 - lava_callback - ERROR - Error processing callback for node 68d4a9c4a5c2c05277bcf7c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:32:58,554 - lava_callback - INFO - Received callback for node 68d4a9cfa5c2c05277bcf7db INFO: 172.21.0.1:54016 - "POST /node/68d4a9cfa5c2c05277bcf7db HTTP/1.0" 202 Accepted 2025-09-27 02:32:58,559 - lava_callback - INFO - Starting async job submit for node 68d4a9cfa5c2c05277bcf7db 2025-09-27 02:32:58,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:32:58,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9cfa5c2c05277bcf7db HTTP/1.1" 200 None 2025-09-27 02:32:58,572 - lava_callback - DEBUG - Processing node 68d4a9cfa5c2c05277bcf7db: baseline-arm-broonie 2025-09-27 02:32:58,573 - lava_callback - ERROR - Error processing callback for node 68d4a9cfa5c2c05277bcf7db: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:33:07,476 - lava_callback - INFO - Received callback for node 68d736e5a6a7b6615d4c47bf INFO: 172.21.0.1:58790 - "POST /node/68d736e5a6a7b6615d4c47bf HTTP/1.0" 202 Accepted 2025-09-27 02:33:07,482 - lava_callback - INFO - Starting async job submit for node 68d736e5a6a7b6615d4c47bf 2025-09-27 02:33:07,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:07,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e5a6a7b6615d4c47bf HTTP/1.1" 200 None 2025-09-27 02:33:07,516 - lava_callback - DEBUG - Processing node 68d736e5a6a7b6615d4c47bf: baseline-arm64 2025-09-27 02:33:07,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:33:07,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:33:07,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e5a6a7b6615d4c47bf/log.txt.gz 2025-09-27 02:33:07,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:33:08,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:33:08,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e5a6a7b6615d4c47bf/lava_callback.json.gz 2025-09-27 02:33:08,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:08,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e5a6a7b6615d4c47bf HTTP/1.1" 200 None 2025-09-27 02:33:08,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:08,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 02:33:08,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:08,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e5a6a7b6615d4c47bf HTTP/1.1" 200 None 2025-09-27 02:33:08,138 - lava_callback - INFO - Completed processing callback for node 68d736e5a6a7b6615d4c47bf INFO: 172.21.0.1:56760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:33:38,518 - lava_callback - INFO - Received callback for node 68d4a9fca5c2c05277bcf80e INFO: 172.21.0.1:55292 - "POST /node/68d4a9fca5c2c05277bcf80e HTTP/1.0" 202 Accepted 2025-09-27 02:33:38,524 - lava_callback - INFO - Starting async job submit for node 68d4a9fca5c2c05277bcf80e 2025-09-27 02:33:38,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:38,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9fca5c2c05277bcf80e HTTP/1.1" 200 None 2025-09-27 02:33:38,559 - lava_callback - DEBUG - Processing node 68d4a9fca5c2c05277bcf80e: ltp-input 2025-09-27 02:33:38,559 - lava_callback - ERROR - Error processing callback for node 68d4a9fca5c2c05277bcf80e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:33:39,306 - lava_callback - INFO - Received callback for node 68d4a9fda5c2c05277bcf811 INFO: 172.21.0.1:33118 - "POST /node/68d4a9fda5c2c05277bcf811 HTTP/1.0" 202 Accepted 2025-09-27 02:33:39,312 - lava_callback - INFO - Starting async job submit for node 68d4a9fda5c2c05277bcf811 2025-09-27 02:33:39,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:39,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9fda5c2c05277bcf811 HTTP/1.1" 200 None 2025-09-27 02:33:39,325 - lava_callback - DEBUG - Processing node 68d4a9fda5c2c05277bcf811: ltp-ipc 2025-09-27 02:33:39,325 - lava_callback - ERROR - Error processing callback for node 68d4a9fda5c2c05277bcf811: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:33:40,031 - lava_callback - INFO - Received callback for node 68d4a9ffa5c2c05277bcf814 INFO: 172.21.0.1:33134 - "POST /node/68d4a9ffa5c2c05277bcf814 HTTP/1.0" 202 Accepted 2025-09-27 02:33:40,037 - lava_callback - INFO - Starting async job submit for node 68d4a9ffa5c2c05277bcf814 2025-09-27 02:33:40,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:40,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9ffa5c2c05277bcf814 HTTP/1.1" 200 None 2025-09-27 02:33:40,051 - lava_callback - DEBUG - Processing node 68d4a9ffa5c2c05277bcf814: ltp-pty 2025-09-27 02:33:40,051 - lava_callback - ERROR - Error processing callback for node 68d4a9ffa5c2c05277bcf814: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:33:40,857 - lava_callback - INFO - Received callback for node 68d4aa01a5c2c05277bcf817 INFO: 172.21.0.1:33138 - "POST /node/68d4aa01a5c2c05277bcf817 HTTP/1.0" 202 Accepted 2025-09-27 02:33:40,863 - lava_callback - INFO - Starting async job submit for node 68d4aa01a5c2c05277bcf817 2025-09-27 02:33:40,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:40,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4aa01a5c2c05277bcf817 HTTP/1.1" 200 None 2025-09-27 02:33:40,878 - lava_callback - DEBUG - Processing node 68d4aa01a5c2c05277bcf817: ltp-sched 2025-09-27 02:33:40,878 - lava_callback - ERROR - Error processing callback for node 68d4aa01a5c2c05277bcf817: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:33:41,597 - lava_callback - INFO - Received callback for node 68d4aa03a5c2c05277bcf81a INFO: 172.21.0.1:33146 - "POST /node/68d4aa03a5c2c05277bcf81a HTTP/1.0" 202 Accepted 2025-09-27 02:33:41,603 - lava_callback - INFO - Starting async job submit for node 68d4aa03a5c2c05277bcf81a 2025-09-27 02:33:41,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:41,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4aa03a5c2c05277bcf81a HTTP/1.1" 200 None 2025-09-27 02:33:41,616 - lava_callback - DEBUG - Processing node 68d4aa03a5c2c05277bcf81a: ltp-smoketest 2025-09-27 02:33:41,616 - lava_callback - ERROR - Error processing callback for node 68d4aa03a5c2c05277bcf81a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:33:42,358 - lava_callback - INFO - Received callback for node 68d4aa05a5c2c05277bcf81d INFO: 172.21.0.1:33152 - "POST /node/68d4aa05a5c2c05277bcf81d HTTP/1.0" 202 Accepted 2025-09-27 02:33:42,364 - lava_callback - INFO - Starting async job submit for node 68d4aa05a5c2c05277bcf81d 2025-09-27 02:33:42,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:42,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4aa05a5c2c05277bcf81d HTTP/1.1" 200 None 2025-09-27 02:33:42,378 - lava_callback - DEBUG - Processing node 68d4aa05a5c2c05277bcf81d: ltp-syscalls 2025-09-27 02:33:42,378 - lava_callback - ERROR - Error processing callback for node 68d4aa05a5c2c05277bcf81d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:33:58,863 - lava_callback - INFO - Received callback for node 68d4aa06a5c2c05277bcf820 INFO: 172.21.0.1:35998 - "POST /node/68d4aa06a5c2c05277bcf820 HTTP/1.0" 202 Accepted 2025-09-27 02:33:58,870 - lava_callback - INFO - Starting async job submit for node 68d4aa06a5c2c05277bcf820 2025-09-27 02:33:58,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:58,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4aa06a5c2c05277bcf820 HTTP/1.1" 200 None 2025-09-27 02:33:58,883 - lava_callback - DEBUG - Processing node 68d4aa06a5c2c05277bcf820: ltp-syscalls-ipc 2025-09-27 02:33:58,883 - lava_callback - ERROR - Error processing callback for node 68d4aa06a5c2c05277bcf820: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:33:59,638 - lava_callback - INFO - Received callback for node 68d4aa08a5c2c05277bcf823 INFO: 172.21.0.1:51452 - "POST /node/68d4aa08a5c2c05277bcf823 HTTP/1.0" 202 Accepted 2025-09-27 02:33:59,644 - lava_callback - INFO - Starting async job submit for node 68d4aa08a5c2c05277bcf823 2025-09-27 02:33:59,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:33:59,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4aa08a5c2c05277bcf823 HTTP/1.1" 200 None 2025-09-27 02:33:59,680 - lava_callback - DEBUG - Processing node 68d4aa08a5c2c05277bcf823: ltp-timers 2025-09-27 02:33:59,680 - lava_callback - ERROR - Error processing callback for node 68d4aa08a5c2c05277bcf823: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 02:34:00,470 - lava_callback - INFO - Received callback for node 68d4aa0aa5c2c05277bcf826 INFO: 172.21.0.1:51460 - "POST /node/68d4aa0aa5c2c05277bcf826 HTTP/1.0" 202 Accepted 2025-09-27 02:34:00,476 - lava_callback - INFO - Starting async job submit for node 68d4aa0aa5c2c05277bcf826 2025-09-27 02:34:00,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:00,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4aa0aa5c2c05277bcf826 HTTP/1.1" 200 None 2025-09-27 02:34:00,501 - lava_callback - DEBUG - Processing node 68d4aa0aa5c2c05277bcf826: ltp-watchqueue 2025-09-27 02:34:00,501 - lava_callback - ERROR - Error processing callback for node 68d4aa0aa5c2c05277bcf826: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:51464 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:34:09,536 - lava_callback - INFO - Received callback for node 68d73705a6a7b6615d4c487d INFO: 172.21.0.1:47914 - "POST /node/68d73705a6a7b6615d4c487d HTTP/1.0" 202 Accepted 2025-09-27 02:34:09,542 - lava_callback - INFO - Starting async job submit for node 68d73705a6a7b6615d4c487d 2025-09-27 02:34:09,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:09,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73705a6a7b6615d4c487d HTTP/1.1" 200 None 2025-09-27 02:34:09,575 - lava_callback - DEBUG - Processing node 68d73705a6a7b6615d4c487d: baseline-arm64 2025-09-27 02:34:09,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:34:09,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:34:09,989 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73705a6a7b6615d4c487d/log.txt.gz 2025-09-27 02:34:09,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:34:10,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:34:10,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73705a6a7b6615d4c487d/lava_callback.json.gz 2025-09-27 02:34:10,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:10,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73705a6a7b6615d4c487d HTTP/1.1" 200 None 2025-09-27 02:34:10,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:10,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:34:10,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:10,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73705a6a7b6615d4c487d HTTP/1.1" 200 None 2025-09-27 02:34:10,257 - lava_callback - INFO - Completed processing callback for node 68d73705a6a7b6615d4c487d 2025-09-27 02:34:10,777 - lava_callback - INFO - Received callback for node 68d73701a6a7b6615d4c4861 INFO: 172.21.0.1:47926 - "POST /node/68d73701a6a7b6615d4c4861 HTTP/1.0" 202 Accepted 2025-09-27 02:34:10,783 - lava_callback - INFO - Starting async job submit for node 68d73701a6a7b6615d4c4861 2025-09-27 02:34:10,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:10,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73701a6a7b6615d4c4861 HTTP/1.1" 200 None 2025-09-27 02:34:10,827 - lava_callback - DEBUG - Processing node 68d73701a6a7b6615d4c4861: baseline-arm64 2025-09-27 02:34:11,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:34:11,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:34:11,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73701a6a7b6615d4c4861/log.txt.gz 2025-09-27 02:34:11,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:34:11,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:34:11,369 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73701a6a7b6615d4c4861/lava_callback.json.gz 2025-09-27 02:34:11,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:11,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73701a6a7b6615d4c4861 HTTP/1.1" 200 None 2025-09-27 02:34:11,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:11,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:34:11,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:34:11,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73701a6a7b6615d4c4861 HTTP/1.1" 200 None 2025-09-27 02:34:11,448 - lava_callback - INFO - Completed processing callback for node 68d73701a6a7b6615d4c4861 INFO: 172.21.0.1:47938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:37:12,162 - lava_callback - INFO - Received callback for node 68d4a9faa5c2c05277bcf80b INFO: 172.21.0.1:49594 - "POST /node/68d4a9faa5c2c05277bcf80b HTTP/1.0" 202 Accepted 2025-09-27 02:37:12,169 - lava_callback - INFO - Starting async job submit for node 68d4a9faa5c2c05277bcf80b 2025-09-27 02:37:12,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:37:12,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9faa5c2c05277bcf80b HTTP/1.1" 200 None 2025-09-27 02:37:12,210 - lava_callback - DEBUG - Processing node 68d4a9faa5c2c05277bcf80b: ltp-fsx 2025-09-27 02:37:12,439 - lava_callback - INFO - Received callback for node 68d5562bb70fb2a1e20f2638 INFO: 172.21.0.1:49606 - "POST /node/68d5562bb70fb2a1e20f2638 HTTP/1.0" 202 Accepted 2025-09-27 02:37:12,461 - lava_callback - INFO - Starting async job submit for node 68d5562bb70fb2a1e20f2638 2025-09-27 02:37:12,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:37:12,567 - lava_callback - ERROR - Error processing callback for node 68d4a9faa5c2c05277bcf80b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 02:37:12,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5562bb70fb2a1e20f2638 HTTP/1.1" 200 None 2025-09-27 02:37:12,571 - lava_callback - DEBUG - Processing node 68d5562bb70fb2a1e20f2638: baseline-arm64 2025-09-27 02:37:12,964 - lava_callback - ERROR - Error processing callback for node 68d5562bb70fb2a1e20f2638: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:38:29,065 - lava_callback - INFO - Received callback for node 68d4a84ea5c2c05277bcf733 INFO: 172.21.0.1:38542 - "POST /node/68d4a84ea5c2c05277bcf733 HTTP/1.0" 202 Accepted 2025-09-27 02:38:29,071 - lava_callback - INFO - Starting async job submit for node 68d4a84ea5c2c05277bcf733 2025-09-27 02:38:29,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:38:29,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a84ea5c2c05277bcf733 HTTP/1.1" 200 None 2025-09-27 02:38:29,113 - lava_callback - DEBUG - Processing node 68d4a84ea5c2c05277bcf733: baseline-arm 2025-09-27 02:38:29,372 - lava_callback - ERROR - Error processing callback for node 68d4a84ea5c2c05277bcf733: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 02:38:35,061 - lava_callback - INFO - Received callback for node 68d5562bb70fb2a1e20f263b INFO: 172.21.0.1:52026 - "POST /node/68d5562bb70fb2a1e20f263b HTTP/1.0" 202 Accepted 2025-09-27 02:38:35,068 - lava_callback - INFO - Starting async job submit for node 68d5562bb70fb2a1e20f263b 2025-09-27 02:38:35,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:38:35,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5562bb70fb2a1e20f263b HTTP/1.1" 200 None 2025-09-27 02:38:35,102 - lava_callback - DEBUG - Processing node 68d5562bb70fb2a1e20f263b: baseline-arm64 2025-09-27 02:38:35,467 - lava_callback - ERROR - Error processing callback for node 68d5562bb70fb2a1e20f263b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:38:51,528 - lava_callback - INFO - Received callback for node 68d4a9dea5c2c05277bcf7f3 INFO: 172.21.0.1:51196 - "POST /node/68d4a9dea5c2c05277bcf7f3 HTTP/1.0" 202 Accepted 2025-09-27 02:38:51,540 - lava_callback - INFO - Starting async job submit for node 68d4a9dea5c2c05277bcf7f3 2025-09-27 02:38:51,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:38:51,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9dea5c2c05277bcf7f3 HTTP/1.1" 200 None 2025-09-27 02:38:51,919 - lava_callback - DEBUG - Processing node 68d4a9dea5c2c05277bcf7f3: ltp-controllers 2025-09-27 02:38:54,785 - lava_callback - ERROR - Error processing callback for node 68d4a9dea5c2c05277bcf7f3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:39:43,513 - lava_callback - INFO - Received callback for node 68d5564ab70fb2a1e20f266e INFO: 172.21.0.1:52944 - "POST /node/68d5564ab70fb2a1e20f266e HTTP/1.0" 202 Accepted 2025-09-27 02:39:43,520 - lava_callback - INFO - Starting async job submit for node 68d5564ab70fb2a1e20f266e 2025-09-27 02:39:43,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:39:43,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5564ab70fb2a1e20f266e HTTP/1.1" 200 None 2025-09-27 02:39:43,553 - lava_callback - DEBUG - Processing node 68d5564ab70fb2a1e20f266e: baseline-arm64 2025-09-27 02:39:43,889 - lava_callback - ERROR - Error processing callback for node 68d5564ab70fb2a1e20f266e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:39:49,411 - lava_callback - INFO - Received callback for node 68d5564bb70fb2a1e20f2671 INFO: 172.21.0.1:48698 - "POST /node/68d5564bb70fb2a1e20f2671 HTTP/1.0" 202 Accepted 2025-09-27 02:39:49,418 - lava_callback - INFO - Starting async job submit for node 68d5564bb70fb2a1e20f2671 2025-09-27 02:39:49,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:39:49,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5564bb70fb2a1e20f2671 HTTP/1.1" 200 None 2025-09-27 02:39:49,460 - lava_callback - DEBUG - Processing node 68d5564bb70fb2a1e20f2671: baseline-arm64 2025-09-27 02:39:49,787 - lava_callback - ERROR - Error processing callback for node 68d5564bb70fb2a1e20f2671: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:40:27,068 - lava_callback - INFO - Received callback for node 68d556a7b70fb2a1e20f270f INFO: 172.21.0.1:59992 - "POST /node/68d556a7b70fb2a1e20f270f HTTP/1.0" 202 Accepted 2025-09-27 02:40:27,076 - lava_callback - INFO - Starting async job submit for node 68d556a7b70fb2a1e20f270f 2025-09-27 02:40:27,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:40:27,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d556a7b70fb2a1e20f270f HTTP/1.1" 200 None 2025-09-27 02:40:27,110 - lava_callback - DEBUG - Processing node 68d556a7b70fb2a1e20f270f: baseline-arm64 2025-09-27 02:40:28,012 - lava_callback - ERROR - Error processing callback for node 68d556a7b70fb2a1e20f270f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:40:59,568 - lava_callback - INFO - Received callback for node 68d556c4b70fb2a1e20f2745 INFO: 172.21.0.1:44098 - "POST /node/68d556c4b70fb2a1e20f2745 HTTP/1.0" 202 Accepted 2025-09-27 02:40:59,574 - lava_callback - INFO - Starting async job submit for node 68d556c4b70fb2a1e20f2745 2025-09-27 02:40:59,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:40:59,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d556c4b70fb2a1e20f2745 HTTP/1.1" 200 None 2025-09-27 02:40:59,608 - lava_callback - DEBUG - Processing node 68d556c4b70fb2a1e20f2745: baseline-arm64 2025-09-27 02:40:59,917 - lava_callback - ERROR - Error processing callback for node 68d556c4b70fb2a1e20f2745: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:41:44,763 - lava_callback - INFO - Received callback for node 68d556c5b70fb2a1e20f2748 INFO: 172.21.0.1:60258 - "POST /node/68d556c5b70fb2a1e20f2748 HTTP/1.0" 202 Accepted 2025-09-27 02:41:44,769 - lava_callback - INFO - Starting async job submit for node 68d556c5b70fb2a1e20f2748 2025-09-27 02:41:44,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:41:44,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d556c5b70fb2a1e20f2748 HTTP/1.1" 200 None 2025-09-27 02:41:44,820 - lava_callback - DEBUG - Processing node 68d556c5b70fb2a1e20f2748: baseline-arm64 2025-09-27 02:41:45,119 - lava_callback - ERROR - Error processing callback for node 68d556c5b70fb2a1e20f2748: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:42:12,502 - lava_callback - INFO - Received callback for node 68d4a9e0a5c2c05277bcf7f6 INFO: 172.21.0.1:55880 - "POST /node/68d4a9e0a5c2c05277bcf7f6 HTTP/1.0" 202 Accepted 2025-09-27 02:42:12,510 - lava_callback - INFO - Starting async job submit for node 68d4a9e0a5c2c05277bcf7f6 2025-09-27 02:42:12,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:42:12,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4a9e0a5c2c05277bcf7f6 HTTP/1.1" 200 None 2025-09-27 02:42:12,627 - lava_callback - DEBUG - Processing node 68d4a9e0a5c2c05277bcf7f6: ltp-cve 2025-09-27 02:42:13,337 - lava_callback - ERROR - Error processing callback for node 68d4a9e0a5c2c05277bcf7f6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:42:20,953 - lava_callback - INFO - Received callback for node 68d56f632be2da46606993cf INFO: 172.21.0.1:59038 - "POST /node/68d56f632be2da46606993cf HTTP/1.0" 202 Accepted 2025-09-27 02:42:20,959 - lava_callback - INFO - Starting async job submit for node 68d56f632be2da46606993cf 2025-09-27 02:42:20,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:42:20,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56f632be2da46606993cf HTTP/1.1" 200 None 2025-09-27 02:42:20,994 - lava_callback - DEBUG - Processing node 68d56f632be2da46606993cf: baseline-arm64 2025-09-27 02:42:21,371 - lava_callback - ERROR - Error processing callback for node 68d56f632be2da46606993cf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 02:42:24,837 - lava_callback - INFO - Received callback for node 68d556a7b70fb2a1e20f2712 INFO: 172.21.0.1:59054 - "POST /node/68d556a7b70fb2a1e20f2712 HTTP/1.0" 202 Accepted 2025-09-27 02:42:24,914 - lava_callback - INFO - Starting async job submit for node 68d556a7b70fb2a1e20f2712 2025-09-27 02:42:24,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:42:24,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d556a7b70fb2a1e20f2712 HTTP/1.1" 200 None 2025-09-27 02:42:24,947 - lava_callback - DEBUG - Processing node 68d556a7b70fb2a1e20f2712: baseline-arm64 INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:42:49,489 - lava_callback - ERROR - Error processing callback for node 68d556a7b70fb2a1e20f2712: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:43:05,230 - lava_callback - INFO - Received callback for node 68d56f6c2be2da46606993ea INFO: 172.21.0.1:54312 - "POST /node/68d56f6c2be2da46606993ea HTTP/1.0" 202 Accepted 2025-09-27 02:43:05,236 - lava_callback - INFO - Starting async job submit for node 68d56f6c2be2da46606993ea 2025-09-27 02:43:05,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:43:05,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56f6c2be2da46606993ea HTTP/1.1" 200 None 2025-09-27 02:43:05,281 - lava_callback - DEBUG - Processing node 68d56f6c2be2da46606993ea: baseline-arm64 2025-09-27 02:43:05,618 - lava_callback - ERROR - Error processing callback for node 68d56f6c2be2da46606993ea: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:43:38,156 - lava_callback - INFO - Received callback for node 68d575522be2da4660699734 INFO: 172.21.0.1:47944 - "POST /node/68d575522be2da4660699734 HTTP/1.0" 202 Accepted 2025-09-27 02:43:38,162 - lava_callback - INFO - Starting async job submit for node 68d575522be2da4660699734 2025-09-27 02:43:38,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:43:38,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d575522be2da4660699734 HTTP/1.1" 200 None 2025-09-27 02:43:38,195 - lava_callback - DEBUG - Processing node 68d575522be2da4660699734: baseline-arm64 2025-09-27 02:43:38,526 - lava_callback - ERROR - Error processing callback for node 68d575522be2da4660699734: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59340 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:44:25,950 - lava_callback - INFO - Received callback for node 68d575592be2da466069974f INFO: 172.21.0.1:33410 - "POST /node/68d575592be2da466069974f HTTP/1.0" 202 Accepted 2025-09-27 02:44:25,957 - lava_callback - INFO - Starting async job submit for node 68d575592be2da466069974f 2025-09-27 02:44:25,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:44:26,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d575592be2da466069974f HTTP/1.1" 200 None 2025-09-27 02:44:26,025 - lava_callback - DEBUG - Processing node 68d575592be2da466069974f: baseline-arm64 2025-09-27 02:44:26,359 - lava_callback - ERROR - Error processing callback for node 68d575592be2da466069974f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:48:22,225 - lava_callback - INFO - Received callback for node 68d5c2be2be2da466069a61b INFO: 172.21.0.1:60546 - "POST /node/68d5c2be2be2da466069a61b HTTP/1.0" 202 Accepted 2025-09-27 02:48:22,231 - lava_callback - INFO - Starting async job submit for node 68d5c2be2be2da466069a61b 2025-09-27 02:48:22,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:48:22,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2be2be2da466069a61b HTTP/1.1" 200 None 2025-09-27 02:48:22,266 - lava_callback - DEBUG - Processing node 68d5c2be2be2da466069a61b: baseline-arm 2025-09-27 02:48:22,492 - lava_callback - ERROR - Error processing callback for node 68d5c2be2be2da466069a61b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:48:31,271 - lava_callback - INFO - Received callback for node 68d736eaa6a7b6615d4c47e6 INFO: 172.21.0.1:48938 - "POST /node/68d736eaa6a7b6615d4c47e6 HTTP/1.0" 202 Accepted 2025-09-27 02:48:31,276 - lava_callback - INFO - Starting async job submit for node 68d736eaa6a7b6615d4c47e6 2025-09-27 02:48:31,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:48:31,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eaa6a7b6615d4c47e6 HTTP/1.1" 200 None 2025-09-27 02:48:31,310 - lava_callback - DEBUG - Processing node 68d736eaa6a7b6615d4c47e6: baseline-arm64-broonie 2025-09-27 02:48:31,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:48:31,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:48:31,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eaa6a7b6615d4c47e6/log.txt.gz 2025-09-27 02:48:31,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:48:31,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:48:31,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eaa6a7b6615d4c47e6/lava_callback.json.gz 2025-09-27 02:48:31,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:48:31,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eaa6a7b6615d4c47e6 HTTP/1.1" 200 None 2025-09-27 02:48:31,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:48:31,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 02:48:31,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:48:31,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eaa6a7b6615d4c47e6 HTTP/1.1" 200 None 2025-09-27 02:48:31,891 - lava_callback - INFO - Completed processing callback for node 68d736eaa6a7b6615d4c47e6 INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42832 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:50:10,607 - lava_callback - INFO - Received callback for node 68d73706a6a7b6615d4c4880 INFO: 172.21.0.1:58522 - "POST /node/68d73706a6a7b6615d4c4880 HTTP/1.0" 202 Accepted 2025-09-27 02:50:10,613 - lava_callback - INFO - Starting async job submit for node 68d73706a6a7b6615d4c4880 2025-09-27 02:50:10,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:50:10,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73706a6a7b6615d4c4880 HTTP/1.1" 200 None 2025-09-27 02:50:10,670 - lava_callback - DEBUG - Processing node 68d73706a6a7b6615d4c4880: baseline-arm64-broonie 2025-09-27 02:50:10,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:50:11,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:50:11,037 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73706a6a7b6615d4c4880/log.txt.gz 2025-09-27 02:50:11,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 02:50:11,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 02:50:11,192 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73706a6a7b6615d4c4880/lava_callback.json.gz 2025-09-27 02:50:11,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:50:11,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73706a6a7b6615d4c4880 HTTP/1.1" 200 None 2025-09-27 02:50:11,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:50:11,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 02:50:11,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:50:11,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73706a6a7b6615d4c4880 HTTP/1.1" 200 None 2025-09-27 02:50:11,275 - lava_callback - INFO - Completed processing callback for node 68d73706a6a7b6615d4c4880 INFO: 172.21.0.1:58538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:51:25,572 - lava_callback - INFO - Received callback for node 68d5c2bf2be2da466069a61e INFO: 172.21.0.1:50280 - "POST /node/68d5c2bf2be2da466069a61e HTTP/1.0" 202 Accepted 2025-09-27 02:51:25,580 - lava_callback - INFO - Starting async job submit for node 68d5c2bf2be2da466069a61e 2025-09-27 02:51:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:51:25,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2bf2be2da466069a61e HTTP/1.1" 200 None 2025-09-27 02:51:25,622 - lava_callback - DEBUG - Processing node 68d5c2bf2be2da466069a61e: baseline-arm 2025-09-27 02:51:25,946 - lava_callback - ERROR - Error processing callback for node 68d5c2bf2be2da466069a61e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:53:31,471 - lava_callback - INFO - Received callback for node 68d5c2c72be2da466069a633 INFO: 172.21.0.1:43696 - "POST /node/68d5c2c72be2da466069a633 HTTP/1.0" 202 Accepted 2025-09-27 02:53:31,480 - lava_callback - INFO - Starting async job submit for node 68d5c2c72be2da466069a633 2025-09-27 02:53:31,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:53:31,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2c72be2da466069a633 HTTP/1.1" 200 None 2025-09-27 02:53:31,520 - lava_callback - DEBUG - Processing node 68d5c2c72be2da466069a633: baseline-arm 2025-09-27 02:53:31,802 - lava_callback - ERROR - Error processing callback for node 68d5c2c72be2da466069a633: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:56:13,011 - lava_callback - INFO - Received callback for node 68d4ab5fa5c2c05277bcf82a INFO: 172.21.0.1:54768 - "POST /node/68d4ab5fa5c2c05277bcf82a HTTP/1.0" 202 Accepted 2025-09-27 02:56:13,019 - lava_callback - INFO - Starting async job submit for node 68d4ab5fa5c2c05277bcf82a 2025-09-27 02:56:13,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:56:13,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ab5fa5c2c05277bcf82a HTTP/1.1" 200 None 2025-09-27 02:56:13,060 - lava_callback - DEBUG - Processing node 68d4ab5fa5c2c05277bcf82a: ltp-syscalls-ipc 2025-09-27 02:56:13,953 - lava_callback - ERROR - Error processing callback for node 68d4ab5fa5c2c05277bcf82a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:56:41,605 - lava_callback - INFO - Received callback for node 68d5c2c72be2da466069a636 INFO: 172.21.0.1:54722 - "POST /node/68d5c2c72be2da466069a636 HTTP/1.0" 202 Accepted 2025-09-27 02:56:41,611 - lava_callback - INFO - Starting async job submit for node 68d5c2c72be2da466069a636 2025-09-27 02:56:41,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:56:41,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2c72be2da466069a636 HTTP/1.1" 200 None 2025-09-27 02:56:41,650 - lava_callback - DEBUG - Processing node 68d5c2c72be2da466069a636: baseline-arm 2025-09-27 02:56:41,901 - lava_callback - ERROR - Error processing callback for node 68d5c2c72be2da466069a636: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK 2025-09-27 02:59:06,633 - lava_callback - INFO - Received callback for node 68d5c5942be2da466069a78e INFO: 172.21.0.1:35594 - "POST /node/68d5c5942be2da466069a78e HTTP/1.0" 202 Accepted 2025-09-27 02:59:06,639 - lava_callback - INFO - Starting async job submit for node 68d5c5942be2da466069a78e 2025-09-27 02:59:06,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 02:59:06,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5942be2da466069a78e HTTP/1.1" 200 None 2025-09-27 02:59:06,673 - lava_callback - DEBUG - Processing node 68d5c5942be2da466069a78e: baseline-arm 2025-09-27 02:59:06,899 - lava_callback - ERROR - Error processing callback for node 68d5c5942be2da466069a78e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:01:08,682 - lava_callback - INFO - Received callback for node 68d5c5942be2da466069a791 INFO: 172.21.0.1:40722 - "POST /node/68d5c5942be2da466069a791 HTTP/1.0" 202 Accepted 2025-09-27 03:01:08,688 - lava_callback - INFO - Starting async job submit for node 68d5c5942be2da466069a791 2025-09-27 03:01:08,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:01:08,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5942be2da466069a791 HTTP/1.1" 200 None 2025-09-27 03:01:08,844 - lava_callback - DEBUG - Processing node 68d5c5942be2da466069a791: baseline-arm 2025-09-27 03:01:09,069 - lava_callback - ERROR - Error processing callback for node 68d5c5942be2da466069a791: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:03:26,847 - lava_callback - INFO - Received callback for node 68d5c59d2be2da466069a7a6 INFO: 172.21.0.1:60024 - "POST /node/68d5c59d2be2da466069a7a6 HTTP/1.0" 202 Accepted 2025-09-27 03:03:26,853 - lava_callback - INFO - Starting async job submit for node 68d5c59d2be2da466069a7a6 2025-09-27 03:03:26,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:03:26,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c59d2be2da466069a7a6 HTTP/1.1" 200 None 2025-09-27 03:03:26,907 - lava_callback - DEBUG - Processing node 68d5c59d2be2da466069a7a6: baseline-arm 2025-09-27 03:03:27,136 - lava_callback - ERROR - Error processing callback for node 68d5c59d2be2da466069a7a6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:05:47,004 - lava_callback - INFO - Received callback for node 68d5c59d2be2da466069a7a9 INFO: 172.21.0.1:33520 - "POST /node/68d5c59d2be2da466069a7a9 HTTP/1.0" 202 Accepted 2025-09-27 03:05:47,009 - lava_callback - INFO - Starting async job submit for node 68d5c59d2be2da466069a7a9 2025-09-27 03:05:47,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:05:47,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c59d2be2da466069a7a9 HTTP/1.1" 200 None 2025-09-27 03:05:47,088 - lava_callback - DEBUG - Processing node 68d5c59d2be2da466069a7a9: baseline-arm 2025-09-27 03:05:47,318 - lava_callback - ERROR - Error processing callback for node 68d5c59d2be2da466069a7a9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:07:53,642 - lava_callback - INFO - Received callback for node 68d5c82c2be2da466069a85f INFO: 172.21.0.1:35528 - "POST /node/68d5c82c2be2da466069a85f HTTP/1.0" 202 Accepted 2025-09-27 03:07:53,648 - lava_callback - INFO - Starting async job submit for node 68d5c82c2be2da466069a85f 2025-09-27 03:07:53,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:07:53,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c82c2be2da466069a85f HTTP/1.1" 200 None 2025-09-27 03:07:53,685 - lava_callback - DEBUG - Processing node 68d5c82c2be2da466069a85f: baseline-arm 2025-09-27 03:07:53,914 - lava_callback - ERROR - Error processing callback for node 68d5c82c2be2da466069a85f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:09:54,622 - lava_callback - INFO - Received callback for node 68d5765b2be2da4660699896 INFO: 172.21.0.1:57182 - "POST /node/68d5765b2be2da4660699896 HTTP/1.0" 202 Accepted 2025-09-27 03:09:54,629 - lava_callback - INFO - Starting async job submit for node 68d5765b2be2da4660699896 2025-09-27 03:09:54,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:09:54,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5765b2be2da4660699896 HTTP/1.1" 200 None 2025-09-27 03:09:54,683 - lava_callback - DEBUG - Processing node 68d5765b2be2da4660699896: baseline-arm64 2025-09-27 03:09:55,530 - lava_callback - ERROR - Error processing callback for node 68d5765b2be2da4660699896: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:10:08,320 - lava_callback - INFO - Received callback for node 68d5c82c2be2da466069a862 INFO: 172.21.0.1:47020 - "POST /node/68d5c82c2be2da466069a862 HTTP/1.0" 202 Accepted 2025-09-27 03:10:08,325 - lava_callback - INFO - Starting async job submit for node 68d5c82c2be2da466069a862 2025-09-27 03:10:08,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:10:08,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c82c2be2da466069a862 HTTP/1.1" 200 None 2025-09-27 03:10:08,359 - lava_callback - DEBUG - Processing node 68d5c82c2be2da466069a862: baseline-arm 2025-09-27 03:10:08,589 - lava_callback - ERROR - Error processing callback for node 68d5c82c2be2da466069a862: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:11:34,187 - lava_callback - INFO - Received callback for node 68d5765b2be2da4660699899 INFO: 172.21.0.1:39872 - "POST /node/68d5765b2be2da4660699899 HTTP/1.0" 202 Accepted 2025-09-27 03:11:34,194 - lava_callback - INFO - Starting async job submit for node 68d5765b2be2da4660699899 2025-09-27 03:11:34,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:11:34,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5765b2be2da4660699899 HTTP/1.1" 200 None 2025-09-27 03:11:34,293 - lava_callback - DEBUG - Processing node 68d5765b2be2da4660699899: baseline-arm64 2025-09-27 03:11:35,143 - lava_callback - ERROR - Error processing callback for node 68d5765b2be2da4660699899: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:12:04,205 - lava_callback - INFO - Received callback for node 68d576792be2da46606998cc INFO: 172.21.0.1:48540 - "POST /node/68d576792be2da46606998cc HTTP/1.0" 202 Accepted 2025-09-27 03:12:04,212 - lava_callback - INFO - Starting async job submit for node 68d576792be2da46606998cc 2025-09-27 03:12:04,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:12:04,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576792be2da46606998cc HTTP/1.1" 200 None 2025-09-27 03:12:04,272 - lava_callback - DEBUG - Processing node 68d576792be2da46606998cc: baseline-arm64 2025-09-27 03:12:05,165 - lava_callback - ERROR - Error processing callback for node 68d576792be2da46606998cc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:12:27,014 - lava_callback - INFO - Received callback for node 68d5c82e2be2da466069a865 INFO: 172.21.0.1:47530 - "POST /node/68d5c82e2be2da466069a865 HTTP/1.0" 202 Accepted 2025-09-27 03:12:27,020 - lava_callback - INFO - Starting async job submit for node 68d5c82e2be2da466069a865 2025-09-27 03:12:27,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:12:27,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c82e2be2da466069a865 HTTP/1.1" 200 None 2025-09-27 03:12:27,064 - lava_callback - DEBUG - Processing node 68d5c82e2be2da466069a865: baseline-arm 2025-09-27 03:12:27,292 - lava_callback - ERROR - Error processing callback for node 68d5c82e2be2da466069a865: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:14:37,248 - lava_callback - INFO - Received callback for node 68d5c82f2be2da466069a868 INFO: 172.21.0.1:45810 - "POST /node/68d5c82f2be2da466069a868 HTTP/1.0" 202 Accepted 2025-09-27 03:14:37,254 - lava_callback - INFO - Starting async job submit for node 68d5c82f2be2da466069a868 2025-09-27 03:14:37,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:14:37,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c82f2be2da466069a868 HTTP/1.1" 200 None 2025-09-27 03:14:37,299 - lava_callback - DEBUG - Processing node 68d5c82f2be2da466069a868: baseline-arm 2025-09-27 03:14:37,522 - lava_callback - ERROR - Error processing callback for node 68d5c82f2be2da466069a868: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51272 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:17:07,925 - lava_callback - INFO - Received callback for node 68d5c83c2be2da466069a88f INFO: 172.21.0.1:51288 - "POST /node/68d5c83c2be2da466069a88f HTTP/1.0" 202 Accepted 2025-09-27 03:17:07,931 - lava_callback - INFO - Starting async job submit for node 68d5c83c2be2da466069a88f 2025-09-27 03:17:07,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:17:07,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c83c2be2da466069a88f HTTP/1.1" 200 None 2025-09-27 03:17:07,965 - lava_callback - DEBUG - Processing node 68d5c83c2be2da466069a88f: baseline-arm 2025-09-27 03:17:08,216 - lava_callback - ERROR - Error processing callback for node 68d5c83c2be2da466069a88f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:19:02,715 - lava_callback - INFO - Received callback for node 68d5c83c2be2da466069a892 INFO: 172.21.0.1:39636 - "POST /node/68d5c83c2be2da466069a892 HTTP/1.0" 202 Accepted 2025-09-27 03:19:02,721 - lava_callback - INFO - Starting async job submit for node 68d5c83c2be2da466069a892 2025-09-27 03:19:02,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:19:02,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c83c2be2da466069a892 HTTP/1.1" 200 None 2025-09-27 03:19:02,755 - lava_callback - DEBUG - Processing node 68d5c83c2be2da466069a892: baseline-arm 2025-09-27 03:19:02,984 - lava_callback - ERROR - Error processing callback for node 68d5c83c2be2da466069a892: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:21:29,212 - lava_callback - INFO - Received callback for node 68d5c83e2be2da466069a895 INFO: 172.21.0.1:42010 - "POST /node/68d5c83e2be2da466069a895 HTTP/1.0" 202 Accepted 2025-09-27 03:21:29,218 - lava_callback - INFO - Starting async job submit for node 68d5c83e2be2da466069a895 2025-09-27 03:21:29,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:21:29,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c83e2be2da466069a895 HTTP/1.1" 200 None 2025-09-27 03:21:29,254 - lava_callback - DEBUG - Processing node 68d5c83e2be2da466069a895: baseline-arm 2025-09-27 03:21:29,479 - lava_callback - ERROR - Error processing callback for node 68d5c83e2be2da466069a895: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:23:47,774 - lava_callback - INFO - Received callback for node 68d5c83e2be2da466069a898 INFO: 172.21.0.1:42748 - "POST /node/68d5c83e2be2da466069a898 HTTP/1.0" 202 Accepted 2025-09-27 03:23:47,780 - lava_callback - INFO - Starting async job submit for node 68d5c83e2be2da466069a898 2025-09-27 03:23:47,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:23:47,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c83e2be2da466069a898 HTTP/1.1" 200 None 2025-09-27 03:23:47,834 - lava_callback - DEBUG - Processing node 68d5c83e2be2da466069a898: baseline-arm 2025-09-27 03:23:48,096 - lava_callback - ERROR - Error processing callback for node 68d5c83e2be2da466069a898: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:26:09,227 - lava_callback - INFO - Received callback for node 68d5df1b30c58dac7d941366 INFO: 172.21.0.1:39028 - "POST /node/68d5df1b30c58dac7d941366 HTTP/1.0" 202 Accepted 2025-09-27 03:26:09,234 - lava_callback - INFO - Starting async job submit for node 68d5df1b30c58dac7d941366 2025-09-27 03:26:09,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:26:09,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df1b30c58dac7d941366 HTTP/1.1" 200 None 2025-09-27 03:26:09,275 - lava_callback - DEBUG - Processing node 68d5df1b30c58dac7d941366: baseline-arm 2025-09-27 03:26:09,502 - lava_callback - ERROR - Error processing callback for node 68d5df1b30c58dac7d941366: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:28:00,167 - lava_callback - INFO - Received callback for node 68d5df1d30c58dac7d941372 INFO: 172.21.0.1:36726 - "POST /node/68d5df1d30c58dac7d941372 HTTP/1.0" 202 Accepted 2025-09-27 03:28:00,173 - lava_callback - INFO - Starting async job submit for node 68d5df1d30c58dac7d941372 2025-09-27 03:28:00,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:28:00,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df1d30c58dac7d941372 HTTP/1.1" 200 None 2025-09-27 03:28:00,224 - lava_callback - DEBUG - Processing node 68d5df1d30c58dac7d941372: baseline-arm 2025-09-27 03:28:00,450 - lava_callback - ERROR - Error processing callback for node 68d5df1d30c58dac7d941372: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:30:09,468 - lava_callback - INFO - Received callback for node 68d5e00030c58dac7d9413f6 INFO: 172.21.0.1:39246 - "POST /node/68d5e00030c58dac7d9413f6 HTTP/1.0" 202 Accepted 2025-09-27 03:30:09,474 - lava_callback - INFO - Starting async job submit for node 68d5e00030c58dac7d9413f6 2025-09-27 03:30:09,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:30:09,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e00030c58dac7d9413f6 HTTP/1.1" 200 None 2025-09-27 03:30:09,509 - lava_callback - DEBUG - Processing node 68d5e00030c58dac7d9413f6: baseline-arm 2025-09-27 03:30:09,732 - lava_callback - ERROR - Error processing callback for node 68d5e00030c58dac7d9413f6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:30:35,820 - lava_callback - INFO - Received callback for node 68d5767a2be2da46606998cf INFO: 172.21.0.1:33006 - "POST /node/68d5767a2be2da46606998cf HTTP/1.0" 202 Accepted 2025-09-27 03:30:35,827 - lava_callback - INFO - Starting async job submit for node 68d5767a2be2da46606998cf 2025-09-27 03:30:35,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:30:35,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5767a2be2da46606998cf HTTP/1.1" 200 None 2025-09-27 03:30:35,932 - lava_callback - DEBUG - Processing node 68d5767a2be2da46606998cf: baseline-arm64 INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:30:36,985 - lava_callback - ERROR - Error processing callback for node 68d5767a2be2da46606998cf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:32:28,263 - lava_callback - INFO - Received callback for node 68d5e00230c58dac7d941402 INFO: 172.21.0.1:53140 - "POST /node/68d5e00230c58dac7d941402 HTTP/1.0" 202 Accepted 2025-09-27 03:32:28,269 - lava_callback - INFO - Starting async job submit for node 68d5e00230c58dac7d941402 2025-09-27 03:32:28,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:32:28,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e00230c58dac7d941402 HTTP/1.1" 200 None 2025-09-27 03:32:28,327 - lava_callback - DEBUG - Processing node 68d5e00230c58dac7d941402: baseline-arm 2025-09-27 03:32:28,557 - lava_callback - ERROR - Error processing callback for node 68d5e00230c58dac7d941402: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:38:43,699 - lava_callback - INFO - Received callback for node 68d5fa3830c58dac7d941789 INFO: 172.21.0.1:36582 - "POST /node/68d5fa3830c58dac7d941789 HTTP/1.0" 202 Accepted 2025-09-27 03:38:43,705 - lava_callback - INFO - Starting async job submit for node 68d5fa3830c58dac7d941789 2025-09-27 03:38:43,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:38:43,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa3830c58dac7d941789 HTTP/1.1" 200 None 2025-09-27 03:38:43,763 - lava_callback - DEBUG - Processing node 68d5fa3830c58dac7d941789: baseline-arm 2025-09-27 03:38:43,991 - lava_callback - ERROR - Error processing callback for node 68d5fa3830c58dac7d941789: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:38:51,743 - lava_callback - INFO - Received callback for node 68d4c299a5c2c05277bcfc7a INFO: 172.21.0.1:50704 - "POST /node/68d4c299a5c2c05277bcfc7a HTTP/1.0" 202 Accepted 2025-09-27 03:38:51,750 - lava_callback - INFO - Starting async job submit for node 68d4c299a5c2c05277bcfc7a 2025-09-27 03:38:51,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:38:51,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c299a5c2c05277bcfc7a HTTP/1.1" 200 None 2025-09-27 03:38:51,814 - lava_callback - DEBUG - Processing node 68d4c299a5c2c05277bcfc7a: baseline-arm 2025-09-27 03:38:52,076 - lava_callback - ERROR - Error processing callback for node 68d4c299a5c2c05277bcfc7a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:40:49,291 - lava_callback - INFO - Received callback for node 68d5fa3930c58dac7d94178c INFO: 172.21.0.1:41414 - "POST /node/68d5fa3930c58dac7d94178c HTTP/1.0" 202 Accepted 2025-09-27 03:40:49,297 - lava_callback - INFO - Starting async job submit for node 68d5fa3930c58dac7d94178c 2025-09-27 03:40:49,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:40:49,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa3930c58dac7d94178c HTTP/1.1" 200 None 2025-09-27 03:40:49,350 - lava_callback - DEBUG - Processing node 68d5fa3930c58dac7d94178c: baseline-arm 2025-09-27 03:40:49,581 - lava_callback - ERROR - Error processing callback for node 68d5fa3930c58dac7d94178c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:42:48,941 - lava_callback - INFO - Received callback for node 68d5fa3a30c58dac7d94178f INFO: 172.21.0.1:40904 - "POST /node/68d5fa3a30c58dac7d94178f HTTP/1.0" 202 Accepted 2025-09-27 03:42:48,948 - lava_callback - INFO - Starting async job submit for node 68d5fa3a30c58dac7d94178f 2025-09-27 03:42:48,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:42:48,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa3a30c58dac7d94178f HTTP/1.1" 200 None 2025-09-27 03:42:48,982 - lava_callback - DEBUG - Processing node 68d5fa3a30c58dac7d94178f: baseline-arm 2025-09-27 03:42:49,207 - lava_callback - ERROR - Error processing callback for node 68d5fa3a30c58dac7d94178f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:44:47,868 - lava_callback - INFO - Received callback for node 68d5fa3b30c58dac7d941792 INFO: 172.21.0.1:56850 - "POST /node/68d5fa3b30c58dac7d941792 HTTP/1.0" 202 Accepted 2025-09-27 03:44:47,874 - lava_callback - INFO - Starting async job submit for node 68d5fa3b30c58dac7d941792 2025-09-27 03:44:47,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:44:47,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa3b30c58dac7d941792 HTTP/1.1" 200 None 2025-09-27 03:44:47,923 - lava_callback - DEBUG - Processing node 68d5fa3b30c58dac7d941792: baseline-arm 2025-09-27 03:44:48,149 - lava_callback - ERROR - Error processing callback for node 68d5fa3b30c58dac7d941792: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:47:06,965 - lava_callback - INFO - Received callback for node 68d5fa3c30c58dac7d941795 INFO: 172.21.0.1:60724 - "POST /node/68d5fa3c30c58dac7d941795 HTTP/1.0" 202 Accepted 2025-09-27 03:47:06,971 - lava_callback - INFO - Starting async job submit for node 68d5fa3c30c58dac7d941795 2025-09-27 03:47:06,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:47:07,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa3c30c58dac7d941795 HTTP/1.1" 200 None 2025-09-27 03:47:07,004 - lava_callback - DEBUG - Processing node 68d5fa3c30c58dac7d941795: baseline-arm 2025-09-27 03:47:07,252 - lava_callback - ERROR - Error processing callback for node 68d5fa3c30c58dac7d941795: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:49:04,045 - lava_callback - INFO - Received callback for node 68d5fa3c30c58dac7d941798 INFO: 172.21.0.1:40748 - "POST /node/68d5fa3c30c58dac7d941798 HTTP/1.0" 202 Accepted 2025-09-27 03:49:04,051 - lava_callback - INFO - Starting async job submit for node 68d5fa3c30c58dac7d941798 2025-09-27 03:49:04,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:49:04,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa3c30c58dac7d941798 HTTP/1.1" 200 None 2025-09-27 03:49:04,099 - lava_callback - DEBUG - Processing node 68d5fa3c30c58dac7d941798: baseline-arm 2025-09-27 03:49:04,333 - lava_callback - ERROR - Error processing callback for node 68d5fa3c30c58dac7d941798: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58116 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:51:28,761 - lava_callback - INFO - Received callback for node 68d5fa3e30c58dac7d94179b INFO: 172.21.0.1:58128 - "POST /node/68d5fa3e30c58dac7d94179b HTTP/1.0" 202 Accepted 2025-09-27 03:51:28,771 - lava_callback - INFO - Starting async job submit for node 68d5fa3e30c58dac7d94179b 2025-09-27 03:51:28,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:51:28,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa3e30c58dac7d94179b HTTP/1.1" 200 None 2025-09-27 03:51:28,816 - lava_callback - DEBUG - Processing node 68d5fa3e30c58dac7d94179b: baseline-arm 2025-09-27 03:51:29,048 - lava_callback - ERROR - Error processing callback for node 68d5fa3e30c58dac7d94179b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:54:48,442 - lava_callback - INFO - Received callback for node 68d5fa3e30c58dac7d94179e INFO: 172.21.0.1:40626 - "POST /node/68d5fa3e30c58dac7d94179e HTTP/1.0" 202 Accepted 2025-09-27 03:54:48,448 - lava_callback - INFO - Starting async job submit for node 68d5fa3e30c58dac7d94179e 2025-09-27 03:54:48,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:54:48,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa3e30c58dac7d94179e HTTP/1.1" 200 None 2025-09-27 03:54:48,481 - lava_callback - DEBUG - Processing node 68d5fa3e30c58dac7d94179e: baseline-arm 2025-09-27 03:54:48,734 - lava_callback - ERROR - Error processing callback for node 68d5fa3e30c58dac7d94179e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:57:05,146 - lava_callback - INFO - Received callback for node 68d591402be2da4660699f1d INFO: 172.21.0.1:34072 - "POST /node/68d591402be2da4660699f1d HTTP/1.0" 202 Accepted 2025-09-27 03:57:05,152 - lava_callback - INFO - Starting async job submit for node 68d591402be2da4660699f1d 2025-09-27 03:57:05,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:57:05,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591402be2da4660699f1d HTTP/1.1" 200 None 2025-09-27 03:57:05,188 - lava_callback - DEBUG - Processing node 68d591402be2da4660699f1d: baseline-arm64 2025-09-27 03:57:05,522 - lava_callback - ERROR - Error processing callback for node 68d591402be2da4660699f1d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 03:57:06,436 - lava_callback - INFO - Received callback for node 68d5913f2be2da4660699f1a INFO: 172.21.0.1:34082 - "POST /node/68d5913f2be2da4660699f1a HTTP/1.0" 202 Accepted 2025-09-27 03:57:06,443 - lava_callback - INFO - Starting async job submit for node 68d5913f2be2da4660699f1a 2025-09-27 03:57:06,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:57:06,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5913f2be2da4660699f1a HTTP/1.1" 200 None 2025-09-27 03:57:06,476 - lava_callback - DEBUG - Processing node 68d5913f2be2da4660699f1a: baseline-arm64 INFO: 172.21.0.1:34086 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:57:06,806 - lava_callback - ERROR - Error processing callback for node 68d5913f2be2da4660699f1a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 03:57:08,834 - lava_callback - INFO - Received callback for node 68d5fa7e30c58dac7d941811 INFO: 172.21.0.1:34090 - "POST /node/68d5fa7e30c58dac7d941811 HTTP/1.0" 202 Accepted 2025-09-27 03:57:08,840 - lava_callback - INFO - Starting async job submit for node 68d5fa7e30c58dac7d941811 2025-09-27 03:57:08,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:57:08,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa7e30c58dac7d941811 HTTP/1.1" 200 None 2025-09-27 03:57:08,876 - lava_callback - DEBUG - Processing node 68d5fa7e30c58dac7d941811: baseline-arm 2025-09-27 03:57:09,129 - lava_callback - ERROR - Error processing callback for node 68d5fa7e30c58dac7d941811: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:58:11,824 - lava_callback - INFO - Received callback for node 68d4c299a5c2c05277bcfc7d INFO: 172.21.0.1:46830 - "POST /node/68d4c299a5c2c05277bcfc7d HTTP/1.0" 202 Accepted 2025-09-27 03:58:11,830 - lava_callback - INFO - Starting async job submit for node 68d4c299a5c2c05277bcfc7d 2025-09-27 03:58:11,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:58:11,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c299a5c2c05277bcfc7d HTTP/1.1" 200 None 2025-09-27 03:58:11,873 - lava_callback - DEBUG - Processing node 68d4c299a5c2c05277bcfc7d: baseline-arm 2025-09-27 03:58:12,132 - lava_callback - ERROR - Error processing callback for node 68d4c299a5c2c05277bcfc7d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:58:29,090 - lava_callback - INFO - Received callback for node 68d591422be2da4660699f20 INFO: 172.21.0.1:50644 - "POST /node/68d591422be2da4660699f20 HTTP/1.0" 202 Accepted 2025-09-27 03:58:29,096 - lava_callback - INFO - Starting async job submit for node 68d591422be2da4660699f20 2025-09-27 03:58:29,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:58:29,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591422be2da4660699f20 HTTP/1.1" 200 None 2025-09-27 03:58:29,131 - lava_callback - DEBUG - Processing node 68d591422be2da4660699f20: baseline-arm64 2025-09-27 03:58:29,495 - lava_callback - ERROR - Error processing callback for node 68d591422be2da4660699f20: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 03:58:32,572 - lava_callback - INFO - Received callback for node 68d591432be2da4660699f23 INFO: 172.21.0.1:34978 - "POST /node/68d591432be2da4660699f23 HTTP/1.0" 202 Accepted 2025-09-27 03:58:32,578 - lava_callback - INFO - Starting async job submit for node 68d591432be2da4660699f23 2025-09-27 03:58:32,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:58:32,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591432be2da4660699f23 HTTP/1.1" 200 None 2025-09-27 03:58:32,612 - lava_callback - DEBUG - Processing node 68d591432be2da4660699f23: baseline-arm64 2025-09-27 03:58:32,945 - lava_callback - ERROR - Error processing callback for node 68d591432be2da4660699f23: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:59:27,726 - lava_callback - INFO - Received callback for node 68d5fa7e30c58dac7d941814 INFO: 172.21.0.1:59424 - "POST /node/68d5fa7e30c58dac7d941814 HTTP/1.0" 202 Accepted 2025-09-27 03:59:27,732 - lava_callback - INFO - Starting async job submit for node 68d5fa7e30c58dac7d941814 2025-09-27 03:59:27,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:59:27,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa7e30c58dac7d941814 HTTP/1.1" 200 None 2025-09-27 03:59:27,790 - lava_callback - DEBUG - Processing node 68d5fa7e30c58dac7d941814: baseline-arm 2025-09-27 03:59:28,013 - lava_callback - ERROR - Error processing callback for node 68d5fa7e30c58dac7d941814: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK 2025-09-27 03:59:49,652 - lava_callback - INFO - Received callback for node 68d591452be2da4660699f26 INFO: 172.21.0.1:44744 - "POST /node/68d591452be2da4660699f26 HTTP/1.0" 202 Accepted 2025-09-27 03:59:49,658 - lava_callback - INFO - Starting async job submit for node 68d591452be2da4660699f26 2025-09-27 03:59:49,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 03:59:49,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591452be2da4660699f26 HTTP/1.1" 200 None 2025-09-27 03:59:49,691 - lava_callback - DEBUG - Processing node 68d591452be2da4660699f26: baseline-arm64 2025-09-27 03:59:50,052 - lava_callback - ERROR - Error processing callback for node 68d591452be2da4660699f26: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:00:18,232 - lava_callback - INFO - Received callback for node 68d591462be2da4660699f29 INFO: 172.21.0.1:33144 - "POST /node/68d591462be2da4660699f29 HTTP/1.0" 202 Accepted 2025-09-27 04:00:18,238 - lava_callback - INFO - Starting async job submit for node 68d591462be2da4660699f29 2025-09-27 04:00:18,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:00:18,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591462be2da4660699f29 HTTP/1.1" 200 None 2025-09-27 04:00:18,274 - lava_callback - DEBUG - Processing node 68d591462be2da4660699f29: baseline-arm64 2025-09-27 04:00:18,621 - lava_callback - ERROR - Error processing callback for node 68d591462be2da4660699f29: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:01:03,931 - lava_callback - INFO - Received callback for node 68d591482be2da4660699f2c INFO: 172.21.0.1:40748 - "POST /node/68d591482be2da4660699f2c HTTP/1.0" 202 Accepted 2025-09-27 04:01:03,937 - lava_callback - INFO - Starting async job submit for node 68d591482be2da4660699f2c 2025-09-27 04:01:03,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:01:03,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591482be2da4660699f2c HTTP/1.1" 200 None 2025-09-27 04:01:03,979 - lava_callback - DEBUG - Processing node 68d591482be2da4660699f2c: baseline-arm64 2025-09-27 04:01:04,338 - lava_callback - ERROR - Error processing callback for node 68d591482be2da4660699f2c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:01:49,317 - lava_callback - INFO - Received callback for node 68d5fa8030c58dac7d941817 INFO: 172.21.0.1:58806 - "POST /node/68d5fa8030c58dac7d941817 HTTP/1.0" 202 Accepted 2025-09-27 04:01:49,323 - lava_callback - INFO - Starting async job submit for node 68d5fa8030c58dac7d941817 2025-09-27 04:01:49,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:01:49,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa8030c58dac7d941817 HTTP/1.1" 200 None 2025-09-27 04:01:49,381 - lava_callback - DEBUG - Processing node 68d5fa8030c58dac7d941817: baseline-arm 2025-09-27 04:01:49,605 - lava_callback - ERROR - Error processing callback for node 68d5fa8030c58dac7d941817: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:02:20,651 - lava_callback - INFO - Received callback for node 68d591492be2da4660699f2f INFO: 172.21.0.1:45982 - "POST /node/68d591492be2da4660699f2f HTTP/1.0" 202 Accepted 2025-09-27 04:02:20,657 - lava_callback - INFO - Starting async job submit for node 68d591492be2da4660699f2f 2025-09-27 04:02:20,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:02:20,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591492be2da4660699f2f HTTP/1.1" 200 None 2025-09-27 04:02:20,691 - lava_callback - DEBUG - Processing node 68d591492be2da4660699f2f: baseline-arm64 2025-09-27 04:02:21,027 - lava_callback - ERROR - Error processing callback for node 68d591492be2da4660699f2f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:02:22,488 - lava_callback - INFO - Received callback for node 68d591c72be2da466069a033 INFO: 172.21.0.1:45996 - "POST /node/68d591c72be2da466069a033 HTTP/1.0" 202 Accepted 2025-09-27 04:02:22,494 - lava_callback - INFO - Starting async job submit for node 68d591c72be2da466069a033 2025-09-27 04:02:22,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:02:22,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591c72be2da466069a033 HTTP/1.1" 200 None 2025-09-27 04:02:22,528 - lava_callback - DEBUG - Processing node 68d591c72be2da466069a033: baseline-arm64 2025-09-27 04:02:22,875 - lava_callback - ERROR - Error processing callback for node 68d591c72be2da466069a033: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:03:49,768 - lava_callback - INFO - Received callback for node 68d591c82be2da466069a036 INFO: 172.21.0.1:51900 - "POST /node/68d591c82be2da466069a036 HTTP/1.0" 202 Accepted 2025-09-27 04:03:49,774 - lava_callback - INFO - Starting async job submit for node 68d591c82be2da466069a036 2025-09-27 04:03:49,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:03:49,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591c82be2da466069a036 HTTP/1.1" 200 None 2025-09-27 04:03:49,814 - lava_callback - DEBUG - Processing node 68d591c82be2da466069a036: baseline-arm64 2025-09-27 04:03:50,150 - lava_callback - ERROR - Error processing callback for node 68d591c82be2da466069a036: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:04:14,401 - lava_callback - INFO - Received callback for node 68d5fa8030c58dac7d94181a INFO: 172.21.0.1:32934 - "POST /node/68d5fa8030c58dac7d94181a HTTP/1.0" 202 Accepted 2025-09-27 04:04:14,406 - lava_callback - INFO - Starting async job submit for node 68d5fa8030c58dac7d94181a 2025-09-27 04:04:14,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:04:14,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa8030c58dac7d94181a HTTP/1.1" 200 None 2025-09-27 04:04:14,440 - lava_callback - DEBUG - Processing node 68d5fa8030c58dac7d94181a: baseline-arm 2025-09-27 04:04:14,667 - lava_callback - ERROR - Error processing callback for node 68d5fa8030c58dac7d94181a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:32944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:04:18,873 - lava_callback - INFO - Received callback for node 68d591ca2be2da466069a039 INFO: 172.21.0.1:32958 - "POST /node/68d591ca2be2da466069a039 HTTP/1.0" 202 Accepted 2025-09-27 04:04:18,879 - lava_callback - INFO - Starting async job submit for node 68d591ca2be2da466069a039 2025-09-27 04:04:18,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:04:18,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591ca2be2da466069a039 HTTP/1.1" 200 None 2025-09-27 04:04:18,946 - lava_callback - DEBUG - Processing node 68d591ca2be2da466069a039: baseline-arm64 2025-09-27 04:04:19,302 - lava_callback - ERROR - Error processing callback for node 68d591ca2be2da466069a039: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59438 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:05:11,381 - lava_callback - INFO - Received callback for node 68d591cc2be2da466069a03c INFO: 172.21.0.1:54962 - "POST /node/68d591cc2be2da466069a03c HTTP/1.0" 202 Accepted 2025-09-27 04:05:11,388 - lava_callback - INFO - Starting async job submit for node 68d591cc2be2da466069a03c 2025-09-27 04:05:11,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:05:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591cc2be2da466069a03c HTTP/1.1" 200 None 2025-09-27 04:05:11,446 - lava_callback - DEBUG - Processing node 68d591cc2be2da466069a03c: baseline-arm64 2025-09-27 04:05:11,775 - lava_callback - ERROR - Error processing callback for node 68d591cc2be2da466069a03c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:05:45,066 - lava_callback - INFO - Received callback for node 68d591cf2be2da466069a03f INFO: 172.21.0.1:43188 - "POST /node/68d591cf2be2da466069a03f HTTP/1.0" 202 Accepted 2025-09-27 04:05:45,072 - lava_callback - INFO - Starting async job submit for node 68d591cf2be2da466069a03f 2025-09-27 04:05:45,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:05:45,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591cf2be2da466069a03f HTTP/1.1" 200 None 2025-09-27 04:05:45,107 - lava_callback - DEBUG - Processing node 68d591cf2be2da466069a03f: baseline-arm64 2025-09-27 04:05:45,466 - lava_callback - ERROR - Error processing callback for node 68d591cf2be2da466069a03f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:06:13,925 - lava_callback - INFO - Received callback for node 68d591cf2be2da466069a042 INFO: 172.21.0.1:55812 - "POST /node/68d591cf2be2da466069a042 HTTP/1.0" 202 Accepted 2025-09-27 04:06:13,931 - lava_callback - INFO - Starting async job submit for node 68d591cf2be2da466069a042 2025-09-27 04:06:13,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:06:13,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591cf2be2da466069a042 HTTP/1.1" 200 None 2025-09-27 04:06:13,965 - lava_callback - DEBUG - Processing node 68d591cf2be2da466069a042: baseline-arm64 2025-09-27 04:06:14,294 - lava_callback - ERROR - Error processing callback for node 68d591cf2be2da466069a042: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:06:22,489 - lava_callback - INFO - Received callback for node 68d591d22be2da466069a045 INFO: 172.21.0.1:54156 - "POST /node/68d591d22be2da466069a045 HTTP/1.0" 202 Accepted 2025-09-27 04:06:22,495 - lava_callback - INFO - Starting async job submit for node 68d591d22be2da466069a045 2025-09-27 04:06:22,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:06:22,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591d22be2da466069a045 HTTP/1.1" 200 None 2025-09-27 04:06:22,531 - lava_callback - DEBUG - Processing node 68d591d22be2da466069a045: baseline-arm64 2025-09-27 04:06:22,891 - lava_callback - ERROR - Error processing callback for node 68d591d22be2da466069a045: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:06:36,935 - lava_callback - INFO - Received callback for node 68d4c2eba5c2c05277bcfce5 INFO: 172.21.0.1:50272 - "POST /node/68d4c2eba5c2c05277bcfce5 HTTP/1.0" 202 Accepted 2025-09-27 04:06:36,941 - lava_callback - INFO - Starting async job submit for node 68d4c2eba5c2c05277bcfce5 2025-09-27 04:06:36,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:06:36,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2eba5c2c05277bcfce5 HTTP/1.1" 200 None 2025-09-27 04:06:37,000 - lava_callback - DEBUG - Processing node 68d4c2eba5c2c05277bcfce5: baseline-arm-broonie 2025-09-27 04:06:37,233 - lava_callback - ERROR - Error processing callback for node 68d4c2eba5c2c05277bcfce5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:06:48,539 - lava_callback - INFO - Received callback for node 68d5fa8230c58dac7d94181d INFO: 172.21.0.1:57364 - "POST /node/68d5fa8230c58dac7d94181d HTTP/1.0" 202 Accepted 2025-09-27 04:06:48,545 - lava_callback - INFO - Starting async job submit for node 68d5fa8230c58dac7d94181d 2025-09-27 04:06:48,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:06:48,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa8230c58dac7d94181d HTTP/1.1" 200 None 2025-09-27 04:06:48,591 - lava_callback - DEBUG - Processing node 68d5fa8230c58dac7d94181d: baseline-arm 2025-09-27 04:06:48,824 - lava_callback - ERROR - Error processing callback for node 68d5fa8230c58dac7d94181d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:07:05,467 - lava_callback - INFO - Received callback for node 68d591d32be2da466069a048 INFO: 172.21.0.1:33172 - "POST /node/68d591d32be2da466069a048 HTTP/1.0" 202 Accepted 2025-09-27 04:07:05,473 - lava_callback - INFO - Starting async job submit for node 68d591d32be2da466069a048 2025-09-27 04:07:05,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:07:05,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d591d32be2da466069a048 HTTP/1.1" 200 None 2025-09-27 04:07:05,518 - lava_callback - DEBUG - Processing node 68d591d32be2da466069a048: baseline-arm64 2025-09-27 04:07:05,868 - lava_callback - ERROR - Error processing callback for node 68d591d32be2da466069a048: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:09:03,221 - lava_callback - INFO - Received callback for node 68d5aacb2be2da466069a34d INFO: 172.21.0.1:50398 - "POST /node/68d5aacb2be2da466069a34d HTTP/1.0" 202 Accepted 2025-09-27 04:09:03,227 - lava_callback - INFO - Starting async job submit for node 68d5aacb2be2da466069a34d 2025-09-27 04:09:03,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:09:03,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5aacb2be2da466069a34d HTTP/1.1" 200 None 2025-09-27 04:09:03,262 - lava_callback - DEBUG - Processing node 68d5aacb2be2da466069a34d: baseline-arm64 2025-09-27 04:09:03,595 - lava_callback - ERROR - Error processing callback for node 68d5aacb2be2da466069a34d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:09:06,202 - lava_callback - INFO - Received callback for node 68d5fa8230c58dac7d941820 INFO: 172.21.0.1:50412 - "POST /node/68d5fa8230c58dac7d941820 HTTP/1.0" 202 Accepted 2025-09-27 04:09:06,208 - lava_callback - INFO - Starting async job submit for node 68d5fa8230c58dac7d941820 2025-09-27 04:09:06,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:09:06,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa8230c58dac7d941820 HTTP/1.1" 200 None 2025-09-27 04:09:06,242 - lava_callback - DEBUG - Processing node 68d5fa8230c58dac7d941820: baseline-arm 2025-09-27 04:09:06,468 - lava_callback - ERROR - Error processing callback for node 68d5fa8230c58dac7d941820: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50416 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:09:14,604 - lava_callback - INFO - Received callback for node 68d5aacb2be2da466069a34a INFO: 172.21.0.1:56230 - "POST /node/68d5aacb2be2da466069a34a HTTP/1.0" 202 Accepted 2025-09-27 04:09:14,610 - lava_callback - INFO - Starting async job submit for node 68d5aacb2be2da466069a34a 2025-09-27 04:09:14,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:09:14,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5aacb2be2da466069a34a HTTP/1.1" 200 None 2025-09-27 04:09:14,666 - lava_callback - DEBUG - Processing node 68d5aacb2be2da466069a34a: baseline-arm64 2025-09-27 04:09:15,011 - lava_callback - ERROR - Error processing callback for node 68d5aacb2be2da466069a34a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:09:50,835 - lava_callback - INFO - Received callback for node 68d5aace2be2da466069a350 INFO: 172.21.0.1:37084 - "POST /node/68d5aace2be2da466069a350 HTTP/1.0" 202 Accepted 2025-09-27 04:09:50,843 - lava_callback - INFO - Starting async job submit for node 68d5aace2be2da466069a350 2025-09-27 04:09:50,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:09:50,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5aace2be2da466069a350 HTTP/1.1" 200 None 2025-09-27 04:09:50,883 - lava_callback - DEBUG - Processing node 68d5aace2be2da466069a350: baseline-arm64 2025-09-27 04:09:51,298 - lava_callback - ERROR - Error processing callback for node 68d5aace2be2da466069a350: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:10:23,864 - lava_callback - INFO - Received callback for node 68d5aacf2be2da466069a353 INFO: 172.21.0.1:56666 - "POST /node/68d5aacf2be2da466069a353 HTTP/1.0" 202 Accepted 2025-09-27 04:10:23,870 - lava_callback - INFO - Starting async job submit for node 68d5aacf2be2da466069a353 2025-09-27 04:10:23,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:10:23,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5aacf2be2da466069a353 HTTP/1.1" 200 None 2025-09-27 04:10:23,912 - lava_callback - DEBUG - Processing node 68d5aacf2be2da466069a353: baseline-arm64 2025-09-27 04:10:24,279 - lava_callback - ERROR - Error processing callback for node 68d5aacf2be2da466069a353: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:10:31,604 - lava_callback - INFO - Received callback for node 68d5ab082be2da466069a3c9 INFO: 172.21.0.1:33260 - "POST /node/68d5ab082be2da466069a3c9 HTTP/1.0" 202 Accepted 2025-09-27 04:10:31,611 - lava_callback - INFO - Starting async job submit for node 68d5ab082be2da466069a3c9 2025-09-27 04:10:31,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:10:31,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ab082be2da466069a3c9 HTTP/1.1" 200 None 2025-09-27 04:10:31,653 - lava_callback - DEBUG - Processing node 68d5ab082be2da466069a3c9: baseline-arm64 2025-09-27 04:10:32,041 - lava_callback - ERROR - Error processing callback for node 68d5ab082be2da466069a3c9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:11:06,442 - lava_callback - INFO - Received callback for node 68d5ab082be2da466069a3cc INFO: 172.21.0.1:45806 - "POST /node/68d5ab082be2da466069a3cc HTTP/1.0" 202 Accepted 2025-09-27 04:11:06,448 - lava_callback - INFO - Starting async job submit for node 68d5ab082be2da466069a3cc 2025-09-27 04:11:06,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:11:06,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ab082be2da466069a3cc HTTP/1.1" 200 None 2025-09-27 04:11:06,482 - lava_callback - DEBUG - Processing node 68d5ab082be2da466069a3cc: baseline-arm64 INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:11:06,846 - lava_callback - ERROR - Error processing callback for node 68d5ab082be2da466069a3cc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:11:26,081 - lava_callback - INFO - Received callback for node 68d5fa8430c58dac7d941823 INFO: 172.21.0.1:38266 - "POST /node/68d5fa8430c58dac7d941823 HTTP/1.0" 202 Accepted 2025-09-27 04:11:26,087 - lava_callback - INFO - Starting async job submit for node 68d5fa8430c58dac7d941823 2025-09-27 04:11:26,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:11:26,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa8430c58dac7d941823 HTTP/1.1" 200 None 2025-09-27 04:11:26,123 - lava_callback - DEBUG - Processing node 68d5fa8430c58dac7d941823: baseline-arm 2025-09-27 04:11:26,348 - lava_callback - ERROR - Error processing callback for node 68d5fa8430c58dac7d941823: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:11:43,864 - lava_callback - INFO - Received callback for node 68d5ab0b2be2da466069a3cf INFO: 172.21.0.1:51064 - "POST /node/68d5ab0b2be2da466069a3cf HTTP/1.0" 202 Accepted 2025-09-27 04:11:43,870 - lava_callback - INFO - Starting async job submit for node 68d5ab0b2be2da466069a3cf 2025-09-27 04:11:43,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:11:43,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ab0b2be2da466069a3cf HTTP/1.1" 200 None 2025-09-27 04:11:43,937 - lava_callback - DEBUG - Processing node 68d5ab0b2be2da466069a3cf: baseline-arm64 2025-09-27 04:11:44,275 - lava_callback - ERROR - Error processing callback for node 68d5ab0b2be2da466069a3cf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:11:57,260 - lava_callback - INFO - Received callback for node 68d5ab0c2be2da466069a3d2 INFO: 172.21.0.1:47040 - "POST /node/68d5ab0c2be2da466069a3d2 HTTP/1.0" 202 Accepted 2025-09-27 04:11:57,266 - lava_callback - INFO - Starting async job submit for node 68d5ab0c2be2da466069a3d2 2025-09-27 04:11:57,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:11:57,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ab0c2be2da466069a3d2 HTTP/1.1" 200 None 2025-09-27 04:11:57,319 - lava_callback - DEBUG - Processing node 68d5ab0c2be2da466069a3d2: baseline-arm64 2025-09-27 04:11:57,694 - lava_callback - ERROR - Error processing callback for node 68d5ab0c2be2da466069a3d2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:12:30,624 - lava_callback - INFO - Received callback for node 68d5ab762be2da466069a48b INFO: 172.21.0.1:32896 - "POST /node/68d5ab762be2da466069a48b HTTP/1.0" 202 Accepted 2025-09-27 04:12:30,630 - lava_callback - INFO - Starting async job submit for node 68d5ab762be2da466069a48b 2025-09-27 04:12:30,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:12:30,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ab762be2da466069a48b HTTP/1.1" 200 None 2025-09-27 04:12:30,679 - lava_callback - DEBUG - Processing node 68d5ab762be2da466069a48b: baseline-arm64 2025-09-27 04:12:31,084 - lava_callback - ERROR - Error processing callback for node 68d5ab762be2da466069a48b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:13:05,087 - lava_callback - INFO - Received callback for node 68d5ab772be2da466069a48e INFO: 172.21.0.1:47618 - "POST /node/68d5ab772be2da466069a48e HTTP/1.0" 202 Accepted 2025-09-27 04:13:05,093 - lava_callback - INFO - Starting async job submit for node 68d5ab772be2da466069a48e 2025-09-27 04:13:05,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:13:05,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ab772be2da466069a48e HTTP/1.1" 200 None 2025-09-27 04:13:05,126 - lava_callback - DEBUG - Processing node 68d5ab772be2da466069a48e: baseline-arm64 2025-09-27 04:13:05,449 - lava_callback - ERROR - Error processing callback for node 68d5ab772be2da466069a48e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:13:35,804 - lava_callback - INFO - Received callback for node 68d5ab792be2da466069a491 INFO: 172.21.0.1:47704 - "POST /node/68d5ab792be2da466069a491 HTTP/1.0" 202 Accepted 2025-09-27 04:13:35,811 - lava_callback - INFO - Starting async job submit for node 68d5ab792be2da466069a491 2025-09-27 04:13:35,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:13:35,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ab792be2da466069a491 HTTP/1.1" 200 None 2025-09-27 04:13:35,845 - lava_callback - DEBUG - Processing node 68d5ab792be2da466069a491: baseline-arm64 2025-09-27 04:13:36,141 - lava_callback - ERROR - Error processing callback for node 68d5ab792be2da466069a491: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:13:46,775 - lava_callback - INFO - Received callback for node 68d5ab7a2be2da466069a494 INFO: 172.21.0.1:33956 - "POST /node/68d5ab7a2be2da466069a494 HTTP/1.0" 202 Accepted 2025-09-27 04:13:46,781 - lava_callback - INFO - Starting async job submit for node 68d5ab7a2be2da466069a494 2025-09-27 04:13:46,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:13:46,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ab7a2be2da466069a494 HTTP/1.1" 200 None 2025-09-27 04:13:46,832 - lava_callback - DEBUG - Processing node 68d5ab7a2be2da466069a494: baseline-arm64 2025-09-27 04:13:47,195 - lava_callback - ERROR - Error processing callback for node 68d5ab7a2be2da466069a494: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:13:48,310 - lava_callback - INFO - Received callback for node 68d5fa8430c58dac7d941826 INFO: 172.21.0.1:33962 - "POST /node/68d5fa8430c58dac7d941826 HTTP/1.0" 202 Accepted 2025-09-27 04:13:48,316 - lava_callback - INFO - Starting async job submit for node 68d5fa8430c58dac7d941826 2025-09-27 04:13:48,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:13:48,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fa8430c58dac7d941826 HTTP/1.1" 200 None 2025-09-27 04:13:48,374 - lava_callback - DEBUG - Processing node 68d5fa8430c58dac7d941826: baseline-arm 2025-09-27 04:13:48,618 - lava_callback - ERROR - Error processing callback for node 68d5fa8430c58dac7d941826: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:14:27,173 - lava_callback - INFO - Received callback for node 68d5abb32be2da466069a50b INFO: 172.21.0.1:32998 - "POST /node/68d5abb32be2da466069a50b HTTP/1.0" 202 Accepted 2025-09-27 04:14:27,179 - lava_callback - INFO - Starting async job submit for node 68d5abb32be2da466069a50b 2025-09-27 04:14:27,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:14:27,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5abb32be2da466069a50b HTTP/1.1" 200 None 2025-09-27 04:14:27,224 - lava_callback - DEBUG - Processing node 68d5abb32be2da466069a50b: baseline-arm64 2025-09-27 04:14:27,518 - lava_callback - ERROR - Error processing callback for node 68d5abb32be2da466069a50b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:15:03,170 - lava_callback - INFO - Received callback for node 68d5abb62be2da466069a511 INFO: 172.21.0.1:48636 - "POST /node/68d5abb62be2da466069a511 HTTP/1.0" 202 Accepted 2025-09-27 04:15:03,176 - lava_callback - INFO - Starting async job submit for node 68d5abb62be2da466069a511 2025-09-27 04:15:03,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:15:03,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5abb62be2da466069a511 HTTP/1.1" 200 None 2025-09-27 04:15:03,211 - lava_callback - DEBUG - Processing node 68d5abb62be2da466069a511: baseline-arm64 2025-09-27 04:15:03,540 - lava_callback - ERROR - Error processing callback for node 68d5abb62be2da466069a511: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:15:16,599 - lava_callback - INFO - Received callback for node 68d5abb32be2da466069a50e INFO: 172.21.0.1:49354 - "POST /node/68d5abb32be2da466069a50e HTTP/1.0" 202 Accepted 2025-09-27 04:15:16,606 - lava_callback - INFO - Starting async job submit for node 68d5abb32be2da466069a50e 2025-09-27 04:15:16,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:15:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5abb32be2da466069a50e HTTP/1.1" 200 None 2025-09-27 04:15:16,639 - lava_callback - DEBUG - Processing node 68d5abb32be2da466069a50e: baseline-arm64 2025-09-27 04:15:16,937 - lava_callback - ERROR - Error processing callback for node 68d5abb32be2da466069a50e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:15:42,405 - lava_callback - INFO - Received callback for node 68d5abb72be2da466069a514 INFO: 172.21.0.1:46294 - "POST /node/68d5abb72be2da466069a514 HTTP/1.0" 202 Accepted 2025-09-27 04:15:42,411 - lava_callback - INFO - Starting async job submit for node 68d5abb72be2da466069a514 2025-09-27 04:15:42,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:15:42,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5abb72be2da466069a514 HTTP/1.1" 200 None 2025-09-27 04:15:42,448 - lava_callback - DEBUG - Processing node 68d5abb72be2da466069a514: baseline-arm64 2025-09-27 04:15:42,743 - lava_callback - ERROR - Error processing callback for node 68d5abb72be2da466069a514: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:16:09,128 - lava_callback - INFO - Received callback for node 68d5fccd30c58dac7d9418d3 INFO: 172.21.0.1:36360 - "POST /node/68d5fccd30c58dac7d9418d3 HTTP/1.0" 202 Accepted 2025-09-27 04:16:09,134 - lava_callback - INFO - Starting async job submit for node 68d5fccd30c58dac7d9418d3 2025-09-27 04:16:09,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:16:09,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fccd30c58dac7d9418d3 HTTP/1.1" 200 None 2025-09-27 04:16:09,167 - lava_callback - DEBUG - Processing node 68d5fccd30c58dac7d9418d3: baseline-arm 2025-09-27 04:16:09,421 - lava_callback - ERROR - Error processing callback for node 68d5fccd30c58dac7d9418d3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:17:51,957 - lava_callback - INFO - Received callback for node 68d4c29ba5c2c05277bcfc80 INFO: 172.21.0.1:50670 - "POST /node/68d4c29ba5c2c05277bcfc80 HTTP/1.0" 202 Accepted 2025-09-27 04:17:51,963 - lava_callback - INFO - Starting async job submit for node 68d4c29ba5c2c05277bcfc80 2025-09-27 04:17:51,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:17:52,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c29ba5c2c05277bcfc80 HTTP/1.1" 200 None 2025-09-27 04:17:52,031 - lava_callback - DEBUG - Processing node 68d4c29ba5c2c05277bcfc80: baseline-arm 2025-09-27 04:17:52,295 - lava_callback - ERROR - Error processing callback for node 68d4c29ba5c2c05277bcfc80: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:18:24,048 - lava_callback - INFO - Received callback for node 68d5c3f52be2da466069a6c4 INFO: 172.21.0.1:36806 - "POST /node/68d5c3f52be2da466069a6c4 HTTP/1.0" 202 Accepted 2025-09-27 04:18:24,055 - lava_callback - INFO - Starting async job submit for node 68d5c3f52be2da466069a6c4 2025-09-27 04:18:24,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:18:24,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c3f52be2da466069a6c4 HTTP/1.1" 200 None 2025-09-27 04:18:24,089 - lava_callback - DEBUG - Processing node 68d5c3f52be2da466069a6c4: baseline-arm64 2025-09-27 04:18:24,418 - lava_callback - ERROR - Error processing callback for node 68d5c3f52be2da466069a6c4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36822 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:18:29,541 - lava_callback - INFO - Received callback for node 68d5fccd30c58dac7d9418d6 INFO: 172.21.0.1:44808 - "POST /node/68d5fccd30c58dac7d9418d6 HTTP/1.0" 202 Accepted 2025-09-27 04:18:29,547 - lava_callback - INFO - Starting async job submit for node 68d5fccd30c58dac7d9418d6 2025-09-27 04:18:29,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:18:29,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fccd30c58dac7d9418d6 HTTP/1.1" 200 None 2025-09-27 04:18:29,591 - lava_callback - DEBUG - Processing node 68d5fccd30c58dac7d9418d6: baseline-arm 2025-09-27 04:18:29,840 - lava_callback - ERROR - Error processing callback for node 68d5fccd30c58dac7d9418d6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:19:02,415 - lava_callback - INFO - Received callback for node 68d5c3f52be2da466069a6c1 INFO: 172.21.0.1:56420 - "POST /node/68d5c3f52be2da466069a6c1 HTTP/1.0" 202 Accepted 2025-09-27 04:19:02,421 - lava_callback - INFO - Starting async job submit for node 68d5c3f52be2da466069a6c1 2025-09-27 04:19:02,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:19:02,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c3f52be2da466069a6c1 HTTP/1.1" 200 None 2025-09-27 04:19:02,456 - lava_callback - DEBUG - Processing node 68d5c3f52be2da466069a6c1: baseline-arm64 2025-09-27 04:19:02,826 - lava_callback - ERROR - Error processing callback for node 68d5c3f52be2da466069a6c1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:19:03,774 - lava_callback - INFO - Received callback for node 68d5c4112be2da466069a6f7 INFO: 172.21.0.1:56422 - "POST /node/68d5c4112be2da466069a6f7 HTTP/1.0" 202 Accepted 2025-09-27 04:19:03,781 - lava_callback - INFO - Starting async job submit for node 68d5c4112be2da466069a6f7 2025-09-27 04:19:03,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:19:03,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c4112be2da466069a6f7 HTTP/1.1" 200 None 2025-09-27 04:19:03,835 - lava_callback - DEBUG - Processing node 68d5c4112be2da466069a6f7: baseline-arm64 2025-09-27 04:19:04,209 - lava_callback - ERROR - Error processing callback for node 68d5c4112be2da466069a6f7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:19:42,668 - lava_callback - INFO - Received callback for node 68d4c2e5a5c2c05277bcfcdc INFO: 172.21.0.1:47338 - "POST /node/68d4c2e5a5c2c05277bcfcdc HTTP/1.0" 202 Accepted 2025-09-27 04:19:42,673 - lava_callback - INFO - Starting async job submit for node 68d4c2e5a5c2c05277bcfcdc 2025-09-27 04:19:42,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:19:42,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2e5a5c2c05277bcfcdc HTTP/1.1" 200 None 2025-09-27 04:19:42,730 - lava_callback - DEBUG - Processing node 68d4c2e5a5c2c05277bcfcdc: baseline-arm-broonie 2025-09-27 04:19:42,920 - lava_callback - ERROR - Error processing callback for node 68d4c2e5a5c2c05277bcfcdc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:19:43,918 - lava_callback - INFO - Received callback for node 68d5c4122be2da466069a6fa INFO: 172.21.0.1:47340 - "POST /node/68d5c4122be2da466069a6fa HTTP/1.0" 202 Accepted 2025-09-27 04:19:43,924 - lava_callback - INFO - Starting async job submit for node 68d5c4122be2da466069a6fa 2025-09-27 04:19:43,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:19:43,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c4122be2da466069a6fa HTTP/1.1" 200 None 2025-09-27 04:19:43,960 - lava_callback - DEBUG - Processing node 68d5c4122be2da466069a6fa: baseline-arm64 2025-09-27 04:19:44,292 - lava_callback - ERROR - Error processing callback for node 68d5c4122be2da466069a6fa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:19:55,985 - lava_callback - INFO - Received callback for node 68d4c2dda5c2c05277bcfcc4 INFO: 172.21.0.1:50012 - "POST /node/68d4c2dda5c2c05277bcfcc4 HTTP/1.0" 202 Accepted 2025-09-27 04:19:55,991 - lava_callback - INFO - Starting async job submit for node 68d4c2dda5c2c05277bcfcc4 2025-09-27 04:19:55,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:19:56,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2dda5c2c05277bcfcc4 HTTP/1.1" 200 None 2025-09-27 04:19:56,015 - lava_callback - DEBUG - Processing node 68d4c2dda5c2c05277bcfcc4: baseline-arm 2025-09-27 04:19:56,015 - lava_callback - ERROR - Error processing callback for node 68d4c2dda5c2c05277bcfcc4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:19:56,644 - lava_callback - INFO - Received callback for node 68d4c2dda5c2c05277bcfcc7 INFO: 172.21.0.1:50024 - "POST /node/68d4c2dda5c2c05277bcfcc7 HTTP/1.0" 202 Accepted 2025-09-27 04:19:56,649 - lava_callback - INFO - Starting async job submit for node 68d4c2dda5c2c05277bcfcc7 2025-09-27 04:19:56,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:19:56,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2dda5c2c05277bcfcc7 HTTP/1.1" 200 None 2025-09-27 04:19:56,663 - lava_callback - DEBUG - Processing node 68d4c2dda5c2c05277bcfcc7: baseline-arm 2025-09-27 04:19:56,663 - lava_callback - ERROR - Error processing callback for node 68d4c2dda5c2c05277bcfcc7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:19:57,289 - lava_callback - INFO - Received callback for node 68d4c2dfa5c2c05277bcfcca INFO: 172.21.0.1:50034 - "POST /node/68d4c2dfa5c2c05277bcfcca HTTP/1.0" 202 Accepted 2025-09-27 04:19:57,294 - lava_callback - INFO - Starting async job submit for node 68d4c2dfa5c2c05277bcfcca 2025-09-27 04:19:57,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:19:57,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2dfa5c2c05277bcfcca HTTP/1.1" 200 None 2025-09-27 04:19:57,307 - lava_callback - DEBUG - Processing node 68d4c2dfa5c2c05277bcfcca: baseline-arm 2025-09-27 04:19:57,307 - lava_callback - ERROR - Error processing callback for node 68d4c2dfa5c2c05277bcfcca: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:19:57,921 - lava_callback - INFO - Received callback for node 68d4c2dfa5c2c05277bcfccd INFO: 172.21.0.1:50050 - "POST /node/68d4c2dfa5c2c05277bcfccd HTTP/1.0" 202 Accepted 2025-09-27 04:19:57,927 - lava_callback - INFO - Starting async job submit for node 68d4c2dfa5c2c05277bcfccd 2025-09-27 04:19:57,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:19:57,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2dfa5c2c05277bcfccd HTTP/1.1" 200 None 2025-09-27 04:19:57,947 - lava_callback - DEBUG - Processing node 68d4c2dfa5c2c05277bcfccd: baseline-arm 2025-09-27 04:19:57,947 - lava_callback - ERROR - Error processing callback for node 68d4c2dfa5c2c05277bcfccd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:20:23,753 - lava_callback - INFO - Received callback for node 68d5c9db2be2da466069a987 INFO: 172.21.0.1:49372 - "POST /node/68d5c9db2be2da466069a987 HTTP/1.0" 202 Accepted 2025-09-27 04:20:23,759 - lava_callback - INFO - Starting async job submit for node 68d5c9db2be2da466069a987 2025-09-27 04:20:23,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:23,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c9db2be2da466069a987 HTTP/1.1" 200 None 2025-09-27 04:20:23,794 - lava_callback - DEBUG - Processing node 68d5c9db2be2da466069a987: baseline-arm64 2025-09-27 04:20:24,036 - lava_callback - INFO - Received callback for node 68d4c2fca5c2c05277bcfd00 INFO: 172.21.0.1:49380 - "POST /node/68d4c2fca5c2c05277bcfd00 HTTP/1.0" 202 Accepted 2025-09-27 04:20:24,062 - lava_callback - INFO - Starting async job submit for node 68d4c2fca5c2c05277bcfd00 2025-09-27 04:20:24,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:24,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2fca5c2c05277bcfd00 HTTP/1.1" 200 None 2025-09-27 04:20:24,160 - lava_callback - ERROR - Error processing callback for node 68d5c9db2be2da466069a987: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:20:24,160 - lava_callback - DEBUG - Processing node 68d4c2fca5c2c05277bcfd00: ltp-cve 2025-09-27 04:20:24,161 - lava_callback - ERROR - Error processing callback for node 68d4c2fca5c2c05277bcfd00: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:20:24,850 - lava_callback - INFO - Received callback for node 68d4c2ffa5c2c05277bcfd06 INFO: 172.21.0.1:49388 - "POST /node/68d4c2ffa5c2c05277bcfd06 HTTP/1.0" 202 Accepted 2025-09-27 04:20:24,856 - lava_callback - INFO - Starting async job submit for node 68d4c2ffa5c2c05277bcfd06 2025-09-27 04:20:24,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:24,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2ffa5c2c05277bcfd06 HTTP/1.1" 200 None 2025-09-27 04:20:24,869 - lava_callback - DEBUG - Processing node 68d4c2ffa5c2c05277bcfd06: ltp-fs-bind 2025-09-27 04:20:24,869 - lava_callback - ERROR - Error processing callback for node 68d4c2ffa5c2c05277bcfd06: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:20:25,649 - lava_callback - INFO - Received callback for node 68d4c301a5c2c05277bcfd09 INFO: 172.21.0.1:49402 - "POST /node/68d4c301a5c2c05277bcfd09 HTTP/1.0" 202 Accepted 2025-09-27 04:20:25,655 - lava_callback - INFO - Starting async job submit for node 68d4c301a5c2c05277bcfd09 2025-09-27 04:20:25,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:25,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c301a5c2c05277bcfd09 HTTP/1.1" 200 None 2025-09-27 04:20:25,669 - lava_callback - DEBUG - Processing node 68d4c301a5c2c05277bcfd09: ltp-fsx 2025-09-27 04:20:25,669 - lava_callback - ERROR - Error processing callback for node 68d4c301a5c2c05277bcfd09: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:20:31,850 - lava_callback - INFO - Received callback for node 68d5c9db2be2da466069a98a INFO: 172.21.0.1:44382 - "POST /node/68d5c9db2be2da466069a98a HTTP/1.0" 202 Accepted 2025-09-27 04:20:31,856 - lava_callback - INFO - Starting async job submit for node 68d5c9db2be2da466069a98a 2025-09-27 04:20:31,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:31,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c9db2be2da466069a98a HTTP/1.1" 200 None 2025-09-27 04:20:31,896 - lava_callback - DEBUG - Processing node 68d5c9db2be2da466069a98a: baseline-arm64 2025-09-27 04:20:32,228 - lava_callback - ERROR - Error processing callback for node 68d5c9db2be2da466069a98a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40710 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:20:43,991 - lava_callback - INFO - Received callback for node 68d4c310a5c2c05277bcfd20 INFO: 172.21.0.1:40718 - "POST /node/68d4c310a5c2c05277bcfd20 HTTP/1.0" 202 Accepted 2025-09-27 04:20:43,997 - lava_callback - INFO - Starting async job submit for node 68d4c310a5c2c05277bcfd20 2025-09-27 04:20:43,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:44,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c310a5c2c05277bcfd20 HTTP/1.1" 200 None 2025-09-27 04:20:44,043 - lava_callback - DEBUG - Processing node 68d4c310a5c2c05277bcfd20: ltp-input 2025-09-27 04:20:44,043 - lava_callback - ERROR - Error processing callback for node 68d4c310a5c2c05277bcfd20: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:20:44,754 - lava_callback - INFO - Received callback for node 68d4c312a5c2c05277bcfd23 INFO: 172.21.0.1:40732 - "POST /node/68d4c312a5c2c05277bcfd23 HTTP/1.0" 202 Accepted 2025-09-27 04:20:44,760 - lava_callback - INFO - Starting async job submit for node 68d4c312a5c2c05277bcfd23 2025-09-27 04:20:44,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:44,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c312a5c2c05277bcfd23 HTTP/1.1" 200 None 2025-09-27 04:20:44,776 - lava_callback - DEBUG - Processing node 68d4c312a5c2c05277bcfd23: ltp-ipc 2025-09-27 04:20:44,776 - lava_callback - ERROR - Error processing callback for node 68d4c312a5c2c05277bcfd23: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:20:45,482 - lava_callback - INFO - Received callback for node 68d4c314a5c2c05277bcfd26 INFO: 172.21.0.1:40748 - "POST /node/68d4c314a5c2c05277bcfd26 HTTP/1.0" 202 Accepted 2025-09-27 04:20:45,488 - lava_callback - INFO - Starting async job submit for node 68d4c314a5c2c05277bcfd26 2025-09-27 04:20:45,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:45,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c314a5c2c05277bcfd26 HTTP/1.1" 200 None 2025-09-27 04:20:45,502 - lava_callback - DEBUG - Processing node 68d4c314a5c2c05277bcfd26: ltp-pty 2025-09-27 04:20:45,502 - lava_callback - ERROR - Error processing callback for node 68d4c314a5c2c05277bcfd26: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:20:46,232 - lava_callback - INFO - Received callback for node 68d4c315a5c2c05277bcfd29 INFO: 172.21.0.1:40758 - "POST /node/68d4c315a5c2c05277bcfd29 HTTP/1.0" 202 Accepted 2025-09-27 04:20:46,238 - lava_callback - INFO - Starting async job submit for node 68d4c315a5c2c05277bcfd29 2025-09-27 04:20:46,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:46,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c315a5c2c05277bcfd29 HTTP/1.1" 200 None 2025-09-27 04:20:46,274 - lava_callback - DEBUG - Processing node 68d4c315a5c2c05277bcfd29: ltp-sched 2025-09-27 04:20:46,274 - lava_callback - ERROR - Error processing callback for node 68d4c315a5c2c05277bcfd29: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:20:47,005 - lava_callback - INFO - Received callback for node 68d4c317a5c2c05277bcfd2c INFO: 172.21.0.1:40774 - "POST /node/68d4c317a5c2c05277bcfd2c HTTP/1.0" 202 Accepted 2025-09-27 04:20:47,011 - lava_callback - INFO - Starting async job submit for node 68d4c317a5c2c05277bcfd2c 2025-09-27 04:20:47,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:47,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c317a5c2c05277bcfd2c HTTP/1.1" 200 None 2025-09-27 04:20:47,025 - lava_callback - DEBUG - Processing node 68d4c317a5c2c05277bcfd2c: ltp-smoketest 2025-09-27 04:20:47,025 - lava_callback - ERROR - Error processing callback for node 68d4c317a5c2c05277bcfd2c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:20:47,791 - lava_callback - INFO - Received callback for node 68d4c31ba5c2c05277bcfd32 INFO: 172.21.0.1:40780 - "POST /node/68d4c31ba5c2c05277bcfd32 HTTP/1.0" 202 Accepted 2025-09-27 04:20:47,797 - lava_callback - INFO - Starting async job submit for node 68d4c31ba5c2c05277bcfd32 2025-09-27 04:20:47,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:47,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c31ba5c2c05277bcfd32 HTTP/1.1" 200 None 2025-09-27 04:20:47,812 - lava_callback - DEBUG - Processing node 68d4c31ba5c2c05277bcfd32: ltp-syscalls-ipc 2025-09-27 04:20:47,812 - lava_callback - ERROR - Error processing callback for node 68d4c31ba5c2c05277bcfd32: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:20:48,522 - lava_callback - INFO - Received callback for node 68d4c31ca5c2c05277bcfd35 INFO: 172.21.0.1:40788 - "POST /node/68d4c31ca5c2c05277bcfd35 HTTP/1.0" 202 Accepted 2025-09-27 04:20:48,528 - lava_callback - INFO - Starting async job submit for node 68d4c31ca5c2c05277bcfd35 2025-09-27 04:20:48,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:48,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c31ca5c2c05277bcfd35 HTTP/1.1" 200 None 2025-09-27 04:20:48,546 - lava_callback - DEBUG - Processing node 68d4c31ca5c2c05277bcfd35: ltp-timers 2025-09-27 04:20:48,546 - lava_callback - ERROR - Error processing callback for node 68d4c31ca5c2c05277bcfd35: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:20:49,270 - lava_callback - INFO - Received callback for node 68d4c31ea5c2c05277bcfd38 INFO: 172.21.0.1:40800 - "POST /node/68d4c31ea5c2c05277bcfd38 HTTP/1.0" 202 Accepted 2025-09-27 04:20:49,276 - lava_callback - INFO - Starting async job submit for node 68d4c31ea5c2c05277bcfd38 2025-09-27 04:20:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:49,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c31ea5c2c05277bcfd38 HTTP/1.1" 200 None 2025-09-27 04:20:49,312 - lava_callback - DEBUG - Processing node 68d4c31ea5c2c05277bcfd38: ltp-watchqueue 2025-09-27 04:20:49,312 - lava_callback - ERROR - Error processing callback for node 68d4c31ea5c2c05277bcfd38: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:20:51,952 - lava_callback - INFO - Received callback for node 68d5fccf30c58dac7d9418d9 INFO: 172.21.0.1:40280 - "POST /node/68d5fccf30c58dac7d9418d9 HTTP/1.0" 202 Accepted 2025-09-27 04:20:51,958 - lava_callback - INFO - Starting async job submit for node 68d5fccf30c58dac7d9418d9 2025-09-27 04:20:51,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:20:51,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fccf30c58dac7d9418d9 HTTP/1.1" 200 None 2025-09-27 04:20:51,991 - lava_callback - DEBUG - Processing node 68d5fccf30c58dac7d9418d9: baseline-arm 2025-09-27 04:20:52,218 - lava_callback - ERROR - Error processing callback for node 68d5fccf30c58dac7d9418d9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:21:04,238 - lava_callback - INFO - Received callback for node 68d5c9f72be2da466069a9bd INFO: 172.21.0.1:50048 - "POST /node/68d5c9f72be2da466069a9bd HTTP/1.0" 202 Accepted 2025-09-27 04:21:04,245 - lava_callback - INFO - Starting async job submit for node 68d5c9f72be2da466069a9bd 2025-09-27 04:21:04,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:21:04,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c9f72be2da466069a9bd HTTP/1.1" 200 None 2025-09-27 04:21:04,278 - lava_callback - DEBUG - Processing node 68d5c9f72be2da466069a9bd: baseline-arm64 2025-09-27 04:21:04,632 - lava_callback - ERROR - Error processing callback for node 68d5c9f72be2da466069a9bd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 04:21:15,991 - lava_callback - INFO - Received callback for node 68d4c2f7a5c2c05277bcfcf7 INFO: 172.21.0.1:33708 - "POST /node/68d4c2f7a5c2c05277bcfcf7 HTTP/1.0" 202 Accepted 2025-09-27 04:21:15,998 - lava_callback - INFO - Starting async job submit for node 68d4c2f7a5c2c05277bcfcf7 2025-09-27 04:21:16,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:21:16,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2f7a5c2c05277bcfcf7 HTTP/1.1" 200 None 2025-09-27 04:21:16,037 - lava_callback - DEBUG - Processing node 68d4c2f7a5c2c05277bcfcf7: ltp-cap-bounds 2025-09-27 04:21:16,361 - lava_callback - ERROR - Error processing callback for node 68d4c2f7a5c2c05277bcfcf7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:21:19,973 - lava_callback - INFO - Received callback for node 68d4c32ea5c2c05277bcfd50 INFO: 172.21.0.1:49696 - "POST /node/68d4c32ea5c2c05277bcfd50 HTTP/1.0" 202 Accepted 2025-09-27 04:21:19,978 - lava_callback - INFO - Starting async job submit for node 68d4c32ea5c2c05277bcfd50 2025-09-27 04:21:19,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:21:20,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c32ea5c2c05277bcfd50 HTTP/1.1" 200 None 2025-09-27 04:21:20,013 - lava_callback - DEBUG - Processing node 68d4c32ea5c2c05277bcfd50: baseline-arm64-clabbe 2025-09-27 04:21:20,013 - lava_callback - ERROR - Error processing callback for node 68d4c32ea5c2c05277bcfd50: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:21:49,568 - lava_callback - INFO - Received callback for node 68d5c9f82be2da466069a9c0 INFO: 172.21.0.1:51630 - "POST /node/68d5c9f82be2da466069a9c0 HTTP/1.0" 202 Accepted 2025-09-27 04:21:49,574 - lava_callback - INFO - Starting async job submit for node 68d5c9f82be2da466069a9c0 2025-09-27 04:21:49,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:21:49,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c9f82be2da466069a9c0 HTTP/1.1" 200 None 2025-09-27 04:21:49,607 - lava_callback - DEBUG - Processing node 68d5c9f82be2da466069a9c0: baseline-arm64 2025-09-27 04:21:49,969 - lava_callback - ERROR - Error processing callback for node 68d5c9f82be2da466069a9c0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:21:59,955 - lava_callback - INFO - Received callback for node 68d4c353a5c2c05277bcfd65 INFO: 172.21.0.1:59178 - "POST /node/68d4c353a5c2c05277bcfd65 HTTP/1.0" 202 Accepted 2025-09-27 04:21:59,961 - lava_callback - INFO - Starting async job submit for node 68d4c353a5c2c05277bcfd65 2025-09-27 04:21:59,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:21:59,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c353a5c2c05277bcfd65 HTTP/1.1" 200 None 2025-09-27 04:21:59,976 - lava_callback - DEBUG - Processing node 68d4c353a5c2c05277bcfd65: baseline-arm64-clabbe 2025-09-27 04:21:59,976 - lava_callback - ERROR - Error processing callback for node 68d4c353a5c2c05277bcfd65: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:22:00,605 - lava_callback - INFO - Received callback for node 68d4c35fa5c2c05277bcfd6e INFO: 172.21.0.1:59192 - "POST /node/68d4c35fa5c2c05277bcfd6e HTTP/1.0" 202 Accepted 2025-09-27 04:22:00,612 - lava_callback - INFO - Starting async job submit for node 68d4c35fa5c2c05277bcfd6e 2025-09-27 04:22:00,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:22:00,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c35fa5c2c05277bcfd6e HTTP/1.1" 200 None 2025-09-27 04:22:00,628 - lava_callback - DEBUG - Processing node 68d4c35fa5c2c05277bcfd6e: baseline-arm64-clabbe 2025-09-27 04:22:00,628 - lava_callback - ERROR - Error processing callback for node 68d4c35fa5c2c05277bcfd6e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:22:01,254 - lava_callback - INFO - Received callback for node 68d4c361a5c2c05277bcfd71 INFO: 172.21.0.1:59200 - "POST /node/68d4c361a5c2c05277bcfd71 HTTP/1.0" 202 Accepted 2025-09-27 04:22:01,259 - lava_callback - INFO - Starting async job submit for node 68d4c361a5c2c05277bcfd71 2025-09-27 04:22:01,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:22:01,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c361a5c2c05277bcfd71 HTTP/1.1" 200 None 2025-09-27 04:22:01,274 - lava_callback - DEBUG - Processing node 68d4c361a5c2c05277bcfd71: baseline-arm64-clabbe 2025-09-27 04:22:01,274 - lava_callback - ERROR - Error processing callback for node 68d4c361a5c2c05277bcfd71: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:22:01,894 - lava_callback - INFO - Received callback for node 68d4c364a5c2c05277bcfd74 INFO: 172.21.0.1:59216 - "POST /node/68d4c364a5c2c05277bcfd74 HTTP/1.0" 202 Accepted 2025-09-27 04:22:01,899 - lava_callback - INFO - Starting async job submit for node 68d4c364a5c2c05277bcfd74 2025-09-27 04:22:01,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:22:01,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c364a5c2c05277bcfd74 HTTP/1.1" 200 None 2025-09-27 04:22:01,919 - lava_callback - DEBUG - Processing node 68d4c364a5c2c05277bcfd74: baseline-arm64-clabbe 2025-09-27 04:22:01,919 - lava_callback - ERROR - Error processing callback for node 68d4c364a5c2c05277bcfd74: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:22:56,309 - lava_callback - INFO - Received callback for node 68d4c39ba5c2c05277bcfdce INFO: 172.21.0.1:55008 - "POST /node/68d4c39ba5c2c05277bcfdce HTTP/1.0" 202 Accepted 2025-09-27 04:22:56,315 - lava_callback - INFO - Starting async job submit for node 68d4c39ba5c2c05277bcfdce 2025-09-27 04:22:56,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:22:56,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c39ba5c2c05277bcfdce HTTP/1.1" 200 None 2025-09-27 04:22:56,328 - lava_callback - DEBUG - Processing node 68d4c39ba5c2c05277bcfdce: baseline-arm 2025-09-27 04:22:56,328 - lava_callback - ERROR - Error processing callback for node 68d4c39ba5c2c05277bcfdce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:22:57,027 - lava_callback - INFO - Received callback for node 68d4c39ca5c2c05277bcfdd1 INFO: 172.21.0.1:55030 - "POST /node/68d4c39ca5c2c05277bcfdd1 HTTP/1.0" 202 Accepted 2025-09-27 04:22:57,033 - lava_callback - INFO - Starting async job submit for node 68d4c39ca5c2c05277bcfdd1 2025-09-27 04:22:57,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:22:57,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c39ca5c2c05277bcfdd1 HTTP/1.1" 200 None 2025-09-27 04:22:57,068 - lava_callback - DEBUG - Processing node 68d4c39ca5c2c05277bcfdd1: baseline-arm 2025-09-27 04:22:57,068 - lava_callback - ERROR - Error processing callback for node 68d4c39ca5c2c05277bcfdd1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:22:57,701 - lava_callback - INFO - Received callback for node 68d4c39da5c2c05277bcfdd4 INFO: 172.21.0.1:55044 - "POST /node/68d4c39da5c2c05277bcfdd4 HTTP/1.0" 202 Accepted 2025-09-27 04:22:57,707 - lava_callback - INFO - Starting async job submit for node 68d4c39da5c2c05277bcfdd4 2025-09-27 04:22:57,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:22:57,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c39da5c2c05277bcfdd4 HTTP/1.1" 200 None 2025-09-27 04:22:57,721 - lava_callback - DEBUG - Processing node 68d4c39da5c2c05277bcfdd4: baseline-arm 2025-09-27 04:22:57,721 - lava_callback - ERROR - Error processing callback for node 68d4c39da5c2c05277bcfdd4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:22:58,363 - lava_callback - INFO - Received callback for node 68d4c39ea5c2c05277bcfdd7 INFO: 172.21.0.1:55050 - "POST /node/68d4c39ea5c2c05277bcfdd7 HTTP/1.0" 202 Accepted 2025-09-27 04:22:58,368 - lava_callback - INFO - Starting async job submit for node 68d4c39ea5c2c05277bcfdd7 2025-09-27 04:22:58,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:22:58,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c39ea5c2c05277bcfdd7 HTTP/1.1" 200 None 2025-09-27 04:22:58,382 - lava_callback - DEBUG - Processing node 68d4c39ea5c2c05277bcfdd7: baseline-arm 2025-09-27 04:22:58,382 - lava_callback - ERROR - Error processing callback for node 68d4c39ea5c2c05277bcfdd7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:23:12,077 - lava_callback - INFO - Received callback for node 68d5fccf30c58dac7d9418dc INFO: 172.21.0.1:43628 - "POST /node/68d5fccf30c58dac7d9418dc HTTP/1.0" 202 Accepted 2025-09-27 04:23:12,083 - lava_callback - INFO - Starting async job submit for node 68d5fccf30c58dac7d9418dc 2025-09-27 04:23:12,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:12,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fccf30c58dac7d9418dc HTTP/1.1" 200 None 2025-09-27 04:23:12,117 - lava_callback - DEBUG - Processing node 68d5fccf30c58dac7d9418dc: baseline-arm 2025-09-27 04:23:12,347 - lava_callback - ERROR - Error processing callback for node 68d5fccf30c58dac7d9418dc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43644 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 04:23:16,032 - lava_callback - INFO - Received callback for node 68d4c3dea5c2c05277bcfe87 INFO: 172.21.0.1:43658 - "POST /node/68d4c3dea5c2c05277bcfe87 HTTP/1.0" 202 Accepted 2025-09-27 04:23:16,038 - lava_callback - INFO - Starting async job submit for node 68d4c3dea5c2c05277bcfe87 2025-09-27 04:23:16,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:16,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3dea5c2c05277bcfe87 HTTP/1.1" 200 None 2025-09-27 04:23:16,074 - lava_callback - DEBUG - Processing node 68d4c3dea5c2c05277bcfe87: baseline-arm-broonie 2025-09-27 04:23:16,224 - lava_callback - INFO - Received callback for node 68d4c39fa5c2c05277bcfdda 2025-09-27 04:23:16,229 - lava_callback - INFO - Starting async job submit for node 68d4c39fa5c2c05277bcfdda 2025-09-27 04:23:16,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43674 - "POST /node/68d4c39fa5c2c05277bcfdda HTTP/1.0" 202 Accepted 2025-09-27 04:23:16,272 - lava_callback - ERROR - Error processing callback for node 68d4c3dea5c2c05277bcfe87: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:23:16,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c39fa5c2c05277bcfdda HTTP/1.1" 200 None 2025-09-27 04:23:16,276 - lava_callback - DEBUG - Processing node 68d4c39fa5c2c05277bcfdda: baseline-arm 2025-09-27 04:23:16,276 - lava_callback - ERROR - Error processing callback for node 68d4c39fa5c2c05277bcfdda: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:23:16,877 - lava_callback - INFO - Received callback for node 68d4c3a0a5c2c05277bcfddd INFO: 172.21.0.1:43696 - "POST /node/68d4c3a0a5c2c05277bcfddd HTTP/1.0" 202 Accepted 2025-09-27 04:23:16,883 - lava_callback - INFO - Starting async job submit for node 68d4c3a0a5c2c05277bcfddd 2025-09-27 04:23:16,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:16,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3a0a5c2c05277bcfddd HTTP/1.1" 200 None 2025-09-27 04:23:16,897 - lava_callback - DEBUG - Processing node 68d4c3a0a5c2c05277bcfddd: baseline-arm 2025-09-27 04:23:16,897 - lava_callback - ERROR - Error processing callback for node 68d4c3a0a5c2c05277bcfddd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:23:17,522 - lava_callback - INFO - Received callback for node 68d4c3a2a5c2c05277bcfde0 INFO: 172.21.0.1:43698 - "POST /node/68d4c3a2a5c2c05277bcfde0 HTTP/1.0" 202 Accepted 2025-09-27 04:23:17,528 - lava_callback - INFO - Starting async job submit for node 68d4c3a2a5c2c05277bcfde0 2025-09-27 04:23:17,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:17,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3a2a5c2c05277bcfde0 HTTP/1.1" 200 None 2025-09-27 04:23:17,542 - lava_callback - DEBUG - Processing node 68d4c3a2a5c2c05277bcfde0: baseline-arm 2025-09-27 04:23:17,542 - lava_callback - ERROR - Error processing callback for node 68d4c3a2a5c2c05277bcfde0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:23:18,176 - lava_callback - INFO - Received callback for node 68d4c3a2a5c2c05277bcfde3 INFO: 172.21.0.1:43706 - "POST /node/68d4c3a2a5c2c05277bcfde3 HTTP/1.0" 202 Accepted 2025-09-27 04:23:18,181 - lava_callback - INFO - Starting async job submit for node 68d4c3a2a5c2c05277bcfde3 2025-09-27 04:23:18,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:18,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3a2a5c2c05277bcfde3 HTTP/1.1" 200 None 2025-09-27 04:23:18,196 - lava_callback - DEBUG - Processing node 68d4c3a2a5c2c05277bcfde3: baseline-arm 2025-09-27 04:23:18,196 - lava_callback - ERROR - Error processing callback for node 68d4c3a2a5c2c05277bcfde3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:23:36,547 - lava_callback - INFO - Received callback for node 68d4c3c0a5c2c05277bcfe2e INFO: 172.21.0.1:38802 - "POST /node/68d4c3c0a5c2c05277bcfe2e HTTP/1.0" 202 Accepted 2025-09-27 04:23:36,553 - lava_callback - INFO - Starting async job submit for node 68d4c3c0a5c2c05277bcfe2e 2025-09-27 04:23:36,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:36,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3c0a5c2c05277bcfe2e HTTP/1.1" 200 None 2025-09-27 04:23:36,566 - lava_callback - DEBUG - Processing node 68d4c3c0a5c2c05277bcfe2e: baseline-arm 2025-09-27 04:23:36,566 - lava_callback - ERROR - Error processing callback for node 68d4c3c0a5c2c05277bcfe2e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:23:37,231 - lava_callback - INFO - Received callback for node 68d4c3c1a5c2c05277bcfe31 INFO: 172.21.0.1:38818 - "POST /node/68d4c3c1a5c2c05277bcfe31 HTTP/1.0" 202 Accepted 2025-09-27 04:23:37,236 - lava_callback - INFO - Starting async job submit for node 68d4c3c1a5c2c05277bcfe31 2025-09-27 04:23:37,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:37,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3c1a5c2c05277bcfe31 HTTP/1.1" 200 None 2025-09-27 04:23:37,250 - lava_callback - DEBUG - Processing node 68d4c3c1a5c2c05277bcfe31: baseline-arm 2025-09-27 04:23:37,250 - lava_callback - ERROR - Error processing callback for node 68d4c3c1a5c2c05277bcfe31: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:23:37,896 - lava_callback - INFO - Received callback for node 68d4c3c2a5c2c05277bcfe34 INFO: 172.21.0.1:38820 - "POST /node/68d4c3c2a5c2c05277bcfe34 HTTP/1.0" 202 Accepted 2025-09-27 04:23:37,902 - lava_callback - INFO - Starting async job submit for node 68d4c3c2a5c2c05277bcfe34 2025-09-27 04:23:37,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:37,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3c2a5c2c05277bcfe34 HTTP/1.1" 200 None 2025-09-27 04:23:37,921 - lava_callback - DEBUG - Processing node 68d4c3c2a5c2c05277bcfe34: baseline-arm 2025-09-27 04:23:37,921 - lava_callback - ERROR - Error processing callback for node 68d4c3c2a5c2c05277bcfe34: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:23:38,576 - lava_callback - INFO - Received callback for node 68d4c3c3a5c2c05277bcfe37 INFO: 172.21.0.1:38830 - "POST /node/68d4c3c3a5c2c05277bcfe37 HTTP/1.0" 202 Accepted 2025-09-27 04:23:38,582 - lava_callback - INFO - Starting async job submit for node 68d4c3c3a5c2c05277bcfe37 2025-09-27 04:23:38,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:38,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3c3a5c2c05277bcfe37 HTTP/1.1" 200 None 2025-09-27 04:23:38,621 - lava_callback - DEBUG - Processing node 68d4c3c3a5c2c05277bcfe37: baseline-arm 2025-09-27 04:23:38,621 - lava_callback - ERROR - Error processing callback for node 68d4c3c3a5c2c05277bcfe37: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:23:39,229 - lava_callback - INFO - Received callback for node 68d4c3c6a5c2c05277bcfe41 INFO: 172.21.0.1:38836 - "POST /node/68d4c3c6a5c2c05277bcfe41 HTTP/1.0" 202 Accepted 2025-09-27 04:23:39,235 - lava_callback - INFO - Starting async job submit for node 68d4c3c6a5c2c05277bcfe41 2025-09-27 04:23:39,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:39,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3c6a5c2c05277bcfe41 HTTP/1.1" 200 None 2025-09-27 04:23:39,275 - lava_callback - DEBUG - Processing node 68d4c3c6a5c2c05277bcfe41: baseline-arm 2025-09-27 04:23:39,275 - lava_callback - ERROR - Error processing callback for node 68d4c3c6a5c2c05277bcfe41: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:23:39,881 - lava_callback - INFO - Received callback for node 68d4c3c7a5c2c05277bcfe51 INFO: 172.21.0.1:41340 - "POST /node/68d4c3c7a5c2c05277bcfe51 HTTP/1.0" 202 Accepted 2025-09-27 04:23:39,886 - lava_callback - INFO - Starting async job submit for node 68d4c3c7a5c2c05277bcfe51 2025-09-27 04:23:39,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:39,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3c7a5c2c05277bcfe51 HTTP/1.1" 200 None 2025-09-27 04:23:39,919 - lava_callback - DEBUG - Processing node 68d4c3c7a5c2c05277bcfe51: baseline-arm 2025-09-27 04:23:39,919 - lava_callback - ERROR - Error processing callback for node 68d4c3c7a5c2c05277bcfe51: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:23:56,248 - lava_callback - INFO - Received callback for node 68d4c3c9a5c2c05277bcfe57 INFO: 172.21.0.1:59462 - "POST /node/68d4c3c9a5c2c05277bcfe57 HTTP/1.0" 202 Accepted 2025-09-27 04:23:56,253 - lava_callback - INFO - Starting async job submit for node 68d4c3c9a5c2c05277bcfe57 2025-09-27 04:23:56,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:56,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3c9a5c2c05277bcfe57 HTTP/1.1" 200 None 2025-09-27 04:23:56,273 - lava_callback - DEBUG - Processing node 68d4c3c9a5c2c05277bcfe57: baseline-arm 2025-09-27 04:23:56,273 - lava_callback - ERROR - Error processing callback for node 68d4c3c9a5c2c05277bcfe57: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:23:56,892 - lava_callback - INFO - Received callback for node 68d4c3c9a5c2c05277bcfe5a INFO: 172.21.0.1:59480 - "POST /node/68d4c3c9a5c2c05277bcfe5a HTTP/1.0" 202 Accepted 2025-09-27 04:23:56,897 - lava_callback - INFO - Starting async job submit for node 68d4c3c9a5c2c05277bcfe5a 2025-09-27 04:23:56,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:23:56,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3c9a5c2c05277bcfe5a HTTP/1.1" 200 None 2025-09-27 04:23:56,934 - lava_callback - DEBUG - Processing node 68d4c3c9a5c2c05277bcfe5a: baseline-arm 2025-09-27 04:23:56,934 - lava_callback - ERROR - Error processing callback for node 68d4c3c9a5c2c05277bcfe5a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:24:20,108 - lava_callback - INFO - Received callback for node 68d4c3eca5c2c05277bcfe9c INFO: 172.21.0.1:49710 - "POST /node/68d4c3eca5c2c05277bcfe9c HTTP/1.0" 202 Accepted 2025-09-27 04:24:20,114 - lava_callback - INFO - Starting async job submit for node 68d4c3eca5c2c05277bcfe9c 2025-09-27 04:24:20,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:24:20,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3eca5c2c05277bcfe9c HTTP/1.1" 200 None 2025-09-27 04:24:20,128 - lava_callback - DEBUG - Processing node 68d4c3eca5c2c05277bcfe9c: baseline-arm-clabbe 2025-09-27 04:24:20,128 - lava_callback - ERROR - Error processing callback for node 68d4c3eca5c2c05277bcfe9c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:24:20,760 - lava_callback - INFO - Received callback for node 68d4c3efa5c2c05277bcfea2 INFO: 172.21.0.1:49722 - "POST /node/68d4c3efa5c2c05277bcfea2 HTTP/1.0" 202 Accepted 2025-09-27 04:24:20,766 - lava_callback - INFO - Starting async job submit for node 68d4c3efa5c2c05277bcfea2 2025-09-27 04:24:20,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:24:20,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3efa5c2c05277bcfea2 HTTP/1.1" 200 None 2025-09-27 04:24:20,779 - lava_callback - DEBUG - Processing node 68d4c3efa5c2c05277bcfea2: baseline-arm-clabbe 2025-09-27 04:24:20,779 - lava_callback - ERROR - Error processing callback for node 68d4c3efa5c2c05277bcfea2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:24:21,399 - lava_callback - INFO - Received callback for node 68d4c3f1a5c2c05277bcfea5 INFO: 172.21.0.1:49726 - "POST /node/68d4c3f1a5c2c05277bcfea5 HTTP/1.0" 202 Accepted 2025-09-27 04:24:21,405 - lava_callback - INFO - Starting async job submit for node 68d4c3f1a5c2c05277bcfea5 2025-09-27 04:24:21,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:24:21,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3f1a5c2c05277bcfea5 HTTP/1.1" 200 None 2025-09-27 04:24:21,418 - lava_callback - DEBUG - Processing node 68d4c3f1a5c2c05277bcfea5: baseline-arm-clabbe 2025-09-27 04:24:21,418 - lava_callback - ERROR - Error processing callback for node 68d4c3f1a5c2c05277bcfea5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:24:24,207 - lava_callback - INFO - Received callback for node 68d4c3e4a5c2c05277bcfe90 INFO: 172.21.0.1:49732 - "POST /node/68d4c3e4a5c2c05277bcfe90 HTTP/1.0" 202 Accepted 2025-09-27 04:24:24,213 - lava_callback - INFO - Starting async job submit for node 68d4c3e4a5c2c05277bcfe90 2025-09-27 04:24:24,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:24:24,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c3e4a5c2c05277bcfe90 HTTP/1.1" 200 None 2025-09-27 04:24:24,227 - lava_callback - DEBUG - Processing node 68d4c3e4a5c2c05277bcfe90: baseline-arm-broonie 2025-09-27 04:24:24,227 - lava_callback - ERROR - Error processing callback for node 68d4c3e4a5c2c05277bcfe90: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:25:00,060 - lava_callback - INFO - Received callback for node 68d4c40ba5c2c05277bcfec5 INFO: 172.21.0.1:39350 - "POST /node/68d4c40ba5c2c05277bcfec5 HTTP/1.0" 202 Accepted 2025-09-27 04:25:00,066 - lava_callback - INFO - Starting async job submit for node 68d4c40ba5c2c05277bcfec5 2025-09-27 04:25:00,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:00,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c40ba5c2c05277bcfec5 HTTP/1.1" 200 None 2025-09-27 04:25:00,100 - lava_callback - DEBUG - Processing node 68d4c40ba5c2c05277bcfec5: baseline-arm-clabbe 2025-09-27 04:25:00,101 - lava_callback - ERROR - Error processing callback for node 68d4c40ba5c2c05277bcfec5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:04,202 - lava_callback - INFO - Received callback for node 68d4c41ca5c2c05277bcfee0 INFO: 172.21.0.1:39352 - "POST /node/68d4c41ca5c2c05277bcfee0 HTTP/1.0" 202 Accepted 2025-09-27 04:25:04,208 - lava_callback - INFO - Starting async job submit for node 68d4c41ca5c2c05277bcfee0 2025-09-27 04:25:04,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:04,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c41ca5c2c05277bcfee0 HTTP/1.1" 200 None 2025-09-27 04:25:04,240 - lava_callback - DEBUG - Processing node 68d4c41ca5c2c05277bcfee0: ltp-fs-bind 2025-09-27 04:25:04,240 - lava_callback - ERROR - Error processing callback for node 68d4c41ca5c2c05277bcfee0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:05,001 - lava_callback - INFO - Received callback for node 68d4c41ea5c2c05277bcfee3 INFO: 172.21.0.1:39362 - "POST /node/68d4c41ea5c2c05277bcfee3 HTTP/1.0" 202 Accepted 2025-09-27 04:25:05,007 - lava_callback - INFO - Starting async job submit for node 68d4c41ea5c2c05277bcfee3 2025-09-27 04:25:05,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:05,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c41ea5c2c05277bcfee3 HTTP/1.1" 200 None 2025-09-27 04:25:05,045 - lava_callback - DEBUG - Processing node 68d4c41ea5c2c05277bcfee3: ltp-fsx 2025-09-27 04:25:05,045 - lava_callback - ERROR - Error processing callback for node 68d4c41ea5c2c05277bcfee3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:05,850 - lava_callback - INFO - Received callback for node 68d4c420a5c2c05277bcfee6 INFO: 172.21.0.1:39366 - "POST /node/68d4c420a5c2c05277bcfee6 HTTP/1.0" 202 Accepted 2025-09-27 04:25:05,856 - lava_callback - INFO - Starting async job submit for node 68d4c420a5c2c05277bcfee6 2025-09-27 04:25:05,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:05,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c420a5c2c05277bcfee6 HTTP/1.1" 200 None 2025-09-27 04:25:05,881 - lava_callback - DEBUG - Processing node 68d4c420a5c2c05277bcfee6: ltp-input 2025-09-27 04:25:05,881 - lava_callback - ERROR - Error processing callback for node 68d4c420a5c2c05277bcfee6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:25:06,631 - lava_callback - INFO - Received callback for node 68d4c415a5c2c05277bcfed4 INFO: 172.21.0.1:39382 - "POST /node/68d4c415a5c2c05277bcfed4 HTTP/1.0" 202 Accepted 2025-09-27 04:25:06,637 - lava_callback - INFO - Starting async job submit for node 68d4c415a5c2c05277bcfed4 2025-09-27 04:25:06,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:06,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c415a5c2c05277bcfed4 HTTP/1.1" 200 None 2025-09-27 04:25:06,664 - lava_callback - DEBUG - Processing node 68d4c415a5c2c05277bcfed4: ltp-containers 2025-09-27 04:25:06,664 - lava_callback - ERROR - Error processing callback for node 68d4c415a5c2c05277bcfed4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:07,479 - lava_callback - INFO - Received callback for node 68d4c417a5c2c05277bcfed7 INFO: 172.21.0.1:39394 - "POST /node/68d4c417a5c2c05277bcfed7 HTTP/1.0" 202 Accepted 2025-09-27 04:25:07,485 - lava_callback - INFO - Starting async job submit for node 68d4c417a5c2c05277bcfed7 2025-09-27 04:25:07,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:07,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c417a5c2c05277bcfed7 HTTP/1.1" 200 None 2025-09-27 04:25:07,500 - lava_callback - DEBUG - Processing node 68d4c417a5c2c05277bcfed7: ltp-controllers 2025-09-27 04:25:07,500 - lava_callback - ERROR - Error processing callback for node 68d4c417a5c2c05277bcfed7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:08,262 - lava_callback - INFO - Received callback for node 68d4c419a5c2c05277bcfeda INFO: 172.21.0.1:39406 - "POST /node/68d4c419a5c2c05277bcfeda HTTP/1.0" 202 Accepted 2025-09-27 04:25:08,268 - lava_callback - INFO - Starting async job submit for node 68d4c419a5c2c05277bcfeda 2025-09-27 04:25:08,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:08,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c419a5c2c05277bcfeda HTTP/1.1" 200 None 2025-09-27 04:25:08,282 - lava_callback - DEBUG - Processing node 68d4c419a5c2c05277bcfeda: ltp-cve 2025-09-27 04:25:08,282 - lava_callback - ERROR - Error processing callback for node 68d4c419a5c2c05277bcfeda: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:09,014 - lava_callback - INFO - Received callback for node 68d4c421a5c2c05277bcfee9 INFO: 172.21.0.1:39416 - "POST /node/68d4c421a5c2c05277bcfee9 HTTP/1.0" 202 Accepted 2025-09-27 04:25:09,020 - lava_callback - INFO - Starting async job submit for node 68d4c421a5c2c05277bcfee9 2025-09-27 04:25:09,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:09,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c421a5c2c05277bcfee9 HTTP/1.1" 200 None 2025-09-27 04:25:09,042 - lava_callback - DEBUG - Processing node 68d4c421a5c2c05277bcfee9: ltp-ipc 2025-09-27 04:25:09,042 - lava_callback - ERROR - Error processing callback for node 68d4c421a5c2c05277bcfee9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:09,889 - lava_callback - INFO - Received callback for node 68d4c423a5c2c05277bcfeec INFO: 172.21.0.1:37974 - "POST /node/68d4c423a5c2c05277bcfeec HTTP/1.0" 202 Accepted 2025-09-27 04:25:09,895 - lava_callback - INFO - Starting async job submit for node 68d4c423a5c2c05277bcfeec 2025-09-27 04:25:09,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:09,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c423a5c2c05277bcfeec HTTP/1.1" 200 None 2025-09-27 04:25:09,909 - lava_callback - DEBUG - Processing node 68d4c423a5c2c05277bcfeec: ltp-pty 2025-09-27 04:25:09,909 - lava_callback - ERROR - Error processing callback for node 68d4c423a5c2c05277bcfeec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:10,658 - lava_callback - INFO - Received callback for node 68d4c425a5c2c05277bcfeef INFO: 172.21.0.1:37986 - "POST /node/68d4c425a5c2c05277bcfeef HTTP/1.0" 202 Accepted 2025-09-27 04:25:10,664 - lava_callback - INFO - Starting async job submit for node 68d4c425a5c2c05277bcfeef 2025-09-27 04:25:10,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:10,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c425a5c2c05277bcfeef HTTP/1.1" 200 None 2025-09-27 04:25:10,677 - lava_callback - DEBUG - Processing node 68d4c425a5c2c05277bcfeef: ltp-sched 2025-09-27 04:25:10,677 - lava_callback - ERROR - Error processing callback for node 68d4c425a5c2c05277bcfeef: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:37996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:25:23,111 - lava_callback - INFO - Received callback for node 68d5fcd130c58dac7d9418df INFO: 172.21.0.1:55800 - "POST /node/68d5fcd130c58dac7d9418df HTTP/1.0" 202 Accepted 2025-09-27 04:25:23,117 - lava_callback - INFO - Starting async job submit for node 68d5fcd130c58dac7d9418df 2025-09-27 04:25:23,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:23,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fcd130c58dac7d9418df HTTP/1.1" 200 None 2025-09-27 04:25:23,151 - lava_callback - DEBUG - Processing node 68d5fcd130c58dac7d9418df: baseline-arm 2025-09-27 04:25:23,397 - lava_callback - ERROR - Error processing callback for node 68d5fcd130c58dac7d9418df: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:25:24,201 - lava_callback - INFO - Received callback for node 68d4c426a5c2c05277bcfef2 INFO: 172.21.0.1:55808 - "POST /node/68d4c426a5c2c05277bcfef2 HTTP/1.0" 202 Accepted 2025-09-27 04:25:24,207 - lava_callback - INFO - Starting async job submit for node 68d4c426a5c2c05277bcfef2 2025-09-27 04:25:24,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:24,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c426a5c2c05277bcfef2 HTTP/1.1" 200 None 2025-09-27 04:25:24,221 - lava_callback - DEBUG - Processing node 68d4c426a5c2c05277bcfef2: ltp-smoketest 2025-09-27 04:25:24,221 - lava_callback - ERROR - Error processing callback for node 68d4c426a5c2c05277bcfef2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:24,949 - lava_callback - INFO - Received callback for node 68d4c428a5c2c05277bcfef5 INFO: 172.21.0.1:55812 - "POST /node/68d4c428a5c2c05277bcfef5 HTTP/1.0" 202 Accepted 2025-09-27 04:25:24,955 - lava_callback - INFO - Starting async job submit for node 68d4c428a5c2c05277bcfef5 2025-09-27 04:25:24,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:24,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c428a5c2c05277bcfef5 HTTP/1.1" 200 None 2025-09-27 04:25:24,968 - lava_callback - DEBUG - Processing node 68d4c428a5c2c05277bcfef5: ltp-syscalls 2025-09-27 04:25:24,968 - lava_callback - ERROR - Error processing callback for node 68d4c428a5c2c05277bcfef5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:25:36,367 - lava_callback - INFO - Received callback for node 68d4c2f9a5c2c05277bcfcfa INFO: 172.21.0.1:33600 - "POST /node/68d4c2f9a5c2c05277bcfcfa HTTP/1.0" 202 Accepted 2025-09-27 04:25:36,374 - lava_callback - INFO - Starting async job submit for node 68d4c2f9a5c2c05277bcfcfa 2025-09-27 04:25:36,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:36,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2f9a5c2c05277bcfcfa HTTP/1.1" 200 None 2025-09-27 04:25:36,489 - lava_callback - DEBUG - Processing node 68d4c2f9a5c2c05277bcfcfa: ltp-containers INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:25:37,283 - lava_callback - ERROR - Error processing callback for node 68d4c2f9a5c2c05277bcfcfa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40590 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:25:44,346 - lava_callback - INFO - Received callback for node 68d4c445a5c2c05277bcff13 INFO: 172.21.0.1:40600 - "POST /node/68d4c445a5c2c05277bcff13 HTTP/1.0" 202 Accepted 2025-09-27 04:25:44,352 - lava_callback - INFO - Starting async job submit for node 68d4c445a5c2c05277bcff13 2025-09-27 04:25:44,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:44,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c445a5c2c05277bcff13 HTTP/1.1" 200 None 2025-09-27 04:25:44,366 - lava_callback - DEBUG - Processing node 68d4c445a5c2c05277bcff13: ltp-timers 2025-09-27 04:25:44,366 - lava_callback - ERROR - Error processing callback for node 68d4c445a5c2c05277bcff13: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:25:45,118 - lava_callback - INFO - Received callback for node 68d4c447a5c2c05277bcff16 INFO: 172.21.0.1:40604 - "POST /node/68d4c447a5c2c05277bcff16 HTTP/1.0" 202 Accepted 2025-09-27 04:25:45,124 - lava_callback - INFO - Starting async job submit for node 68d4c447a5c2c05277bcff16 2025-09-27 04:25:45,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:25:45,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c447a5c2c05277bcff16 HTTP/1.1" 200 None 2025-09-27 04:25:45,158 - lava_callback - DEBUG - Processing node 68d4c447a5c2c05277bcff16: ltp-watchqueue 2025-09-27 04:25:45,158 - lava_callback - ERROR - Error processing callback for node 68d4c447a5c2c05277bcff16: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:26:16,574 - lava_callback - INFO - Received callback for node 68d4c454a5c2c05277bcff37 INFO: 172.21.0.1:37338 - "POST /node/68d4c454a5c2c05277bcff37 HTTP/1.0" 202 Accepted 2025-09-27 04:26:16,579 - lava_callback - INFO - Starting async job submit for node 68d4c454a5c2c05277bcff37 2025-09-27 04:26:16,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:16,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c454a5c2c05277bcff37 HTTP/1.1" 200 None 2025-09-27 04:26:16,593 - lava_callback - DEBUG - Processing node 68d4c454a5c2c05277bcff37: baseline-arm 2025-09-27 04:26:16,593 - lava_callback - ERROR - Error processing callback for node 68d4c454a5c2c05277bcff37: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:26:17,225 - lava_callback - INFO - Received callback for node 68d4c455a5c2c05277bcff3a INFO: 172.21.0.1:37350 - "POST /node/68d4c455a5c2c05277bcff3a HTTP/1.0" 202 Accepted 2025-09-27 04:26:17,231 - lava_callback - INFO - Starting async job submit for node 68d4c455a5c2c05277bcff3a 2025-09-27 04:26:17,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:17,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c455a5c2c05277bcff3a HTTP/1.1" 200 None 2025-09-27 04:26:17,246 - lava_callback - DEBUG - Processing node 68d4c455a5c2c05277bcff3a: baseline-arm 2025-09-27 04:26:17,246 - lava_callback - ERROR - Error processing callback for node 68d4c455a5c2c05277bcff3a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:26:17,878 - lava_callback - INFO - Received callback for node 68d4c456a5c2c05277bcff3d INFO: 172.21.0.1:37366 - "POST /node/68d4c456a5c2c05277bcff3d HTTP/1.0" 202 Accepted 2025-09-27 04:26:17,883 - lava_callback - INFO - Starting async job submit for node 68d4c456a5c2c05277bcff3d 2025-09-27 04:26:17,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:17,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c456a5c2c05277bcff3d HTTP/1.1" 200 None 2025-09-27 04:26:17,918 - lava_callback - DEBUG - Processing node 68d4c456a5c2c05277bcff3d: baseline-arm 2025-09-27 04:26:17,918 - lava_callback - ERROR - Error processing callback for node 68d4c456a5c2c05277bcff3d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:26:18,575 - lava_callback - INFO - Received callback for node 68d4c457a5c2c05277bcff40 INFO: 172.21.0.1:37382 - "POST /node/68d4c457a5c2c05277bcff40 HTTP/1.0" 202 Accepted 2025-09-27 04:26:18,580 - lava_callback - INFO - Starting async job submit for node 68d4c457a5c2c05277bcff40 2025-09-27 04:26:18,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:18,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c457a5c2c05277bcff40 HTTP/1.1" 200 None 2025-09-27 04:26:18,594 - lava_callback - DEBUG - Processing node 68d4c457a5c2c05277bcff40: baseline-arm 2025-09-27 04:26:18,594 - lava_callback - ERROR - Error processing callback for node 68d4c457a5c2c05277bcff40: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:26:19,278 - lava_callback - INFO - Received callback for node 68d4c466a5c2c05277bcff67 INFO: 172.21.0.1:37390 - "POST /node/68d4c466a5c2c05277bcff67 HTTP/1.0" 202 Accepted 2025-09-27 04:26:19,283 - lava_callback - INFO - Starting async job submit for node 68d4c466a5c2c05277bcff67 2025-09-27 04:26:19,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:19,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c466a5c2c05277bcff67 HTTP/1.1" 200 None 2025-09-27 04:26:19,313 - lava_callback - DEBUG - Processing node 68d4c466a5c2c05277bcff67: baseline-arm 2025-09-27 04:26:19,313 - lava_callback - ERROR - Error processing callback for node 68d4c466a5c2c05277bcff67: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:26:19,926 - lava_callback - INFO - Received callback for node 68d4c467a5c2c05277bcff6a INFO: 172.21.0.1:44944 - "POST /node/68d4c467a5c2c05277bcff6a HTTP/1.0" 202 Accepted 2025-09-27 04:26:19,931 - lava_callback - INFO - Starting async job submit for node 68d4c467a5c2c05277bcff6a 2025-09-27 04:26:19,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:19,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c467a5c2c05277bcff6a HTTP/1.1" 200 None 2025-09-27 04:26:19,947 - lava_callback - DEBUG - Processing node 68d4c467a5c2c05277bcff6a: baseline-arm 2025-09-27 04:26:19,947 - lava_callback - ERROR - Error processing callback for node 68d4c467a5c2c05277bcff6a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:26:36,533 - lava_callback - INFO - Received callback for node 68d4c468a5c2c05277bcff6d INFO: 172.21.0.1:43402 - "POST /node/68d4c468a5c2c05277bcff6d HTTP/1.0" 202 Accepted 2025-09-27 04:26:36,539 - lava_callback - INFO - Starting async job submit for node 68d4c468a5c2c05277bcff6d 2025-09-27 04:26:36,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:36,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c468a5c2c05277bcff6d HTTP/1.1" 200 None 2025-09-27 04:26:36,552 - lava_callback - DEBUG - Processing node 68d4c468a5c2c05277bcff6d: baseline-arm 2025-09-27 04:26:36,553 - lava_callback - ERROR - Error processing callback for node 68d4c468a5c2c05277bcff6d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:26:37,189 - lava_callback - INFO - Received callback for node 68d4c469a5c2c05277bcff70 INFO: 172.21.0.1:43404 - "POST /node/68d4c469a5c2c05277bcff70 HTTP/1.0" 202 Accepted 2025-09-27 04:26:37,195 - lava_callback - INFO - Starting async job submit for node 68d4c469a5c2c05277bcff70 2025-09-27 04:26:37,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:37,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c469a5c2c05277bcff70 HTTP/1.1" 200 None 2025-09-27 04:26:37,210 - lava_callback - DEBUG - Processing node 68d4c469a5c2c05277bcff70: baseline-arm 2025-09-27 04:26:37,211 - lava_callback - ERROR - Error processing callback for node 68d4c469a5c2c05277bcff70: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:26:44,352 - lava_callback - INFO - Received callback for node 68d4c46fa5c2c05277bcff7f INFO: 172.21.0.1:43162 - "POST /node/68d4c46fa5c2c05277bcff7f HTTP/1.0" 202 Accepted 2025-09-27 04:26:44,357 - lava_callback - INFO - Starting async job submit for node 68d4c46fa5c2c05277bcff7f 2025-09-27 04:26:44,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:44,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c46fa5c2c05277bcff7f HTTP/1.1" 200 None 2025-09-27 04:26:44,371 - lava_callback - DEBUG - Processing node 68d4c46fa5c2c05277bcff7f: baseline-arm-broonie 2025-09-27 04:26:44,371 - lava_callback - ERROR - Error processing callback for node 68d4c46fa5c2c05277bcff7f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:26:45,109 - lava_callback - INFO - Received callback for node 68d4c47fa5c2c05277bcff9b INFO: 172.21.0.1:43166 - "POST /node/68d4c47fa5c2c05277bcff9b HTTP/1.0" 202 Accepted 2025-09-27 04:26:45,115 - lava_callback - INFO - Starting async job submit for node 68d4c47fa5c2c05277bcff9b 2025-09-27 04:26:45,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:26:45,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c47fa5c2c05277bcff9b HTTP/1.1" 200 None 2025-09-27 04:26:45,131 - lava_callback - DEBUG - Processing node 68d4c47fa5c2c05277bcff9b: baseline-arm-broonie 2025-09-27 04:26:45,131 - lava_callback - ERROR - Error processing callback for node 68d4c47fa5c2c05277bcff9b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:27:04,324 - lava_callback - INFO - Received callback for node 68d4c48ba5c2c05277bcffb0 INFO: 172.21.0.1:38186 - "POST /node/68d4c48ba5c2c05277bcffb0 HTTP/1.0" 202 Accepted 2025-09-27 04:27:04,330 - lava_callback - INFO - Starting async job submit for node 68d4c48ba5c2c05277bcffb0 2025-09-27 04:27:04,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:04,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c48ba5c2c05277bcffb0 HTTP/1.1" 200 None 2025-09-27 04:27:04,365 - lava_callback - DEBUG - Processing node 68d4c48ba5c2c05277bcffb0: ltp-cap-bounds 2025-09-27 04:27:04,365 - lava_callback - ERROR - Error processing callback for node 68d4c48ba5c2c05277bcffb0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:05,124 - lava_callback - INFO - Received callback for node 68d4c48da5c2c05277bcffb3 INFO: 172.21.0.1:38192 - "POST /node/68d4c48da5c2c05277bcffb3 HTTP/1.0" 202 Accepted 2025-09-27 04:27:05,130 - lava_callback - INFO - Starting async job submit for node 68d4c48da5c2c05277bcffb3 2025-09-27 04:27:05,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:05,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c48da5c2c05277bcffb3 HTTP/1.1" 200 None 2025-09-27 04:27:05,143 - lava_callback - DEBUG - Processing node 68d4c48da5c2c05277bcffb3: ltp-containers 2025-09-27 04:27:05,143 - lava_callback - ERROR - Error processing callback for node 68d4c48da5c2c05277bcffb3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:05,930 - lava_callback - INFO - Received callback for node 68d4c48ea5c2c05277bcffb6 INFO: 172.21.0.1:38194 - "POST /node/68d4c48ea5c2c05277bcffb6 HTTP/1.0" 202 Accepted 2025-09-27 04:27:05,936 - lava_callback - INFO - Starting async job submit for node 68d4c48ea5c2c05277bcffb6 2025-09-27 04:27:05,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:05,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c48ea5c2c05277bcffb6 HTTP/1.1" 200 None 2025-09-27 04:27:05,952 - lava_callback - DEBUG - Processing node 68d4c48ea5c2c05277bcffb6: ltp-controllers 2025-09-27 04:27:05,952 - lava_callback - ERROR - Error processing callback for node 68d4c48ea5c2c05277bcffb6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:27:06,707 - lava_callback - INFO - Received callback for node 68d4c490a5c2c05277bcffb9 INFO: 172.21.0.1:38216 - "POST /node/68d4c490a5c2c05277bcffb9 HTTP/1.0" 202 Accepted 2025-09-27 04:27:06,713 - lava_callback - INFO - Starting async job submit for node 68d4c490a5c2c05277bcffb9 2025-09-27 04:27:06,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:06,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c490a5c2c05277bcffb9 HTTP/1.1" 200 None 2025-09-27 04:27:06,731 - lava_callback - DEBUG - Processing node 68d4c490a5c2c05277bcffb9: ltp-cve 2025-09-27 04:27:06,731 - lava_callback - ERROR - Error processing callback for node 68d4c490a5c2c05277bcffb9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:07,448 - lava_callback - INFO - Received callback for node 68d4c494a5c2c05277bcffbf INFO: 172.21.0.1:38220 - "POST /node/68d4c494a5c2c05277bcffbf HTTP/1.0" 202 Accepted 2025-09-27 04:27:07,454 - lava_callback - INFO - Starting async job submit for node 68d4c494a5c2c05277bcffbf 2025-09-27 04:27:07,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:07,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c494a5c2c05277bcffbf HTTP/1.1" 200 None 2025-09-27 04:27:07,473 - lava_callback - DEBUG - Processing node 68d4c494a5c2c05277bcffbf: ltp-fs-bind 2025-09-27 04:27:07,473 - lava_callback - ERROR - Error processing callback for node 68d4c494a5c2c05277bcffbf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:08,186 - lava_callback - INFO - Received callback for node 68d4c495a5c2c05277bcffc2 INFO: 172.21.0.1:38226 - "POST /node/68d4c495a5c2c05277bcffc2 HTTP/1.0" 202 Accepted 2025-09-27 04:27:08,191 - lava_callback - INFO - Starting async job submit for node 68d4c495a5c2c05277bcffc2 2025-09-27 04:27:08,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:08,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c495a5c2c05277bcffc2 HTTP/1.1" 200 None 2025-09-27 04:27:08,205 - lava_callback - DEBUG - Processing node 68d4c495a5c2c05277bcffc2: ltp-fsx 2025-09-27 04:27:08,206 - lava_callback - ERROR - Error processing callback for node 68d4c495a5c2c05277bcffc2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:08,936 - lava_callback - INFO - Received callback for node 68d4c497a5c2c05277bcffc5 INFO: 172.21.0.1:38242 - "POST /node/68d4c497a5c2c05277bcffc5 HTTP/1.0" 202 Accepted 2025-09-27 04:27:08,942 - lava_callback - INFO - Starting async job submit for node 68d4c497a5c2c05277bcffc5 2025-09-27 04:27:08,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:08,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c497a5c2c05277bcffc5 HTTP/1.1" 200 None 2025-09-27 04:27:08,957 - lava_callback - DEBUG - Processing node 68d4c497a5c2c05277bcffc5: ltp-input 2025-09-27 04:27:08,957 - lava_callback - ERROR - Error processing callback for node 68d4c497a5c2c05277bcffc5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:09,836 - lava_callback - INFO - Received callback for node 68d4c499a5c2c05277bcffc8 INFO: 172.21.0.1:33752 - "POST /node/68d4c499a5c2c05277bcffc8 HTTP/1.0" 202 Accepted 2025-09-27 04:27:09,842 - lava_callback - INFO - Starting async job submit for node 68d4c499a5c2c05277bcffc8 2025-09-27 04:27:09,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:09,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c499a5c2c05277bcffc8 HTTP/1.1" 200 None 2025-09-27 04:27:09,857 - lava_callback - DEBUG - Processing node 68d4c499a5c2c05277bcffc8: ltp-ipc 2025-09-27 04:27:09,857 - lava_callback - ERROR - Error processing callback for node 68d4c499a5c2c05277bcffc8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:10,573 - lava_callback - INFO - Received callback for node 68d4c49aa5c2c05277bcffcb INFO: 172.21.0.1:33756 - "POST /node/68d4c49aa5c2c05277bcffcb HTTP/1.0" 202 Accepted 2025-09-27 04:27:10,578 - lava_callback - INFO - Starting async job submit for node 68d4c49aa5c2c05277bcffcb 2025-09-27 04:27:10,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:10,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c49aa5c2c05277bcffcb HTTP/1.1" 200 None 2025-09-27 04:27:10,614 - lava_callback - DEBUG - Processing node 68d4c49aa5c2c05277bcffcb: ltp-pty 2025-09-27 04:27:10,614 - lava_callback - ERROR - Error processing callback for node 68d4c49aa5c2c05277bcffcb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:11,303 - lava_callback - INFO - Received callback for node 68d4c49ca5c2c05277bcffce INFO: 172.21.0.1:33772 - "POST /node/68d4c49ca5c2c05277bcffce HTTP/1.0" 202 Accepted 2025-09-27 04:27:11,309 - lava_callback - INFO - Starting async job submit for node 68d4c49ca5c2c05277bcffce 2025-09-27 04:27:11,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:11,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c49ca5c2c05277bcffce HTTP/1.1" 200 None 2025-09-27 04:27:11,344 - lava_callback - DEBUG - Processing node 68d4c49ca5c2c05277bcffce: ltp-sched 2025-09-27 04:27:11,344 - lava_callback - ERROR - Error processing callback for node 68d4c49ca5c2c05277bcffce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:12,036 - lava_callback - INFO - Received callback for node 68d4c49ea5c2c05277bcffd1 INFO: 172.21.0.1:33782 - "POST /node/68d4c49ea5c2c05277bcffd1 HTTP/1.0" 202 Accepted 2025-09-27 04:27:12,042 - lava_callback - INFO - Starting async job submit for node 68d4c49ea5c2c05277bcffd1 2025-09-27 04:27:12,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:12,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c49ea5c2c05277bcffd1 HTTP/1.1" 200 None 2025-09-27 04:27:12,056 - lava_callback - DEBUG - Processing node 68d4c49ea5c2c05277bcffd1: ltp-smoketest 2025-09-27 04:27:12,056 - lava_callback - ERROR - Error processing callback for node 68d4c49ea5c2c05277bcffd1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:33798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33810 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:27:24,385 - lava_callback - INFO - Received callback for node 68d4c49fa5c2c05277bcffd4 INFO: 172.21.0.1:46142 - "POST /node/68d4c49fa5c2c05277bcffd4 HTTP/1.0" 202 Accepted 2025-09-27 04:27:24,391 - lava_callback - INFO - Starting async job submit for node 68d4c49fa5c2c05277bcffd4 2025-09-27 04:27:24,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:24,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c49fa5c2c05277bcffd4 HTTP/1.1" 200 None 2025-09-27 04:27:24,410 - lava_callback - DEBUG - Processing node 68d4c49fa5c2c05277bcffd4: ltp-syscalls 2025-09-27 04:27:24,410 - lava_callback - ERROR - Error processing callback for node 68d4c49fa5c2c05277bcffd4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:25,134 - lava_callback - INFO - Received callback for node 68d4c4a1a5c2c05277bcffd7 INFO: 172.21.0.1:46148 - "POST /node/68d4c4a1a5c2c05277bcffd7 HTTP/1.0" 202 Accepted 2025-09-27 04:27:25,140 - lava_callback - INFO - Starting async job submit for node 68d4c4a1a5c2c05277bcffd7 2025-09-27 04:27:25,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:25,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c4a1a5c2c05277bcffd7 HTTP/1.1" 200 None 2025-09-27 04:27:25,176 - lava_callback - DEBUG - Processing node 68d4c4a1a5c2c05277bcffd7: ltp-syscalls-ipc 2025-09-27 04:27:25,176 - lava_callback - ERROR - Error processing callback for node 68d4c4a1a5c2c05277bcffd7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:25,929 - lava_callback - INFO - Received callback for node 68d4c4a3a5c2c05277bcffda INFO: 172.21.0.1:46162 - "POST /node/68d4c4a3a5c2c05277bcffda HTTP/1.0" 202 Accepted 2025-09-27 04:27:25,935 - lava_callback - INFO - Starting async job submit for node 68d4c4a3a5c2c05277bcffda 2025-09-27 04:27:25,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:25,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c4a3a5c2c05277bcffda HTTP/1.1" 200 None 2025-09-27 04:27:25,949 - lava_callback - DEBUG - Processing node 68d4c4a3a5c2c05277bcffda: ltp-timers 2025-09-27 04:27:25,949 - lava_callback - ERROR - Error processing callback for node 68d4c4a3a5c2c05277bcffda: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:27:26,671 - lava_callback - INFO - Received callback for node 68d4c4a5a5c2c05277bcffdd INFO: 172.21.0.1:46190 - "POST /node/68d4c4a5a5c2c05277bcffdd HTTP/1.0" 202 Accepted 2025-09-27 04:27:26,677 - lava_callback - INFO - Starting async job submit for node 68d4c4a5a5c2c05277bcffdd 2025-09-27 04:27:26,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:26,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c4a5a5c2c05277bcffdd HTTP/1.1" 200 None 2025-09-27 04:27:26,691 - lava_callback - DEBUG - Processing node 68d4c4a5a5c2c05277bcffdd: ltp-watchqueue 2025-09-27 04:27:26,691 - lava_callback - ERROR - Error processing callback for node 68d4c4a5a5c2c05277bcffdd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:27:36,185 - lava_callback - INFO - Received callback for node 68d4c414a5c2c05277bcfed1 INFO: 172.21.0.1:56578 - "POST /node/68d4c414a5c2c05277bcfed1 HTTP/1.0" 202 Accepted 2025-09-27 04:27:36,192 - lava_callback - INFO - Starting async job submit for node 68d4c414a5c2c05277bcfed1 2025-09-27 04:27:36,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:36,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c414a5c2c05277bcfed1 HTTP/1.1" 200 None 2025-09-27 04:27:36,233 - lava_callback - DEBUG - Processing node 68d4c414a5c2c05277bcfed1: ltp-cap-bounds INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:27:36,553 - lava_callback - ERROR - Error processing callback for node 68d4c414a5c2c05277bcfed1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:27:48,239 - lava_callback - INFO - Received callback for node 68d5fcd130c58dac7d9418e2 INFO: 172.21.0.1:54356 - "POST /node/68d5fcd130c58dac7d9418e2 HTTP/1.0" 202 Accepted 2025-09-27 04:27:48,245 - lava_callback - INFO - Starting async job submit for node 68d5fcd130c58dac7d9418e2 2025-09-27 04:27:48,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:27:48,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fcd130c58dac7d9418e2 HTTP/1.1" 200 None 2025-09-27 04:27:48,279 - lava_callback - DEBUG - Processing node 68d5fcd130c58dac7d9418e2: baseline-arm 2025-09-27 04:27:48,504 - lava_callback - ERROR - Error processing callback for node 68d5fcd130c58dac7d9418e2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:29:36,194 - lava_callback - INFO - Received callback for node 68d4cccba5c2c05277bd06cb INFO: 172.21.0.1:48024 - "POST /node/68d4cccba5c2c05277bd06cb HTTP/1.0" 202 Accepted 2025-09-27 04:29:36,201 - lava_callback - INFO - Starting async job submit for node 68d4cccba5c2c05277bd06cb 2025-09-27 04:29:36,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:29:36,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cccba5c2c05277bd06cb HTTP/1.1" 200 None 2025-09-27 04:29:36,241 - lava_callback - DEBUG - Processing node 68d4cccba5c2c05277bd06cb: baseline-arm-broonie 2025-09-27 04:29:36,490 - lava_callback - ERROR - Error processing callback for node 68d4cccba5c2c05277bd06cb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:30:09,561 - lava_callback - INFO - Received callback for node 68d5fcd330c58dac7d9418e5 INFO: 172.21.0.1:37012 - "POST /node/68d5fcd330c58dac7d9418e5 HTTP/1.0" 202 Accepted 2025-09-27 04:30:09,567 - lava_callback - INFO - Starting async job submit for node 68d5fcd330c58dac7d9418e5 2025-09-27 04:30:09,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:30:09,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fcd330c58dac7d9418e5 HTTP/1.1" 200 None 2025-09-27 04:30:09,607 - lava_callback - DEBUG - Processing node 68d5fcd330c58dac7d9418e5: baseline-arm 2025-09-27 04:30:09,828 - lava_callback - ERROR - Error processing callback for node 68d5fcd330c58dac7d9418e5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:32:26,018 - lava_callback - INFO - Received callback for node 68d5fcd330c58dac7d9418e8 INFO: 172.21.0.1:33314 - "POST /node/68d5fcd330c58dac7d9418e8 HTTP/1.0" 202 Accepted 2025-09-27 04:32:26,023 - lava_callback - INFO - Starting async job submit for node 68d5fcd330c58dac7d9418e8 2025-09-27 04:32:26,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:32:26,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fcd330c58dac7d9418e8 HTTP/1.1" 200 None 2025-09-27 04:32:26,057 - lava_callback - DEBUG - Processing node 68d5fcd330c58dac7d9418e8: baseline-arm 2025-09-27 04:32:26,280 - lava_callback - ERROR - Error processing callback for node 68d5fcd330c58dac7d9418e8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:33:56,502 - lava_callback - INFO - Received callback for node 68d4cceca5c2c05277bd0701 INFO: 172.21.0.1:56968 - "POST /node/68d4cceca5c2c05277bd0701 HTTP/1.0" 202 Accepted 2025-09-27 04:33:56,511 - lava_callback - INFO - Starting async job submit for node 68d4cceca5c2c05277bd0701 INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:33:56,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:33:56,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cceca5c2c05277bd0701 HTTP/1.1" 200 None 2025-09-27 04:33:56,558 - lava_callback - DEBUG - Processing node 68d4cceca5c2c05277bd0701: ltp-cap-bounds 2025-09-27 04:33:56,899 - lava_callback - ERROR - Error processing callback for node 68d4cceca5c2c05277bd0701: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:34:48,979 - lava_callback - INFO - Received callback for node 68d5fd1b30c58dac7d941943 INFO: 172.21.0.1:41320 - "POST /node/68d5fd1b30c58dac7d941943 HTTP/1.0" 202 Accepted 2025-09-27 04:34:48,985 - lava_callback - INFO - Starting async job submit for node 68d5fd1b30c58dac7d941943 2025-09-27 04:34:49,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:34:49,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fd1b30c58dac7d941943 HTTP/1.1" 200 None 2025-09-27 04:34:49,043 - lava_callback - DEBUG - Processing node 68d5fd1b30c58dac7d941943: baseline-arm 2025-09-27 04:34:49,264 - lava_callback - ERROR - Error processing callback for node 68d5fd1b30c58dac7d941943: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35934 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:37:08,056 - lava_callback - INFO - Received callback for node 68d5fd1b30c58dac7d941946 INFO: 172.21.0.1:35938 - "POST /node/68d5fd1b30c58dac7d941946 HTTP/1.0" 202 Accepted 2025-09-27 04:37:08,062 - lava_callback - INFO - Starting async job submit for node 68d5fd1b30c58dac7d941946 2025-09-27 04:37:08,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:37:08,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fd1b30c58dac7d941946 HTTP/1.1" 200 None 2025-09-27 04:37:08,103 - lava_callback - DEBUG - Processing node 68d5fd1b30c58dac7d941946: baseline-arm 2025-09-27 04:37:08,333 - lava_callback - ERROR - Error processing callback for node 68d5fd1b30c58dac7d941946: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:37:35,389 - lava_callback - INFO - Received callback for node 68d4c29ca5c2c05277bcfc83 INFO: 172.21.0.1:50796 - "POST /node/68d4c29ca5c2c05277bcfc83 HTTP/1.0" 202 Accepted 2025-09-27 04:37:35,395 - lava_callback - INFO - Starting async job submit for node 68d4c29ca5c2c05277bcfc83 2025-09-27 04:37:35,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:37:35,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c29ca5c2c05277bcfc83 HTTP/1.1" 200 None 2025-09-27 04:37:35,438 - lava_callback - DEBUG - Processing node 68d4c29ca5c2c05277bcfc83: baseline-arm 2025-09-27 04:37:35,725 - lava_callback - ERROR - Error processing callback for node 68d4c29ca5c2c05277bcfc83: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:37:55,733 - lava_callback - INFO - Received callback for node 68d4c2faa5c2c05277bcfcfd INFO: 172.21.0.1:58342 - "POST /node/68d4c2faa5c2c05277bcfcfd HTTP/1.0" 202 Accepted 2025-09-27 04:37:55,744 - lava_callback - INFO - Starting async job submit for node 68d4c2faa5c2c05277bcfcfd 2025-09-27 04:37:56,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:37:56,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c2faa5c2c05277bcfcfd HTTP/1.1" 200 None 2025-09-27 04:37:56,116 - lava_callback - DEBUG - Processing node 68d4c2faa5c2c05277bcfcfd: ltp-controllers INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:37:58,967 - lava_callback - ERROR - Error processing callback for node 68d4c2faa5c2c05277bcfcfd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:39:24,900 - lava_callback - INFO - Received callback for node 68d5fd1d30c58dac7d941949 INFO: 172.21.0.1:54872 - "POST /node/68d5fd1d30c58dac7d941949 HTTP/1.0" 202 Accepted 2025-09-27 04:39:24,906 - lava_callback - INFO - Starting async job submit for node 68d5fd1d30c58dac7d941949 2025-09-27 04:39:24,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:39:24,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fd1d30c58dac7d941949 HTTP/1.1" 200 None 2025-09-27 04:39:24,953 - lava_callback - DEBUG - Processing node 68d5fd1d30c58dac7d941949: baseline-arm 2025-09-27 04:39:25,176 - lava_callback - ERROR - Error processing callback for node 68d5fd1d30c58dac7d941949: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:39:56,915 - lava_callback - INFO - Received callback for node 68d4cceea5c2c05277bd0704 INFO: 172.21.0.1:42192 - "POST /node/68d4cceea5c2c05277bd0704 HTTP/1.0" 202 Accepted 2025-09-27 04:39:56,922 - lava_callback - INFO - Starting async job submit for node 68d4cceea5c2c05277bd0704 2025-09-27 04:39:57,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:39:57,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cceea5c2c05277bd0704 HTTP/1.1" 200 None 2025-09-27 04:39:57,039 - lava_callback - DEBUG - Processing node 68d4cceea5c2c05277bd0704: ltp-containers 2025-09-27 04:39:57,851 - lava_callback - ERROR - Error processing callback for node 68d4cceea5c2c05277bd0704: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:40:59,291 - lava_callback - INFO - Received callback for node 68d4c7d3a5c2c05277bd01f6 INFO: 172.21.0.1:33632 - "POST /node/68d4c7d3a5c2c05277bd01f6 HTTP/1.0" 202 Accepted 2025-09-27 04:40:59,297 - lava_callback - INFO - Starting async job submit for node 68d4c7d3a5c2c05277bd01f6 2025-09-27 04:40:59,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:40:59,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c7d3a5c2c05277bd01f6 HTTP/1.1" 200 None 2025-09-27 04:40:59,311 - lava_callback - DEBUG - Processing node 68d4c7d3a5c2c05277bd01f6: baseline-arm64-baylibre 2025-09-27 04:40:59,311 - lava_callback - ERROR - Error processing callback for node 68d4c7d3a5c2c05277bd01f6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:41:07,361 - lava_callback - INFO - Received callback for node 68d5cad82be2da466069aa87 INFO: 172.21.0.1:34696 - "POST /node/68d5cad82be2da466069aa87 HTTP/1.0" 202 Accepted 2025-09-27 04:41:07,368 - lava_callback - INFO - Starting async job submit for node 68d5cad82be2da466069aa87 2025-09-27 04:41:07,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:41:07,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cad82be2da466069aa87 HTTP/1.1" 200 None 2025-09-27 04:41:07,421 - lava_callback - DEBUG - Processing node 68d5cad82be2da466069aa87: baseline-arm64 2025-09-27 04:41:08,343 - lava_callback - ERROR - Error processing callback for node 68d5cad82be2da466069aa87: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:41:19,323 - lava_callback - INFO - Received callback for node 68d4c7eaa5c2c05277bd020e INFO: 172.21.0.1:49546 - "POST /node/68d4c7eaa5c2c05277bd020e HTTP/1.0" 202 Accepted 2025-09-27 04:41:19,328 - lava_callback - INFO - Starting async job submit for node 68d4c7eaa5c2c05277bd020e 2025-09-27 04:41:19,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:41:19,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c7eaa5c2c05277bd020e HTTP/1.1" 200 None 2025-09-27 04:41:19,342 - lava_callback - DEBUG - Processing node 68d4c7eaa5c2c05277bd020e: baseline-arm64-baylibre 2025-09-27 04:41:19,342 - lava_callback - ERROR - Error processing callback for node 68d4c7eaa5c2c05277bd020e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:41:38,787 - lava_callback - INFO - Received callback for node 68d5cad92be2da466069aa8a INFO: 172.21.0.1:54112 - "POST /node/68d5cad92be2da466069aa8a HTTP/1.0" 202 Accepted 2025-09-27 04:41:38,794 - lava_callback - INFO - Starting async job submit for node 68d5cad92be2da466069aa8a 2025-09-27 04:41:38,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:41:38,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cad92be2da466069aa8a HTTP/1.1" 200 None 2025-09-27 04:41:38,855 - lava_callback - DEBUG - Processing node 68d5cad92be2da466069aa8a: baseline-arm64 2025-09-27 04:41:39,946 - lava_callback - ERROR - Error processing callback for node 68d5cad92be2da466069aa8a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:42:18,832 - lava_callback - INFO - Received callback for node 68d5cadc2be2da466069aa8d INFO: 172.21.0.1:53716 - "POST /node/68d5cadc2be2da466069aa8d HTTP/1.0" 202 Accepted 2025-09-27 04:42:18,843 - lava_callback - INFO - Starting async job submit for node 68d5cadc2be2da466069aa8d 2025-09-27 04:42:18,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:42:18,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cadc2be2da466069aa8d HTTP/1.1" 200 None 2025-09-27 04:42:18,905 - lava_callback - DEBUG - Processing node 68d5cadc2be2da466069aa8d: baseline-arm64 2025-09-27 04:42:19,783 - lava_callback - ERROR - Error processing callback for node 68d5cadc2be2da466069aa8d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:42:49,936 - lava_callback - INFO - Received callback for node 68d5fd1d30c58dac7d94194c INFO: 172.21.0.1:42094 - "POST /node/68d5fd1d30c58dac7d94194c HTTP/1.0" 202 Accepted 2025-09-27 04:42:49,942 - lava_callback - INFO - Starting async job submit for node 68d5fd1d30c58dac7d94194c 2025-09-27 04:42:49,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:42:49,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fd1d30c58dac7d94194c HTTP/1.1" 200 None 2025-09-27 04:42:49,977 - lava_callback - DEBUG - Processing node 68d5fd1d30c58dac7d94194c: baseline-arm 2025-09-27 04:42:50,221 - lava_callback - ERROR - Error processing callback for node 68d5fd1d30c58dac7d94194c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:44:37,114 - lava_callback - INFO - Received callback for node 68d4c443a5c2c05277bcff10 INFO: 172.21.0.1:40198 - "POST /node/68d4c443a5c2c05277bcff10 HTTP/1.0" 202 Accepted 2025-09-27 04:44:37,122 - lava_callback - INFO - Starting async job submit for node 68d4c443a5c2c05277bcff10 2025-09-27 04:44:37,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:44:37,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c443a5c2c05277bcff10 HTTP/1.1" 200 None 2025-09-27 04:44:37,163 - lava_callback - DEBUG - Processing node 68d4c443a5c2c05277bcff10: ltp-syscalls-ipc 2025-09-27 04:44:38,053 - lava_callback - ERROR - Error processing callback for node 68d4c443a5c2c05277bcff10: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:45:12,667 - lava_callback - INFO - Received callback for node 68d5fd1f30c58dac7d94194f INFO: 172.21.0.1:49600 - "POST /node/68d5fd1f30c58dac7d94194f HTTP/1.0" 202 Accepted 2025-09-27 04:45:12,673 - lava_callback - INFO - Starting async job submit for node 68d5fd1f30c58dac7d94194f 2025-09-27 04:45:12,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:45:12,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fd1f30c58dac7d94194f HTTP/1.1" 200 None 2025-09-27 04:45:12,727 - lava_callback - DEBUG - Processing node 68d5fd1f30c58dac7d94194f: baseline-arm 2025-09-27 04:45:12,949 - lava_callback - ERROR - Error processing callback for node 68d5fd1f30c58dac7d94194f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:45:21,099 - lava_callback - INFO - Received callback for node 68d4c8dca5c2c05277bd0374 INFO: 172.21.0.1:51740 - "POST /node/68d4c8dca5c2c05277bd0374 HTTP/1.0" 202 Accepted 2025-09-27 04:45:21,105 - lava_callback - INFO - Starting async job submit for node 68d4c8dca5c2c05277bd0374 2025-09-27 04:45:21,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:45:21,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c8dca5c2c05277bd0374 HTTP/1.1" 200 None 2025-09-27 04:45:21,118 - lava_callback - DEBUG - Processing node 68d4c8dca5c2c05277bd0374: baseline-arm64-clabbe 2025-09-27 04:45:21,118 - lava_callback - ERROR - Error processing callback for node 68d4c8dca5c2c05277bd0374: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:46:21,088 - lava_callback - INFO - Received callback for node 68d4c913a5c2c05277bd0396 INFO: 172.21.0.1:38434 - "POST /node/68d4c913a5c2c05277bd0396 HTTP/1.0" 202 Accepted 2025-09-27 04:46:21,093 - lava_callback - INFO - Starting async job submit for node 68d4c913a5c2c05277bd0396 2025-09-27 04:46:21,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:46:21,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c913a5c2c05277bd0396 HTTP/1.1" 200 None 2025-09-27 04:46:21,131 - lava_callback - DEBUG - Processing node 68d4c913a5c2c05277bd0396: baseline-arm64-clabbe 2025-09-27 04:46:21,131 - lava_callback - ERROR - Error processing callback for node 68d4c913a5c2c05277bd0396: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:46:21,748 - lava_callback - INFO - Received callback for node 68d4c916a5c2c05277bd0399 INFO: 172.21.0.1:38438 - "POST /node/68d4c916a5c2c05277bd0399 HTTP/1.0" 202 Accepted 2025-09-27 04:46:21,753 - lava_callback - INFO - Starting async job submit for node 68d4c916a5c2c05277bd0399 2025-09-27 04:46:21,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:46:21,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c916a5c2c05277bd0399 HTTP/1.1" 200 None 2025-09-27 04:46:21,776 - lava_callback - DEBUG - Processing node 68d4c916a5c2c05277bd0399: baseline-arm64-clabbe 2025-09-27 04:46:21,776 - lava_callback - ERROR - Error processing callback for node 68d4c916a5c2c05277bd0399: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:46:22,407 - lava_callback - INFO - Received callback for node 68d4c919a5c2c05277bd039c INFO: 172.21.0.1:38440 - "POST /node/68d4c919a5c2c05277bd039c HTTP/1.0" 202 Accepted 2025-09-27 04:46:22,412 - lava_callback - INFO - Starting async job submit for node 68d4c919a5c2c05277bd039c 2025-09-27 04:46:22,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:46:22,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c919a5c2c05277bd039c HTTP/1.1" 200 None 2025-09-27 04:46:22,428 - lava_callback - DEBUG - Processing node 68d4c919a5c2c05277bd039c: baseline-arm64-clabbe 2025-09-27 04:46:22,428 - lava_callback - ERROR - Error processing callback for node 68d4c919a5c2c05277bd039c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:38444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:46:41,078 - lava_callback - INFO - Received callback for node 68d4c91ca5c2c05277bd039f INFO: 172.21.0.1:38696 - "POST /node/68d4c91ca5c2c05277bd039f HTTP/1.0" 202 Accepted 2025-09-27 04:46:41,083 - lava_callback - INFO - Starting async job submit for node 68d4c91ca5c2c05277bd039f 2025-09-27 04:46:41,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:46:41,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c91ca5c2c05277bd039f HTTP/1.1" 200 None 2025-09-27 04:46:41,097 - lava_callback - DEBUG - Processing node 68d4c91ca5c2c05277bd039f: baseline-arm64-clabbe 2025-09-27 04:46:41,097 - lava_callback - ERROR - Error processing callback for node 68d4c91ca5c2c05277bd039f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:47:30,866 - lava_callback - INFO - Received callback for node 68d5fd1f30c58dac7d941952 INFO: 172.21.0.1:53220 - "POST /node/68d5fd1f30c58dac7d941952 HTTP/1.0" 202 Accepted 2025-09-27 04:47:30,872 - lava_callback - INFO - Starting async job submit for node 68d5fd1f30c58dac7d941952 2025-09-27 04:47:30,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:47:30,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fd1f30c58dac7d941952 HTTP/1.1" 200 None 2025-09-27 04:47:30,929 - lava_callback - DEBUG - Processing node 68d5fd1f30c58dac7d941952: baseline-arm 2025-09-27 04:47:31,150 - lava_callback - ERROR - Error processing callback for node 68d5fd1f30c58dac7d941952: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:49:49,478 - lava_callback - INFO - Received callback for node 68d5fd2130c58dac7d941955 INFO: 172.21.0.1:50010 - "POST /node/68d5fd2130c58dac7d941955 HTTP/1.0" 202 Accepted 2025-09-27 04:49:49,483 - lava_callback - INFO - Starting async job submit for node 68d5fd2130c58dac7d941955 2025-09-27 04:49:49,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:49:49,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fd2130c58dac7d941955 HTTP/1.1" 200 None 2025-09-27 04:49:49,517 - lava_callback - DEBUG - Processing node 68d5fd2130c58dac7d941955: baseline-arm 2025-09-27 04:49:49,760 - lava_callback - ERROR - Error processing callback for node 68d5fd2130c58dac7d941955: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:51:57,239 - lava_callback - INFO - Received callback for node 68d4cd0ca5c2c05277bd071e INFO: 172.21.0.1:39322 - "POST /node/68d4cd0ca5c2c05277bd071e HTTP/1.0" 202 Accepted 2025-09-27 04:51:57,246 - lava_callback - INFO - Starting async job submit for node 68d4cd0ca5c2c05277bd071e 2025-09-27 04:51:57,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:51:57,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd0ca5c2c05277bd071e HTTP/1.1" 200 None 2025-09-27 04:51:57,370 - lava_callback - DEBUG - Processing node 68d4cd0ca5c2c05277bd071e: ltp-fs-bind 2025-09-27 04:51:57,893 - lava_callback - ERROR - Error processing callback for node 68d4cd0ca5c2c05277bd071e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52528 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:52:11,383 - lava_callback - INFO - Received callback for node 68d5fd2130c58dac7d941958 INFO: 172.21.0.1:41774 - "POST /node/68d5fd2130c58dac7d941958 HTTP/1.0" 202 Accepted 2025-09-27 04:52:11,389 - lava_callback - INFO - Starting async job submit for node 68d5fd2130c58dac7d941958 2025-09-27 04:52:11,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:52:11,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5fd2130c58dac7d941958 HTTP/1.1" 200 None 2025-09-27 04:52:11,423 - lava_callback - DEBUG - Processing node 68d5fd2130c58dac7d941958: baseline-arm 2025-09-27 04:52:11,647 - lava_callback - ERROR - Error processing callback for node 68d5fd2130c58dac7d941958: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:53:00,011 - lava_callback - INFO - Received callback for node 68d4caa8a5c2c05277bd05a9 INFO: 172.21.0.1:55190 - "POST /node/68d4caa8a5c2c05277bd05a9 HTTP/1.0" 202 Accepted 2025-09-27 04:53:00,016 - lava_callback - INFO - Starting async job submit for node 68d4caa8a5c2c05277bd05a9 2025-09-27 04:53:00,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:53:00,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4caa8a5c2c05277bd05a9 HTTP/1.1" 200 None 2025-09-27 04:53:00,032 - lava_callback - DEBUG - Processing node 68d4caa8a5c2c05277bd05a9: baseline-arm64-baylibre 2025-09-27 04:53:00,032 - lava_callback - ERROR - Error processing callback for node 68d4caa8a5c2c05277bd05a9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:53:20,028 - lava_callback - INFO - Received callback for node 68d4cab6a5c2c05277bd05c2 INFO: 172.21.0.1:38822 - "POST /node/68d4cab6a5c2c05277bd05c2 HTTP/1.0" 202 Accepted 2025-09-27 04:53:20,033 - lava_callback - INFO - Starting async job submit for node 68d4cab6a5c2c05277bd05c2 2025-09-27 04:53:20,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:53:20,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cab6a5c2c05277bd05c2 HTTP/1.1" 200 None 2025-09-27 04:53:20,047 - lava_callback - DEBUG - Processing node 68d4cab6a5c2c05277bd05c2: baseline-arm64-baylibre 2025-09-27 04:53:20,047 - lava_callback - ERROR - Error processing callback for node 68d4cab6a5c2c05277bd05c2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:54:30,657 - lava_callback - INFO - Received callback for node 68d6175930c58dac7d941f2c INFO: 172.21.0.1:33202 - "POST /node/68d6175930c58dac7d941f2c HTTP/1.0" 202 Accepted 2025-09-27 04:54:30,662 - lava_callback - INFO - Starting async job submit for node 68d6175930c58dac7d941f2c 2025-09-27 04:54:30,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:54:30,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6175930c58dac7d941f2c HTTP/1.1" 200 None 2025-09-27 04:54:30,695 - lava_callback - DEBUG - Processing node 68d6175930c58dac7d941f2c: baseline-arm 2025-09-27 04:54:30,916 - lava_callback - ERROR - Error processing callback for node 68d6175930c58dac7d941f2c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33216 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:54:41,520 - lava_callback - INFO - Received callback for node 68d4cb06a5c2c05277bd0601 INFO: 172.21.0.1:44598 - "POST /node/68d4cb06a5c2c05277bd0601 HTTP/1.0" 202 Accepted 2025-09-27 04:54:41,526 - lava_callback - INFO - Starting async job submit for node 68d4cb06a5c2c05277bd0601 2025-09-27 04:54:41,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:54:41,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cb06a5c2c05277bd0601 HTTP/1.1" 200 None 2025-09-27 04:54:41,540 - lava_callback - DEBUG - Processing node 68d4cb06a5c2c05277bd0601: baseline-arm64-clabbe 2025-09-27 04:54:41,540 - lava_callback - ERROR - Error processing callback for node 68d4cb06a5c2c05277bd0601: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:54:42,164 - lava_callback - INFO - Received callback for node 68d4cafca5c2c05277bd05f8 INFO: 172.21.0.1:44604 - "POST /node/68d4cafca5c2c05277bd05f8 HTTP/1.0" 202 Accepted 2025-09-27 04:54:42,169 - lava_callback - INFO - Starting async job submit for node 68d4cafca5c2c05277bd05f8 2025-09-27 04:54:42,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:54:42,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cafca5c2c05277bd05f8 HTTP/1.1" 200 None 2025-09-27 04:54:42,183 - lava_callback - DEBUG - Processing node 68d4cafca5c2c05277bd05f8: baseline-arm64-clabbe 2025-09-27 04:54:42,183 - lava_callback - ERROR - Error processing callback for node 68d4cafca5c2c05277bd05f8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:55:01,487 - lava_callback - INFO - Received callback for node 68d4cb22a5c2c05277bd060f INFO: 172.21.0.1:57676 - "POST /node/68d4cb22a5c2c05277bd060f HTTP/1.0" 202 Accepted 2025-09-27 04:55:01,492 - lava_callback - INFO - Starting async job submit for node 68d4cb22a5c2c05277bd060f 2025-09-27 04:55:01,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:55:01,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cb22a5c2c05277bd060f HTTP/1.1" 200 None 2025-09-27 04:55:01,506 - lava_callback - DEBUG - Processing node 68d4cb22a5c2c05277bd060f: baseline-arm64-clabbe 2025-09-27 04:55:01,507 - lava_callback - ERROR - Error processing callback for node 68d4cb22a5c2c05277bd060f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 04:55:16,112 - lava_callback - INFO - Received callback for node 68d4cd07a5c2c05277bd0715 INFO: 172.21.0.1:59580 - "POST /node/68d4cd07a5c2c05277bd0715 HTTP/1.0" 202 Accepted 2025-09-27 04:55:16,123 - lava_callback - INFO - Starting async job submit for node 68d4cd07a5c2c05277bd0715 2025-09-27 04:55:16,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:55:16,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd07a5c2c05277bd0715 HTTP/1.1" 200 None INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:55:16,509 - lava_callback - DEBUG - Processing node 68d4cd07a5c2c05277bd0715: ltp-controllers 2025-09-27 04:55:19,252 - lava_callback - ERROR - Error processing callback for node 68d4cd07a5c2c05277bd0715: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 04:55:21,485 - lava_callback - INFO - Received callback for node 68d4cb27a5c2c05277bd0612 INFO: 172.21.0.1:35374 - "POST /node/68d4cb27a5c2c05277bd0612 HTTP/1.0" 202 Accepted 2025-09-27 04:55:21,490 - lava_callback - INFO - Starting async job submit for node 68d4cb27a5c2c05277bd0612 2025-09-27 04:55:21,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:55:21,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cb27a5c2c05277bd0612 HTTP/1.1" 200 None 2025-09-27 04:55:21,504 - lava_callback - DEBUG - Processing node 68d4cb27a5c2c05277bd0612: baseline-arm64-clabbe 2025-09-27 04:55:21,504 - lava_callback - ERROR - Error processing callback for node 68d4cb27a5c2c05277bd0612: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 04:55:22,133 - lava_callback - INFO - Received callback for node 68d4cb29a5c2c05277bd0615 INFO: 172.21.0.1:35376 - "POST /node/68d4cb29a5c2c05277bd0615 HTTP/1.0" 202 Accepted 2025-09-27 04:55:22,138 - lava_callback - INFO - Starting async job submit for node 68d4cb29a5c2c05277bd0615 2025-09-27 04:55:22,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:55:22,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cb29a5c2c05277bd0615 HTTP/1.1" 200 None 2025-09-27 04:55:22,195 - lava_callback - DEBUG - Processing node 68d4cb29a5c2c05277bd0615: baseline-arm64-clabbe 2025-09-27 04:55:22,195 - lava_callback - ERROR - Error processing callback for node 68d4cb29a5c2c05277bd0615: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:56:17,370 - lava_callback - INFO - Received callback for node 68d4cd0ea5c2c05277bd0721 INFO: 172.21.0.1:48992 - "POST /node/68d4cd0ea5c2c05277bd0721 HTTP/1.0" 202 Accepted 2025-09-27 04:56:17,376 - lava_callback - INFO - Starting async job submit for node 68d4cd0ea5c2c05277bd0721 2025-09-27 04:56:17,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:56:17,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd0ea5c2c05277bd0721 HTTP/1.1" 200 None 2025-09-27 04:56:17,422 - lava_callback - DEBUG - Processing node 68d4cd0ea5c2c05277bd0721: ltp-fsx 2025-09-27 04:56:17,745 - lava_callback - ERROR - Error processing callback for node 68d4cd0ea5c2c05277bd0721: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:56:51,412 - lava_callback - INFO - Received callback for node 68d6175930c58dac7d941f3a INFO: 172.21.0.1:44866 - "POST /node/68d6175930c58dac7d941f3a HTTP/1.0" 202 Accepted 2025-09-27 04:56:51,418 - lava_callback - INFO - Starting async job submit for node 68d6175930c58dac7d941f3a 2025-09-27 04:56:51,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:56:51,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6175930c58dac7d941f3a HTTP/1.1" 200 None 2025-09-27 04:56:51,460 - lava_callback - DEBUG - Processing node 68d6175930c58dac7d941f3a: baseline-arm 2025-09-27 04:56:51,732 - lava_callback - ERROR - Error processing callback for node 68d6175930c58dac7d941f3a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:57:13,489 - lava_callback - INFO - Received callback for node 68d4cc94a5c2c05277bd065c INFO: 172.21.0.1:34758 - "POST /node/68d4cc94a5c2c05277bd065c HTTP/1.0" 202 Accepted 2025-09-27 04:57:13,495 - lava_callback - INFO - Starting async job submit for node 68d4cc94a5c2c05277bd065c 2025-09-27 04:57:13,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:57:13,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cc94a5c2c05277bd065c HTTP/1.1" 200 None 2025-09-27 04:57:13,589 - lava_callback - DEBUG - Processing node 68d4cc94a5c2c05277bd065c: baseline-arm 2025-09-27 04:57:13,863 - lava_callback - ERROR - Error processing callback for node 68d4cc94a5c2c05277bd065c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:58:38,565 - lava_callback - INFO - Received callback for node 68d4c319a5c2c05277bcfd2f INFO: 172.21.0.1:39132 - "POST /node/68d4c319a5c2c05277bcfd2f HTTP/1.0" 202 Accepted 2025-09-27 04:58:38,584 - lava_callback - INFO - Starting async job submit for node 68d4c319a5c2c05277bcfd2f 2025-09-27 04:58:39,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:58:39,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4c319a5c2c05277bcfd2f HTTP/1.1" 200 None 2025-09-27 04:58:39,926 - lava_callback - DEBUG - Processing node 68d4c319a5c2c05277bcfd2f: ltp-syscalls INFO: 172.21.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:58:46,572 - lava_callback - ERROR - Error processing callback for node 68d4c319a5c2c05277bcfd2f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:59:07,191 - lava_callback - INFO - Received callback for node 68d6175c30c58dac7d941f52 INFO: 172.21.0.1:57648 - "POST /node/68d6175c30c58dac7d941f52 HTTP/1.0" 202 Accepted 2025-09-27 04:59:07,197 - lava_callback - INFO - Starting async job submit for node 68d6175c30c58dac7d941f52 2025-09-27 04:59:07,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:59:07,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6175c30c58dac7d941f52 HTTP/1.1" 200 None 2025-09-27 04:59:07,251 - lava_callback - DEBUG - Processing node 68d6175c30c58dac7d941f52: baseline-arm 2025-09-27 04:59:07,478 - lava_callback - ERROR - Error processing callback for node 68d6175c30c58dac7d941f52: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK 2025-09-27 04:59:55,266 - lava_callback - INFO - Received callback for node 68d4cd10a5c2c05277bd0724 INFO: 172.21.0.1:34550 - "POST /node/68d4cd10a5c2c05277bd0724 HTTP/1.0" 202 Accepted 2025-09-27 04:59:55,272 - lava_callback - INFO - Starting async job submit for node 68d4cd10a5c2c05277bd0724 2025-09-27 04:59:55,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 04:59:55,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd10a5c2c05277bd0724 HTTP/1.1" 200 None 2025-09-27 04:59:55,316 - lava_callback - DEBUG - Processing node 68d4cd10a5c2c05277bd0724: ltp-input 2025-09-27 04:59:55,701 - lava_callback - ERROR - Error processing callback for node 68d4cd10a5c2c05277bd0724: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:00:17,374 - lava_callback - INFO - Received callback for node 68d4ccd1a5c2c05277bd06d4 INFO: 172.21.0.1:57546 - "POST /node/68d4ccd1a5c2c05277bd06d4 HTTP/1.0" 202 Accepted 2025-09-27 05:00:17,380 - lava_callback - INFO - Starting async job submit for node 68d4ccd1a5c2c05277bd06d4 2025-09-27 05:00:17,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:00:17,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ccd1a5c2c05277bd06d4 HTTP/1.1" 200 None 2025-09-27 05:00:17,437 - lava_callback - DEBUG - Processing node 68d4ccd1a5c2c05277bd06d4: baseline-arm-broonie 2025-09-27 05:00:17,655 - lava_callback - ERROR - Error processing callback for node 68d4ccd1a5c2c05277bd06d4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:00:38,624 - lava_callback - INFO - Received callback for node 68d4cd11a5c2c05277bd0727 INFO: 172.21.0.1:54692 - "POST /node/68d4cd11a5c2c05277bd0727 HTTP/1.0" 202 Accepted 2025-09-27 05:00:38,630 - lava_callback - INFO - Starting async job submit for node 68d4cd11a5c2c05277bd0727 2025-09-27 05:00:38,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:00:38,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd11a5c2c05277bd0727 HTTP/1.1" 200 None 2025-09-27 05:00:38,692 - lava_callback - DEBUG - Processing node 68d4cd11a5c2c05277bd0727: ltp-ipc 2025-09-27 05:00:39,019 - lava_callback - ERROR - Error processing callback for node 68d4cd11a5c2c05277bd0727: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:01:18,120 - lava_callback - INFO - Received callback for node 68d4cc97a5c2c05277bd0662 INFO: 172.21.0.1:42630 - "POST /node/68d4cc97a5c2c05277bd0662 HTTP/1.0" 202 Accepted 2025-09-27 05:01:18,125 - lava_callback - INFO - Starting async job submit for node 68d4cc97a5c2c05277bd0662 2025-09-27 05:01:18,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:18,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cc97a5c2c05277bd0662 HTTP/1.1" 200 None 2025-09-27 05:01:18,139 - lava_callback - DEBUG - Processing node 68d4cc97a5c2c05277bd0662: baseline-arm 2025-09-27 05:01:18,139 - lava_callback - ERROR - Error processing callback for node 68d4cc97a5c2c05277bd0662: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:01:18,785 - lava_callback - INFO - Received callback for node 68d4cc98a5c2c05277bd0665 INFO: 172.21.0.1:42634 - "POST /node/68d4cc98a5c2c05277bd0665 HTTP/1.0" 202 Accepted 2025-09-27 05:01:18,791 - lava_callback - INFO - Starting async job submit for node 68d4cc98a5c2c05277bd0665 2025-09-27 05:01:18,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:18,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cc98a5c2c05277bd0665 HTTP/1.1" 200 None 2025-09-27 05:01:18,813 - lava_callback - DEBUG - Processing node 68d4cc98a5c2c05277bd0665: baseline-arm 2025-09-27 05:01:18,813 - lava_callback - ERROR - Error processing callback for node 68d4cc98a5c2c05277bd0665: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:01:32,736 - lava_callback - INFO - Received callback for node 68d6175d30c58dac7d941f55 INFO: 172.21.0.1:52188 - "POST /node/68d6175d30c58dac7d941f55 HTTP/1.0" 202 Accepted 2025-09-27 05:01:32,742 - lava_callback - INFO - Starting async job submit for node 68d6175d30c58dac7d941f55 2025-09-27 05:01:32,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:32,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6175d30c58dac7d941f55 HTTP/1.1" 200 None 2025-09-27 05:01:32,784 - lava_callback - DEBUG - Processing node 68d6175d30c58dac7d941f55: baseline-arm 2025-09-27 05:01:33,039 - lava_callback - ERROR - Error processing callback for node 68d6175d30c58dac7d941f55: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52204 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:01:38,158 - lava_callback - INFO - Received callback for node 68d4cca6a5c2c05277bd068c INFO: 172.21.0.1:52220 - "POST /node/68d4cca6a5c2c05277bd068c HTTP/1.0" 202 Accepted 2025-09-27 05:01:38,166 - lava_callback - INFO - Starting async job submit for node 68d4cca6a5c2c05277bd068c 2025-09-27 05:01:38,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:38,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cca6a5c2c05277bd068c HTTP/1.1" 200 None 2025-09-27 05:01:38,183 - lava_callback - DEBUG - Processing node 68d4cca6a5c2c05277bd068c: baseline-arm 2025-09-27 05:01:38,183 - lava_callback - ERROR - Error processing callback for node 68d4cca6a5c2c05277bd068c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:01:38,820 - lava_callback - INFO - Received callback for node 68d4cca6a5c2c05277bd068f INFO: 172.21.0.1:52232 - "POST /node/68d4cca6a5c2c05277bd068f HTTP/1.0" 202 Accepted 2025-09-27 05:01:38,825 - lava_callback - INFO - Starting async job submit for node 68d4cca6a5c2c05277bd068f 2025-09-27 05:01:38,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:38,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cca6a5c2c05277bd068f HTTP/1.1" 200 None 2025-09-27 05:01:38,839 - lava_callback - DEBUG - Processing node 68d4cca6a5c2c05277bd068f: baseline-arm 2025-09-27 05:01:38,839 - lava_callback - ERROR - Error processing callback for node 68d4cca6a5c2c05277bd068f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:01:39,477 - lava_callback - INFO - Received callback for node 68d4cca8a5c2c05277bd0692 INFO: 172.21.0.1:59998 - "POST /node/68d4cca8a5c2c05277bd0692 HTTP/1.0" 202 Accepted 2025-09-27 05:01:39,482 - lava_callback - INFO - Starting async job submit for node 68d4cca8a5c2c05277bd0692 2025-09-27 05:01:39,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:39,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cca8a5c2c05277bd0692 HTTP/1.1" 200 None 2025-09-27 05:01:39,519 - lava_callback - DEBUG - Processing node 68d4cca8a5c2c05277bd0692: baseline-arm 2025-09-27 05:01:39,519 - lava_callback - ERROR - Error processing callback for node 68d4cca8a5c2c05277bd0692: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:01:40,175 - lava_callback - INFO - Received callback for node 68d4cca8a5c2c05277bd0695 INFO: 172.21.0.1:60010 - "POST /node/68d4cca8a5c2c05277bd0695 HTTP/1.0" 202 Accepted 2025-09-27 05:01:40,181 - lava_callback - INFO - Starting async job submit for node 68d4cca8a5c2c05277bd0695 2025-09-27 05:01:40,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:40,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cca8a5c2c05277bd0695 HTTP/1.1" 200 None 2025-09-27 05:01:40,194 - lava_callback - DEBUG - Processing node 68d4cca8a5c2c05277bd0695: baseline-arm 2025-09-27 05:01:40,194 - lava_callback - ERROR - Error processing callback for node 68d4cca8a5c2c05277bd0695: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:01:48,771 - lava_callback - INFO - Received callback for node 68d5cadc2be2da466069aa90 INFO: 172.21.0.1:60032 - "POST /node/68d5cadc2be2da466069aa90 HTTP/1.0" 202 Accepted 2025-09-27 05:01:48,778 - lava_callback - INFO - Starting async job submit for node 68d5cadc2be2da466069aa90 2025-09-27 05:01:48,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:49,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cadc2be2da466069aa90 HTTP/1.1" 200 None 2025-09-27 05:01:49,097 - lava_callback - DEBUG - Processing node 68d5cadc2be2da466069aa90: baseline-arm64 2025-09-27 05:01:49,968 - lava_callback - ERROR - Error processing callback for node 68d5cadc2be2da466069aa90: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:01:57,773 - lava_callback - INFO - Received callback for node 68d4cd09a5c2c05277bd0718 INFO: 172.21.0.1:51334 - "POST /node/68d4cd09a5c2c05277bd0718 HTTP/1.0" 202 Accepted 2025-09-27 05:01:57,780 - lava_callback - INFO - Starting async job submit for node 68d4cd09a5c2c05277bd0718 2025-09-27 05:01:57,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:01:58,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd09a5c2c05277bd0718 HTTP/1.1" 200 None 2025-09-27 05:01:58,045 - lava_callback - DEBUG - Processing node 68d4cd09a5c2c05277bd0718: ltp-cve 2025-09-27 05:01:58,794 - lava_callback - ERROR - Error processing callback for node 68d4cd09a5c2c05277bd0718: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:02:19,149 - lava_callback - INFO - Received callback for node 68d5cb2b2be2da466069ab12 INFO: 172.21.0.1:55644 - "POST /node/68d5cb2b2be2da466069ab12 HTTP/1.0" 202 Accepted 2025-09-27 05:02:19,156 - lava_callback - INFO - Starting async job submit for node 68d5cb2b2be2da466069ab12 2025-09-27 05:02:19,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:02:19,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb2b2be2da466069ab12 HTTP/1.1" 200 None 2025-09-27 05:02:19,212 - lava_callback - DEBUG - Processing node 68d5cb2b2be2da466069ab12: baseline-arm64 2025-09-27 05:02:20,091 - lava_callback - ERROR - Error processing callback for node 68d5cb2b2be2da466069ab12: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:02:21,747 - lava_callback - INFO - Received callback for node 68d4ccd9a5c2c05277bd06e0 INFO: 172.21.0.1:52644 - "POST /node/68d4ccd9a5c2c05277bd06e0 HTTP/1.0" 202 Accepted 2025-09-27 05:02:21,752 - lava_callback - INFO - Starting async job submit for node 68d4ccd9a5c2c05277bd06e0 2025-09-27 05:02:21,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:02:21,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ccd9a5c2c05277bd06e0 HTTP/1.1" 200 None 2025-09-27 05:02:21,767 - lava_callback - DEBUG - Processing node 68d4ccd9a5c2c05277bd06e0: baseline-arm-clabbe 2025-09-27 05:02:21,767 - lava_callback - ERROR - Error processing callback for node 68d4ccd9a5c2c05277bd06e0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:02:22,417 - lava_callback - INFO - Received callback for node 68d4ccdca5c2c05277bd06e6 INFO: 172.21.0.1:52654 - "POST /node/68d4ccdca5c2c05277bd06e6 HTTP/1.0" 202 Accepted 2025-09-27 05:02:22,423 - lava_callback - INFO - Starting async job submit for node 68d4ccdca5c2c05277bd06e6 2025-09-27 05:02:22,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:02:22,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ccdca5c2c05277bd06e6 HTTP/1.1" 200 None 2025-09-27 05:02:22,436 - lava_callback - DEBUG - Processing node 68d4ccdca5c2c05277bd06e6: baseline-arm-clabbe 2025-09-27 05:02:22,436 - lava_callback - ERROR - Error processing callback for node 68d4ccdca5c2c05277bd06e6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:02:41,722 - lava_callback - INFO - Received callback for node 68d4cce5a5c2c05277bd06f5 INFO: 172.21.0.1:57592 - "POST /node/68d4cce5a5c2c05277bd06f5 HTTP/1.0" 202 Accepted 2025-09-27 05:02:41,727 - lava_callback - INFO - Starting async job submit for node 68d4cce5a5c2c05277bd06f5 2025-09-27 05:02:41,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:02:41,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cce5a5c2c05277bd06f5 HTTP/1.1" 200 None 2025-09-27 05:02:41,740 - lava_callback - DEBUG - Processing node 68d4cce5a5c2c05277bd06f5: baseline-arm-clabbe 2025-09-27 05:02:41,740 - lava_callback - ERROR - Error processing callback for node 68d4cce5a5c2c05277bd06f5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:02:42,380 - lava_callback - INFO - Received callback for node 68d4ccdea5c2c05277bd06e9 INFO: 172.21.0.1:57622 - "POST /node/68d4ccdea5c2c05277bd06e9 HTTP/1.0" 202 Accepted 2025-09-27 05:02:42,386 - lava_callback - INFO - Starting async job submit for node 68d4ccdea5c2c05277bd06e9 2025-09-27 05:02:42,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:02:42,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ccdea5c2c05277bd06e9 HTTP/1.1" 200 None 2025-09-27 05:02:42,399 - lava_callback - DEBUG - Processing node 68d4ccdea5c2c05277bd06e9: baseline-arm-clabbe 2025-09-27 05:02:42,399 - lava_callback - ERROR - Error processing callback for node 68d4ccdea5c2c05277bd06e9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:02:58,414 - lava_callback - INFO - Received callback for node 68d5cb2c2be2da466069ab15 INFO: 172.21.0.1:44772 - "POST /node/68d5cb2c2be2da466069ab15 HTTP/1.0" 202 Accepted 2025-09-27 05:02:58,421 - lava_callback - INFO - Starting async job submit for node 68d5cb2c2be2da466069ab15 2025-09-27 05:02:58,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:02:58,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb2c2be2da466069ab15 HTTP/1.1" 200 None 2025-09-27 05:02:58,479 - lava_callback - DEBUG - Processing node 68d5cb2c2be2da466069ab15: baseline-arm64 2025-09-27 05:02:59,359 - lava_callback - ERROR - Error processing callback for node 68d5cb2c2be2da466069ab15: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:03:26,250 - lava_callback - INFO - Received callback for node 68d4cd1aa5c2c05277bd0736 INFO: 172.21.0.1:55210 - "POST /node/68d4cd1aa5c2c05277bd0736 HTTP/1.0" 202 Accepted 2025-09-27 05:03:26,256 - lava_callback - INFO - Starting async job submit for node 68d4cd1aa5c2c05277bd0736 2025-09-27 05:03:26,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:03:26,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd1aa5c2c05277bd0736 HTTP/1.1" 200 None 2025-09-27 05:03:26,270 - lava_callback - DEBUG - Processing node 68d4cd1aa5c2c05277bd0736: ltp-syscalls-ipc 2025-09-27 05:03:26,270 - lava_callback - ERROR - Error processing callback for node 68d4cd1aa5c2c05277bd0736: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:03:27,011 - lava_callback - INFO - Received callback for node 68d4cd1ba5c2c05277bd0739 INFO: 172.21.0.1:55226 - "POST /node/68d4cd1ba5c2c05277bd0739 HTTP/1.0" 202 Accepted 2025-09-27 05:03:27,017 - lava_callback - INFO - Starting async job submit for node 68d4cd1ba5c2c05277bd0739 2025-09-27 05:03:27,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:03:27,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd1ba5c2c05277bd0739 HTTP/1.1" 200 None 2025-09-27 05:03:27,031 - lava_callback - DEBUG - Processing node 68d4cd1ba5c2c05277bd0739: ltp-timers 2025-09-27 05:03:27,031 - lava_callback - ERROR - Error processing callback for node 68d4cd1ba5c2c05277bd0739: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:03:27,802 - lava_callback - INFO - Received callback for node 68d4cd1da5c2c05277bd073c INFO: 172.21.0.1:55228 - "POST /node/68d4cd1da5c2c05277bd073c HTTP/1.0" 202 Accepted 2025-09-27 05:03:27,807 - lava_callback - INFO - Starting async job submit for node 68d4cd1da5c2c05277bd073c 2025-09-27 05:03:27,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:03:27,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd1da5c2c05277bd073c HTTP/1.1" 200 None 2025-09-27 05:03:27,841 - lava_callback - DEBUG - Processing node 68d4cd1da5c2c05277bd073c: ltp-watchqueue 2025-09-27 05:03:27,841 - lava_callback - ERROR - Error processing callback for node 68d4cd1da5c2c05277bd073c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33674 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:03:51,160 - lava_callback - INFO - Received callback for node 68d6176b30c58dac7d941f7c INFO: 172.21.0.1:46836 - "POST /node/68d6176b30c58dac7d941f7c HTTP/1.0" 202 Accepted 2025-09-27 05:03:51,166 - lava_callback - INFO - Starting async job submit for node 68d6176b30c58dac7d941f7c 2025-09-27 05:03:51,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:03:51,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6176b30c58dac7d941f7c HTTP/1.1" 200 None 2025-09-27 05:03:51,206 - lava_callback - DEBUG - Processing node 68d6176b30c58dac7d941f7c: baseline-arm 2025-09-27 05:03:51,466 - lava_callback - ERROR - Error processing callback for node 68d6176b30c58dac7d941f7c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:06:11,676 - lava_callback - INFO - Received callback for node 68d6176b30c58dac7d941f7f INFO: 172.21.0.1:42134 - "POST /node/68d6176b30c58dac7d941f7f HTTP/1.0" 202 Accepted 2025-09-27 05:06:11,682 - lava_callback - INFO - Starting async job submit for node 68d6176b30c58dac7d941f7f 2025-09-27 05:06:11,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:06:11,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6176b30c58dac7d941f7f HTTP/1.1" 200 None 2025-09-27 05:06:11,719 - lava_callback - DEBUG - Processing node 68d6176b30c58dac7d941f7f: baseline-arm 2025-09-27 05:06:11,946 - lava_callback - ERROR - Error processing callback for node 68d6176b30c58dac7d941f7f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:06:25,328 - lava_callback - INFO - Received callback for node 68d5e69730c58dac7d9415d2 INFO: 172.21.0.1:37368 - "POST /node/68d5e69730c58dac7d9415d2 HTTP/1.0" 202 Accepted 2025-09-27 05:06:25,334 - lava_callback - INFO - Starting async job submit for node 68d5e69730c58dac7d9415d2 2025-09-27 05:06:25,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:06:25,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e69730c58dac7d9415d2 HTTP/1.1" 200 None 2025-09-27 05:06:25,375 - lava_callback - DEBUG - Processing node 68d5e69730c58dac7d9415d2: baseline-arm64 2025-09-27 05:06:25,668 - lava_callback - ERROR - Error processing callback for node 68d5e69730c58dac7d9415d2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:07:40,669 - lava_callback - INFO - Received callback for node 68d4ce09a5c2c05277bd08d5 INFO: 172.21.0.1:41656 - "POST /node/68d4ce09a5c2c05277bd08d5 HTTP/1.0" 202 Accepted 2025-09-27 05:07:40,674 - lava_callback - INFO - Starting async job submit for node 68d4ce09a5c2c05277bd08d5 2025-09-27 05:07:40,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:07:40,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ce09a5c2c05277bd08d5 HTTP/1.1" 200 None 2025-09-27 05:07:40,710 - lava_callback - DEBUG - Processing node 68d4ce09a5c2c05277bd08d5: baseline-arm64-baylibre 2025-09-27 05:07:40,711 - lava_callback - ERROR - Error processing callback for node 68d4ce09a5c2c05277bd08d5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:07:44,791 - lava_callback - INFO - Received callback for node 68d5e69b30c58dac7d9415ed INFO: 172.21.0.1:41678 - "POST /node/68d5e69b30c58dac7d9415ed HTTP/1.0" 202 Accepted 2025-09-27 05:07:44,797 - lava_callback - INFO - Starting async job submit for node 68d5e69b30c58dac7d9415ed 2025-09-27 05:07:44,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:07:44,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e69b30c58dac7d9415ed HTTP/1.1" 200 None 2025-09-27 05:07:44,853 - lava_callback - DEBUG - Processing node 68d5e69b30c58dac7d9415ed: baseline-arm64 2025-09-27 05:07:45,183 - lava_callback - ERROR - Error processing callback for node 68d5e69b30c58dac7d9415ed: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:09:05,230 - lava_callback - INFO - Received callback for node 68d5ea4130c58dac7d9416c8 INFO: 172.21.0.1:39876 - "POST /node/68d5ea4130c58dac7d9416c8 HTTP/1.0" 202 Accepted 2025-09-27 05:09:05,237 - lava_callback - INFO - Starting async job submit for node 68d5ea4130c58dac7d9416c8 2025-09-27 05:09:05,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:09:05,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ea4130c58dac7d9416c8 HTTP/1.1" 200 None 2025-09-27 05:09:05,270 - lava_callback - DEBUG - Processing node 68d5ea4130c58dac7d9416c8: baseline-arm64 2025-09-27 05:09:05,601 - lava_callback - ERROR - Error processing callback for node 68d5ea4130c58dac7d9416c8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:09:30,536 - lava_callback - INFO - Received callback for node 68d6176d30c58dac7d941f82 INFO: 172.21.0.1:48016 - "POST /node/68d6176d30c58dac7d941f82 HTTP/1.0" 202 Accepted 2025-09-27 05:09:30,542 - lava_callback - INFO - Starting async job submit for node 68d6176d30c58dac7d941f82 2025-09-27 05:09:30,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:09:30,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6176d30c58dac7d941f82 HTTP/1.1" 200 None 2025-09-27 05:09:30,602 - lava_callback - DEBUG - Processing node 68d6176d30c58dac7d941f82: baseline-arm 2025-09-27 05:09:30,832 - lava_callback - ERROR - Error processing callback for node 68d6176d30c58dac7d941f82: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:09:35,968 - lava_callback - INFO - Received callback for node 68d4cd13a5c2c05277bd072a INFO: 172.21.0.1:48022 - "POST /node/68d4cd13a5c2c05277bd072a HTTP/1.0" 202 Accepted 2025-09-27 05:09:35,975 - lava_callback - INFO - Starting async job submit for node 68d4cd13a5c2c05277bd072a 2025-09-27 05:09:36,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:09:36,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd13a5c2c05277bd072a HTTP/1.1" 200 None 2025-09-27 05:09:36,027 - lava_callback - DEBUG - Processing node 68d4cd13a5c2c05277bd072a: ltp-pty 2025-09-27 05:09:36,412 - lava_callback - ERROR - Error processing callback for node 68d4cd13a5c2c05277bd072a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:09:37,869 - lava_callback - INFO - Received callback for node 68d4cd16a5c2c05277bd0730 INFO: 172.21.0.1:48036 - "POST /node/68d4cd16a5c2c05277bd0730 HTTP/1.0" 202 Accepted 2025-09-27 05:09:37,876 - lava_callback - INFO - Starting async job submit for node 68d4cd16a5c2c05277bd0730 2025-09-27 05:09:37,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:09:37,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd16a5c2c05277bd0730 HTTP/1.1" 200 None 2025-09-27 05:09:37,937 - lava_callback - DEBUG - Processing node 68d4cd16a5c2c05277bd0730: ltp-smoketest 2025-09-27 05:09:38,356 - lava_callback - ERROR - Error processing callback for node 68d4cd16a5c2c05277bd0730: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:09:42,096 - lava_callback - INFO - Received callback for node 68d4ce8da5c2c05277bd098f INFO: 172.21.0.1:49110 - "POST /node/68d4ce8da5c2c05277bd098f HTTP/1.0" 202 Accepted 2025-09-27 05:09:42,102 - lava_callback - INFO - Starting async job submit for node 68d4ce8da5c2c05277bd098f 2025-09-27 05:09:42,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:09:42,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ce8da5c2c05277bd098f HTTP/1.1" 200 None 2025-09-27 05:09:42,115 - lava_callback - DEBUG - Processing node 68d4ce8da5c2c05277bd098f: baseline-arm64-clabbe 2025-09-27 05:09:42,115 - lava_callback - ERROR - Error processing callback for node 68d4ce8da5c2c05277bd098f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:10:02,108 - lava_callback - INFO - Received callback for node 68d4ce96a5c2c05277bd0998 INFO: 172.21.0.1:59388 - "POST /node/68d4ce96a5c2c05277bd0998 HTTP/1.0" 202 Accepted 2025-09-27 05:10:02,113 - lava_callback - INFO - Starting async job submit for node 68d4ce96a5c2c05277bd0998 2025-09-27 05:10:02,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:10:02,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ce96a5c2c05277bd0998 HTTP/1.1" 200 None 2025-09-27 05:10:02,137 - lava_callback - DEBUG - Processing node 68d4ce96a5c2c05277bd0998: baseline-arm64-clabbe 2025-09-27 05:10:02,137 - lava_callback - ERROR - Error processing callback for node 68d4ce96a5c2c05277bd0998: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:10:42,171 - lava_callback - INFO - Received callback for node 68d4cec5a5c2c05277bd09c8 INFO: 172.21.0.1:38598 - "POST /node/68d4cec5a5c2c05277bd09c8 HTTP/1.0" 202 Accepted 2025-09-27 05:10:42,177 - lava_callback - INFO - Starting async job submit for node 68d4cec5a5c2c05277bd09c8 2025-09-27 05:10:42,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:10:42,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cec5a5c2c05277bd09c8 HTTP/1.1" 200 None 2025-09-27 05:10:42,190 - lava_callback - DEBUG - Processing node 68d4cec5a5c2c05277bd09c8: baseline-arm64-clabbe 2025-09-27 05:10:42,190 - lava_callback - ERROR - Error processing callback for node 68d4cec5a5c2c05277bd09c8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:10:42,823 - lava_callback - INFO - Received callback for node 68d4cec1a5c2c05277bd09c5 INFO: 172.21.0.1:38610 - "POST /node/68d4cec1a5c2c05277bd09c5 HTTP/1.0" 202 Accepted 2025-09-27 05:10:42,829 - lava_callback - INFO - Starting async job submit for node 68d4cec1a5c2c05277bd09c5 2025-09-27 05:10:42,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:10:42,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cec1a5c2c05277bd09c5 HTTP/1.1" 200 None 2025-09-27 05:10:42,842 - lava_callback - DEBUG - Processing node 68d4cec1a5c2c05277bd09c5: baseline-arm64-clabbe 2025-09-27 05:10:42,842 - lava_callback - ERROR - Error processing callback for node 68d4cec1a5c2c05277bd09c5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:10:56,180 - lava_callback - INFO - Received callback for node 68d5ea4630c58dac7d9416e3 INFO: 172.21.0.1:53306 - "POST /node/68d5ea4630c58dac7d9416e3 HTTP/1.0" 202 Accepted 2025-09-27 05:10:56,186 - lava_callback - INFO - Starting async job submit for node 68d5ea4630c58dac7d9416e3 2025-09-27 05:10:56,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:10:56,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ea4630c58dac7d9416e3 HTTP/1.1" 200 None 2025-09-27 05:10:56,220 - lava_callback - DEBUG - Processing node 68d5ea4630c58dac7d9416e3: baseline-arm64 INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:10:56,555 - lava_callback - ERROR - Error processing callback for node 68d5ea4630c58dac7d9416e3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:11:02,135 - lava_callback - INFO - Received callback for node 68d4cee2a5c2c05277bd09ef INFO: 172.21.0.1:45548 - "POST /node/68d4cee2a5c2c05277bd09ef HTTP/1.0" 202 Accepted 2025-09-27 05:11:02,140 - lava_callback - INFO - Starting async job submit for node 68d4cee2a5c2c05277bd09ef 2025-09-27 05:11:02,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:11:02,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cee2a5c2c05277bd09ef HTTP/1.1" 200 None 2025-09-27 05:11:02,161 - lava_callback - DEBUG - Processing node 68d4cee2a5c2c05277bd09ef: baseline-arm64-clabbe 2025-09-27 05:11:02,161 - lava_callback - ERROR - Error processing callback for node 68d4cee2a5c2c05277bd09ef: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:11:35,761 - lava_callback - INFO - Received callback for node 68d4db6fa5c2c05277bd0c54 INFO: 172.21.0.1:35150 - "POST /node/68d4db6fa5c2c05277bd0c54 HTTP/1.0" 202 Accepted 2025-09-27 05:11:35,767 - lava_callback - INFO - Starting async job submit for node 68d4db6fa5c2c05277bd0c54 2025-09-27 05:11:35,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:11:35,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db6fa5c2c05277bd0c54 HTTP/1.1" 200 None 2025-09-27 05:11:35,813 - lava_callback - DEBUG - Processing node 68d4db6fa5c2c05277bd0c54: baseline-arm-broonie 2025-09-27 05:11:35,999 - lava_callback - ERROR - Error processing callback for node 68d4db6fa5c2c05277bd0c54: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:11:51,520 - lava_callback - INFO - Received callback for node 68d6176d30c58dac7d941f85 INFO: 172.21.0.1:53588 - "POST /node/68d6176d30c58dac7d941f85 HTTP/1.0" 202 Accepted 2025-09-27 05:11:51,525 - lava_callback - INFO - Starting async job submit for node 68d6176d30c58dac7d941f85 2025-09-27 05:11:51,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:11:51,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6176d30c58dac7d941f85 HTTP/1.1" 200 None 2025-09-27 05:11:51,579 - lava_callback - DEBUG - Processing node 68d6176d30c58dac7d941f85: baseline-arm 2025-09-27 05:11:51,826 - lava_callback - ERROR - Error processing callback for node 68d6176d30c58dac7d941f85: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:13:00,954 - lava_callback - INFO - Received callback for node 68d4cf57a5c2c05277bd0abe INFO: 172.21.0.1:40500 - "POST /node/68d4cf57a5c2c05277bd0abe HTTP/1.0" 202 Accepted 2025-09-27 05:13:00,959 - lava_callback - INFO - Starting async job submit for node 68d4cf57a5c2c05277bd0abe 2025-09-27 05:13:00,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:13:00,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cf57a5c2c05277bd0abe HTTP/1.1" 200 None 2025-09-27 05:13:00,976 - lava_callback - DEBUG - Processing node 68d4cf57a5c2c05277bd0abe: baseline-arm64-baylibre 2025-09-27 05:13:00,976 - lava_callback - ERROR - Error processing callback for node 68d4cf57a5c2c05277bd0abe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:14:22,354 - lava_callback - INFO - Received callback for node 68d4cfaba5c2c05277bd0b0f INFO: 172.21.0.1:60910 - "POST /node/68d4cfaba5c2c05277bd0b0f HTTP/1.0" 202 Accepted 2025-09-27 05:14:22,360 - lava_callback - INFO - Starting async job submit for node 68d4cfaba5c2c05277bd0b0f 2025-09-27 05:14:22,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:14:22,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cfaba5c2c05277bd0b0f HTTP/1.1" 200 None 2025-09-27 05:14:22,373 - lava_callback - DEBUG - Processing node 68d4cfaba5c2c05277bd0b0f: baseline-arm64-clabbe 2025-09-27 05:14:22,373 - lava_callback - ERROR - Error processing callback for node 68d4cfaba5c2c05277bd0b0f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:14:41,031 - lava_callback - INFO - Received callback for node 68d4cfb7a5c2c05277bd0b1b INFO: 172.21.0.1:33046 - "POST /node/68d4cfb7a5c2c05277bd0b1b HTTP/1.0" 202 Accepted 2025-09-27 05:14:41,036 - lava_callback - INFO - Starting async job submit for node 68d4cfb7a5c2c05277bd0b1b 2025-09-27 05:14:41,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:14:41,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cfb7a5c2c05277bd0b1b HTTP/1.1" 200 None 2025-09-27 05:14:41,049 - lava_callback - DEBUG - Processing node 68d4cfb7a5c2c05277bd0b1b: baseline-arm64-baylibre 2025-09-27 05:14:41,049 - lava_callback - ERROR - Error processing callback for node 68d4cfb7a5c2c05277bd0b1b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:14:42,324 - lava_callback - INFO - Received callback for node 68d4cfb4a5c2c05277bd0b18 INFO: 172.21.0.1:33068 - "POST /node/68d4cfb4a5c2c05277bd0b18 HTTP/1.0" 202 Accepted 2025-09-27 05:14:42,329 - lava_callback - INFO - Starting async job submit for node 68d4cfb4a5c2c05277bd0b18 2025-09-27 05:14:42,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:14:42,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cfb4a5c2c05277bd0b18 HTTP/1.1" 200 None 2025-09-27 05:14:42,343 - lava_callback - DEBUG - Processing node 68d4cfb4a5c2c05277bd0b18: baseline-arm64-clabbe 2025-09-27 05:14:42,343 - lava_callback - ERROR - Error processing callback for node 68d4cfb4a5c2c05277bd0b18: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:14:42,974 - lava_callback - INFO - Received callback for node 68d4cfbaa5c2c05277bd0b1e INFO: 172.21.0.1:33070 - "POST /node/68d4cfbaa5c2c05277bd0b1e HTTP/1.0" 202 Accepted 2025-09-27 05:14:42,980 - lava_callback - INFO - Starting async job submit for node 68d4cfbaa5c2c05277bd0b1e 2025-09-27 05:14:42,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:14:42,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cfbaa5c2c05277bd0b1e HTTP/1.1" 200 None 2025-09-27 05:14:42,994 - lava_callback - DEBUG - Processing node 68d4cfbaa5c2c05277bd0b1e: baseline-arm64-clabbe 2025-09-27 05:14:42,994 - lava_callback - ERROR - Error processing callback for node 68d4cfbaa5c2c05277bd0b1e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:14:43,638 - lava_callback - INFO - Received callback for node 68d4cfbda5c2c05277bd0b21 INFO: 172.21.0.1:33074 - "POST /node/68d4cfbda5c2c05277bd0b21 HTTP/1.0" 202 Accepted 2025-09-27 05:14:43,643 - lava_callback - INFO - Starting async job submit for node 68d4cfbda5c2c05277bd0b21 2025-09-27 05:14:43,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:14:43,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cfbda5c2c05277bd0b21 HTTP/1.1" 200 None 2025-09-27 05:14:43,657 - lava_callback - DEBUG - Processing node 68d4cfbda5c2c05277bd0b21: baseline-arm64-clabbe 2025-09-27 05:14:43,657 - lava_callback - ERROR - Error processing callback for node 68d4cfbda5c2c05277bd0b21: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:14:44,300 - lava_callback - INFO - Received callback for node 68d4cfc0a5c2c05277bd0b24 INFO: 172.21.0.1:33088 - "POST /node/68d4cfc0a5c2c05277bd0b24 HTTP/1.0" 202 Accepted 2025-09-27 05:14:44,305 - lava_callback - INFO - Starting async job submit for node 68d4cfc0a5c2c05277bd0b24 2025-09-27 05:14:44,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:14:44,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cfc0a5c2c05277bd0b24 HTTP/1.1" 200 None 2025-09-27 05:14:44,319 - lava_callback - DEBUG - Processing node 68d4cfc0a5c2c05277bd0b24: baseline-arm64-clabbe 2025-09-27 05:14:44,319 - lava_callback - ERROR - Error processing callback for node 68d4cfc0a5c2c05277bd0b24: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 05:14:44,878 - lava_callback - INFO - Received callback for node 68d5ff6b30c58dac7d941aaa INFO: 172.21.0.1:33104 - "POST /node/68d5ff6b30c58dac7d941aaa HTTP/1.0" 202 Accepted 2025-09-27 05:14:44,884 - lava_callback - INFO - Starting async job submit for node 68d5ff6b30c58dac7d941aaa 2025-09-27 05:14:44,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:14:44,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ff6b30c58dac7d941aaa HTTP/1.1" 200 None 2025-09-27 05:14:44,918 - lava_callback - DEBUG - Processing node 68d5ff6b30c58dac7d941aaa: baseline-arm64 2025-09-27 05:14:45,251 - lava_callback - ERROR - Error processing callback for node 68d5ff6b30c58dac7d941aaa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:14:48,292 - lava_callback - INFO - Received callback for node 68d61a2f30c58dac7d942148 INFO: 172.21.0.1:33114 - "POST /node/68d61a2f30c58dac7d942148 HTTP/1.0" 202 Accepted 2025-09-27 05:14:48,298 - lava_callback - INFO - Starting async job submit for node 68d61a2f30c58dac7d942148 2025-09-27 05:14:48,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:14:48,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61a2f30c58dac7d942148 HTTP/1.1" 200 None 2025-09-27 05:14:48,352 - lava_callback - DEBUG - Processing node 68d61a2f30c58dac7d942148: baseline-arm 2025-09-27 05:14:48,578 - lava_callback - ERROR - Error processing callback for node 68d61a2f30c58dac7d942148: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38464 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:15:56,039 - lava_callback - INFO - Received callback for node 68d4dbb6a5c2c05277bd0c98 INFO: 172.21.0.1:58758 - "POST /node/68d4dbb6a5c2c05277bd0c98 HTTP/1.0" 202 Accepted 2025-09-27 05:15:56,046 - lava_callback - INFO - Starting async job submit for node 68d4dbb6a5c2c05277bd0c98 2025-09-27 05:15:56,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:15:56,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbb6a5c2c05277bd0c98 HTTP/1.1" 200 None 2025-09-27 05:15:56,104 - lava_callback - DEBUG - Processing node 68d4dbb6a5c2c05277bd0c98: ltp-cap-bounds 2025-09-27 05:15:56,455 - lava_callback - ERROR - Error processing callback for node 68d4dbb6a5c2c05277bd0c98: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:16:05,901 - lava_callback - INFO - Received callback for node 68d5ff6c30c58dac7d941aad INFO: 172.21.0.1:32948 - "POST /node/68d5ff6c30c58dac7d941aad HTTP/1.0" 202 Accepted 2025-09-27 05:16:05,907 - lava_callback - INFO - Starting async job submit for node 68d5ff6c30c58dac7d941aad 2025-09-27 05:16:05,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:16:05,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ff6c30c58dac7d941aad HTTP/1.1" 200 None 2025-09-27 05:16:05,981 - lava_callback - DEBUG - Processing node 68d5ff6c30c58dac7d941aad: baseline-arm64 2025-09-27 05:16:06,314 - lava_callback - ERROR - Error processing callback for node 68d5ff6c30c58dac7d941aad: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:16:53,746 - lava_callback - INFO - Received callback for node 68d4cc95a5c2c05277bd065f INFO: 172.21.0.1:45258 - "POST /node/68d4cc95a5c2c05277bd065f HTTP/1.0" 202 Accepted 2025-09-27 05:16:53,752 - lava_callback - INFO - Starting async job submit for node 68d4cc95a5c2c05277bd065f 2025-09-27 05:16:53,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:16:53,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cc95a5c2c05277bd065f HTTP/1.1" 200 None 2025-09-27 05:16:53,815 - lava_callback - DEBUG - Processing node 68d4cc95a5c2c05277bd065f: baseline-arm 2025-09-27 05:16:54,106 - lava_callback - ERROR - Error processing callback for node 68d4cc95a5c2c05277bd065f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:17:11,600 - lava_callback - INFO - Received callback for node 68d61a3030c58dac7d942157 INFO: 172.21.0.1:59836 - "POST /node/68d61a3030c58dac7d942157 HTTP/1.0" 202 Accepted 2025-09-27 05:17:11,606 - lava_callback - INFO - Starting async job submit for node 68d61a3030c58dac7d942157 2025-09-27 05:17:11,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:17:11,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61a3030c58dac7d942157 HTTP/1.1" 200 None 2025-09-27 05:17:11,640 - lava_callback - DEBUG - Processing node 68d61a3030c58dac7d942157: baseline-arm 2025-09-27 05:17:11,863 - lava_callback - ERROR - Error processing callback for node 68d61a3030c58dac7d942157: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:17:54,063 - lava_callback - INFO - Received callback for node 68d5ff6e30c58dac7d941ab0 INFO: 172.21.0.1:45914 - "POST /node/68d5ff6e30c58dac7d941ab0 HTTP/1.0" 202 Accepted 2025-09-27 05:17:54,070 - lava_callback - INFO - Starting async job submit for node 68d5ff6e30c58dac7d941ab0 2025-09-27 05:17:54,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:17:54,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ff6e30c58dac7d941ab0 HTTP/1.1" 200 None 2025-09-27 05:17:54,103 - lava_callback - DEBUG - Processing node 68d5ff6e30c58dac7d941ab0: baseline-arm64 2025-09-27 05:17:54,446 - lava_callback - ERROR - Error processing callback for node 68d5ff6e30c58dac7d941ab0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:19:07,283 - lava_callback - INFO - Received callback for node 68d5ff6f30c58dac7d941ab3 INFO: 172.21.0.1:38102 - "POST /node/68d5ff6f30c58dac7d941ab3 HTTP/1.0" 202 Accepted 2025-09-27 05:19:07,289 - lava_callback - INFO - Starting async job submit for node 68d5ff6f30c58dac7d941ab3 2025-09-27 05:19:07,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:19:07,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ff6f30c58dac7d941ab3 HTTP/1.1" 200 None 2025-09-27 05:19:07,344 - lava_callback - DEBUG - Processing node 68d5ff6f30c58dac7d941ab3: baseline-arm64 2025-09-27 05:19:07,693 - lava_callback - ERROR - Error processing callback for node 68d5ff6f30c58dac7d941ab3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:19:31,767 - lava_callback - INFO - Received callback for node 68d61a3330c58dac7d942171 INFO: 172.21.0.1:44320 - "POST /node/68d61a3330c58dac7d942171 HTTP/1.0" 202 Accepted 2025-09-27 05:19:31,773 - lava_callback - INFO - Starting async job submit for node 68d61a3330c58dac7d942171 2025-09-27 05:19:31,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:19:31,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61a3330c58dac7d942171 HTTP/1.1" 200 None 2025-09-27 05:19:31,809 - lava_callback - DEBUG - Processing node 68d61a3330c58dac7d942171: baseline-arm 2025-09-27 05:19:32,035 - lava_callback - ERROR - Error processing callback for node 68d61a3330c58dac7d942171: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:19:38,330 - lava_callback - INFO - Received callback for node 68d4cd15a5c2c05277bd072d INFO: 172.21.0.1:44336 - "POST /node/68d4cd15a5c2c05277bd072d HTTP/1.0" 202 Accepted 2025-09-27 05:19:38,337 - lava_callback - INFO - Starting async job submit for node 68d4cd15a5c2c05277bd072d 2025-09-27 05:19:38,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:19:38,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd15a5c2c05277bd072d HTTP/1.1" 200 None 2025-09-27 05:19:38,377 - lava_callback - DEBUG - Processing node 68d4cd15a5c2c05277bd072d: ltp-sched 2025-09-27 05:19:38,707 - lava_callback - ERROR - Error processing callback for node 68d4cd15a5c2c05277bd072d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:20:30,275 - lava_callback - INFO - Received callback for node 68d5ff7130c58dac7d941ab6 INFO: 172.21.0.1:56826 - "POST /node/68d5ff7130c58dac7d941ab6 HTTP/1.0" 202 Accepted 2025-09-27 05:20:30,282 - lava_callback - INFO - Starting async job submit for node 68d5ff7130c58dac7d941ab6 2025-09-27 05:20:30,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:20:30,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ff7130c58dac7d941ab6 HTTP/1.1" 200 None 2025-09-27 05:20:30,315 - lava_callback - DEBUG - Processing node 68d5ff7130c58dac7d941ab6: baseline-arm64 2025-09-27 05:20:30,662 - lava_callback - ERROR - Error processing callback for node 68d5ff7130c58dac7d941ab6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:21:51,623 - lava_callback - INFO - Received callback for node 68d61a3330c58dac7d942174 INFO: 172.21.0.1:53170 - "POST /node/68d61a3330c58dac7d942174 HTTP/1.0" 202 Accepted 2025-09-27 05:21:51,629 - lava_callback - INFO - Starting async job submit for node 68d61a3330c58dac7d942174 2025-09-27 05:21:51,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:21:51,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61a3330c58dac7d942174 HTTP/1.1" 200 None 2025-09-27 05:21:51,691 - lava_callback - DEBUG - Processing node 68d61a3330c58dac7d942174: baseline-arm 2025-09-27 05:21:51,913 - lava_callback - ERROR - Error processing callback for node 68d61a3330c58dac7d942174: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:21:56,306 - lava_callback - INFO - Received callback for node 68d4dbdea5c2c05277bd0cab INFO: 172.21.0.1:53174 - "POST /node/68d4dbdea5c2c05277bd0cab HTTP/1.0" 202 Accepted 2025-09-27 05:21:56,314 - lava_callback - INFO - Starting async job submit for node 68d4dbdea5c2c05277bd0cab 2025-09-27 05:21:56,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:21:56,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbdea5c2c05277bd0cab HTTP/1.1" 200 None 2025-09-27 05:21:56,428 - lava_callback - DEBUG - Processing node 68d4dbdea5c2c05277bd0cab: ltp-containers INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:21:57,202 - lava_callback - ERROR - Error processing callback for node 68d4dbdea5c2c05277bd0cab: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 05:22:15,256 - lava_callback - INFO - Received callback for node 68d5ff7230c58dac7d941ab9 INFO: 172.21.0.1:39172 - "POST /node/68d5ff7230c58dac7d941ab9 HTTP/1.0" 202 Accepted 2025-09-27 05:22:15,263 - lava_callback - INFO - Starting async job submit for node 68d5ff7230c58dac7d941ab9 2025-09-27 05:22:15,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:22:15,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ff7230c58dac7d941ab9 HTTP/1.1" 200 None 2025-09-27 05:22:15,296 - lava_callback - DEBUG - Processing node 68d5ff7230c58dac7d941ab9: baseline-arm64 2025-09-27 05:22:15,656 - lava_callback - ERROR - Error processing callback for node 68d5ff7230c58dac7d941ab9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:22:29,249 - lava_callback - INFO - Received callback for node 68d5cb2e2be2da466069ab18 INFO: 172.21.0.1:52788 - "POST /node/68d5cb2e2be2da466069ab18 HTTP/1.0" 202 Accepted 2025-09-27 05:22:29,256 - lava_callback - INFO - Starting async job submit for node 68d5cb2e2be2da466069ab18 2025-09-27 05:22:29,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:22:29,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb2e2be2da466069ab18 HTTP/1.1" 200 None 2025-09-27 05:22:29,316 - lava_callback - DEBUG - Processing node 68d5cb2e2be2da466069ab18: baseline-arm64 2025-09-27 05:22:30,194 - lava_callback - ERROR - Error processing callback for node 68d5cb2e2be2da466069ab18: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:22:58,744 - lava_callback - INFO - Received callback for node 68d5cb2f2be2da466069ab1b INFO: 172.21.0.1:38764 - "POST /node/68d5cb2f2be2da466069ab1b HTTP/1.0" 202 Accepted 2025-09-27 05:22:58,752 - lava_callback - INFO - Starting async job submit for node 68d5cb2f2be2da466069ab1b 2025-09-27 05:22:58,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:22:58,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb2f2be2da466069ab1b HTTP/1.1" 200 None 2025-09-27 05:22:58,825 - lava_callback - DEBUG - Processing node 68d5cb2f2be2da466069ab1b: baseline-arm64 2025-09-27 05:22:59,728 - lava_callback - ERROR - Error processing callback for node 68d5cb2f2be2da466069ab1b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:23:54,248 - lava_callback - INFO - Received callback for node 68d5ff7430c58dac7d941abc INFO: 172.21.0.1:51998 - "POST /node/68d5ff7430c58dac7d941abc HTTP/1.0" 202 Accepted 2025-09-27 05:23:54,254 - lava_callback - INFO - Starting async job submit for node 68d5ff7430c58dac7d941abc 2025-09-27 05:23:54,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:23:54,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ff7430c58dac7d941abc HTTP/1.1" 200 None 2025-09-27 05:23:54,290 - lava_callback - DEBUG - Processing node 68d5ff7430c58dac7d941abc: baseline-arm64 2025-09-27 05:23:54,654 - lava_callback - ERROR - Error processing callback for node 68d5ff7430c58dac7d941abc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:24:13,357 - lava_callback - INFO - Received callback for node 68d61a4130c58dac7d94219b INFO: 172.21.0.1:33434 - "POST /node/68d61a4130c58dac7d94219b HTTP/1.0" 202 Accepted 2025-09-27 05:24:13,363 - lava_callback - INFO - Starting async job submit for node 68d61a4130c58dac7d94219b 2025-09-27 05:24:13,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:24:13,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61a4130c58dac7d94219b HTTP/1.1" 200 None 2025-09-27 05:24:13,400 - lava_callback - DEBUG - Processing node 68d61a4130c58dac7d94219b: baseline-arm 2025-09-27 05:24:13,626 - lava_callback - ERROR - Error processing callback for node 68d61a4130c58dac7d94219b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:24:23,910 - lava_callback - INFO - Received callback for node 68d5ff7530c58dac7d941abf INFO: 172.21.0.1:38896 - "POST /node/68d5ff7530c58dac7d941abf HTTP/1.0" 202 Accepted 2025-09-27 05:24:23,916 - lava_callback - INFO - Starting async job submit for node 68d5ff7530c58dac7d941abf 2025-09-27 05:24:23,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:24:23,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ff7530c58dac7d941abf HTTP/1.1" 200 None 2025-09-27 05:24:23,971 - lava_callback - DEBUG - Processing node 68d5ff7530c58dac7d941abf: baseline-arm64 2025-09-27 05:24:24,300 - lava_callback - ERROR - Error processing callback for node 68d5ff7530c58dac7d941abf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:24:25,322 - lava_callback - INFO - Received callback for node 68d5ffe130c58dac7d941bbf INFO: 172.21.0.1:38904 - "POST /node/68d5ffe130c58dac7d941bbf HTTP/1.0" 202 Accepted 2025-09-27 05:24:25,328 - lava_callback - INFO - Starting async job submit for node 68d5ffe130c58dac7d941bbf 2025-09-27 05:24:25,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:24:25,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ffe130c58dac7d941bbf HTTP/1.1" 200 None 2025-09-27 05:24:25,381 - lava_callback - DEBUG - Processing node 68d5ffe130c58dac7d941bbf: baseline-arm64 2025-09-27 05:24:25,739 - lava_callback - ERROR - Error processing callback for node 68d5ffe130c58dac7d941bbf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:25:10,370 - lava_callback - INFO - Received callback for node 68d5ffe230c58dac7d941bc2 INFO: 172.21.0.1:43836 - "POST /node/68d5ffe230c58dac7d941bc2 HTTP/1.0" 202 Accepted 2025-09-27 05:25:10,376 - lava_callback - INFO - Starting async job submit for node 68d5ffe230c58dac7d941bc2 2025-09-27 05:25:10,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:25:10,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ffe230c58dac7d941bc2 HTTP/1.1" 200 None 2025-09-27 05:25:10,410 - lava_callback - DEBUG - Processing node 68d5ffe230c58dac7d941bc2: baseline-arm64 2025-09-27 05:25:10,735 - lava_callback - ERROR - Error processing callback for node 68d5ffe230c58dac7d941bc2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:25:46,635 - lava_callback - INFO - Received callback for node 68d5ffe530c58dac7d941bc8 INFO: 172.21.0.1:46504 - "POST /node/68d5ffe530c58dac7d941bc8 HTTP/1.0" 202 Accepted 2025-09-27 05:25:46,641 - lava_callback - INFO - Starting async job submit for node 68d5ffe530c58dac7d941bc8 2025-09-27 05:25:46,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:25:46,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ffe530c58dac7d941bc8 HTTP/1.1" 200 None 2025-09-27 05:25:46,675 - lava_callback - DEBUG - Processing node 68d5ffe530c58dac7d941bc8: baseline-arm64 2025-09-27 05:25:47,022 - lava_callback - ERROR - Error processing callback for node 68d5ffe530c58dac7d941bc8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:25:55,152 - lava_callback - INFO - Received callback for node 68d5ffe430c58dac7d941bc5 INFO: 172.21.0.1:33742 - "POST /node/68d5ffe430c58dac7d941bc5 HTTP/1.0" 202 Accepted 2025-09-27 05:25:55,158 - lava_callback - INFO - Starting async job submit for node 68d5ffe430c58dac7d941bc5 2025-09-27 05:25:55,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:25:55,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ffe430c58dac7d941bc5 HTTP/1.1" 200 None 2025-09-27 05:25:55,191 - lava_callback - DEBUG - Processing node 68d5ffe430c58dac7d941bc5: baseline-arm64 2025-09-27 05:25:55,525 - lava_callback - ERROR - Error processing callback for node 68d5ffe430c58dac7d941bc5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:26:25,453 - lava_callback - INFO - Received callback for node 68d5ffe830c58dac7d941bcb INFO: 172.21.0.1:42432 - "POST /node/68d5ffe830c58dac7d941bcb HTTP/1.0" 202 Accepted 2025-09-27 05:26:25,460 - lava_callback - INFO - Starting async job submit for node 68d5ffe830c58dac7d941bcb 2025-09-27 05:26:25,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:26:25,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ffe830c58dac7d941bcb HTTP/1.1" 200 None 2025-09-27 05:26:25,496 - lava_callback - DEBUG - Processing node 68d5ffe830c58dac7d941bcb: baseline-arm64 2025-09-27 05:26:25,823 - lava_callback - ERROR - Error processing callback for node 68d5ffe830c58dac7d941bcb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:26:34,836 - lava_callback - INFO - Received callback for node 68d61a4230c58dac7d94219e INFO: 172.21.0.1:49506 - "POST /node/68d61a4230c58dac7d94219e HTTP/1.0" 202 Accepted 2025-09-27 05:26:34,842 - lava_callback - INFO - Starting async job submit for node 68d61a4230c58dac7d94219e 2025-09-27 05:26:34,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:26:34,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61a4230c58dac7d94219e HTTP/1.1" 200 None 2025-09-27 05:26:34,887 - lava_callback - DEBUG - Processing node 68d61a4230c58dac7d94219e: baseline-arm 2025-09-27 05:26:35,135 - lava_callback - ERROR - Error processing callback for node 68d61a4230c58dac7d94219e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:27:09,136 - lava_callback - INFO - Received callback for node 68d5ffe830c58dac7d941bce INFO: 172.21.0.1:40408 - "POST /node/68d5ffe830c58dac7d941bce HTTP/1.0" 202 Accepted 2025-09-27 05:27:09,142 - lava_callback - INFO - Starting async job submit for node 68d5ffe830c58dac7d941bce 2025-09-27 05:27:09,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:27:09,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ffe830c58dac7d941bce HTTP/1.1" 200 None 2025-09-27 05:27:09,175 - lava_callback - DEBUG - Processing node 68d5ffe830c58dac7d941bce: baseline-arm64 2025-09-27 05:27:09,503 - lava_callback - ERROR - Error processing callback for node 68d5ffe830c58dac7d941bce: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:27:22,817 - lava_callback - INFO - Received callback for node 68d5ffeb30c58dac7d941bd1 INFO: 172.21.0.1:50980 - "POST /node/68d5ffeb30c58dac7d941bd1 HTTP/1.0" 202 Accepted 2025-09-27 05:27:22,823 - lava_callback - INFO - Starting async job submit for node 68d5ffeb30c58dac7d941bd1 2025-09-27 05:27:22,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:27:22,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ffeb30c58dac7d941bd1 HTTP/1.1" 200 None 2025-09-27 05:27:22,860 - lava_callback - DEBUG - Processing node 68d5ffeb30c58dac7d941bd1: baseline-arm64 2025-09-27 05:27:23,213 - lava_callback - ERROR - Error processing callback for node 68d5ffeb30c58dac7d941bd1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:27:52,878 - lava_callback - INFO - Received callback for node 68d5ffeb30c58dac7d941bd4 INFO: 172.21.0.1:47226 - "POST /node/68d5ffeb30c58dac7d941bd4 HTTP/1.0" 202 Accepted 2025-09-27 05:27:52,884 - lava_callback - INFO - Starting async job submit for node 68d5ffeb30c58dac7d941bd4 2025-09-27 05:27:52,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:27:52,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ffeb30c58dac7d941bd4 HTTP/1.1" 200 None 2025-09-27 05:27:52,916 - lava_callback - DEBUG - Processing node 68d5ffeb30c58dac7d941bd4: baseline-arm64 2025-09-27 05:27:53,240 - lava_callback - ERROR - Error processing callback for node 68d5ffeb30c58dac7d941bd4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:28:29,239 - lava_callback - INFO - Received callback for node 68d6009330c58dac7d941d0c INFO: 172.21.0.1:44542 - "POST /node/68d6009330c58dac7d941d0c HTTP/1.0" 202 Accepted 2025-09-27 05:28:29,245 - lava_callback - INFO - Starting async job submit for node 68d6009330c58dac7d941d0c 2025-09-27 05:28:29,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:28:29,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6009330c58dac7d941d0c HTTP/1.1" 200 None 2025-09-27 05:28:29,278 - lava_callback - DEBUG - Processing node 68d6009330c58dac7d941d0c: baseline-arm64 2025-09-27 05:28:29,574 - lava_callback - ERROR - Error processing callback for node 68d6009330c58dac7d941d0c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:28:38,869 - lava_callback - INFO - Received callback for node 68d4da71a5c2c05277bd0b4c INFO: 172.21.0.1:33822 - "POST /node/68d4da71a5c2c05277bd0b4c HTTP/1.0" 202 Accepted 2025-09-27 05:28:38,876 - lava_callback - INFO - Starting async job submit for node 68d4da71a5c2c05277bd0b4c 2025-09-27 05:28:38,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:28:38,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4da71a5c2c05277bd0b4c HTTP/1.1" 200 None 2025-09-27 05:28:38,936 - lava_callback - DEBUG - Processing node 68d4da71a5c2c05277bd0b4c: ltp-syscalls-ipc 2025-09-27 05:28:39,847 - lava_callback - ERROR - Error processing callback for node 68d4da71a5c2c05277bd0b4c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:29:02,271 - lava_callback - INFO - Received callback for node 68d6009330c58dac7d941d0f INFO: 172.21.0.1:58214 - "POST /node/68d6009330c58dac7d941d0f HTTP/1.0" 202 Accepted 2025-09-27 05:29:02,277 - lava_callback - INFO - Starting async job submit for node 68d6009330c58dac7d941d0f 2025-09-27 05:29:02,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:29:02,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6009330c58dac7d941d0f HTTP/1.1" 200 None 2025-09-27 05:29:02,311 - lava_callback - DEBUG - Processing node 68d6009330c58dac7d941d0f: baseline-arm64 2025-09-27 05:29:02,607 - lava_callback - ERROR - Error processing callback for node 68d6009330c58dac7d941d0f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:29:05,902 - lava_callback - INFO - Received callback for node 68d6009730c58dac7d941d25 INFO: 172.21.0.1:58222 - "POST /node/68d6009730c58dac7d941d25 HTTP/1.0" 202 Accepted 2025-09-27 05:29:05,908 - lava_callback - INFO - Starting async job submit for node 68d6009730c58dac7d941d25 2025-09-27 05:29:05,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:29:05,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6009730c58dac7d941d25 HTTP/1.1" 200 None 2025-09-27 05:29:05,966 - lava_callback - DEBUG - Processing node 68d6009730c58dac7d941d25: baseline-arm64 2025-09-27 05:29:06,417 - lava_callback - ERROR - Error processing callback for node 68d6009730c58dac7d941d25: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54198 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:29:47,011 - lava_callback - INFO - Received callback for node 68d61a4330c58dac7d9421a1 INFO: 172.21.0.1:54200 - "POST /node/68d61a4330c58dac7d9421a1 HTTP/1.0" 202 Accepted 2025-09-27 05:29:47,016 - lava_callback - INFO - Starting async job submit for node 68d61a4330c58dac7d9421a1 2025-09-27 05:29:47,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:29:47,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61a4330c58dac7d9421a1 HTTP/1.1" 200 None 2025-09-27 05:29:47,050 - lava_callback - DEBUG - Processing node 68d61a4330c58dac7d9421a1: baseline-arm 2025-09-27 05:29:47,274 - lava_callback - ERROR - Error processing callback for node 68d61a4330c58dac7d9421a1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:29:50,243 - lava_callback - INFO - Received callback for node 68d6009830c58dac7d941d28 INFO: 172.21.0.1:37644 - "POST /node/68d6009830c58dac7d941d28 HTTP/1.0" 202 Accepted 2025-09-27 05:29:50,250 - lava_callback - INFO - Starting async job submit for node 68d6009830c58dac7d941d28 2025-09-27 05:29:50,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:29:50,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6009830c58dac7d941d28 HTTP/1.1" 200 None 2025-09-27 05:29:50,292 - lava_callback - DEBUG - Processing node 68d6009830c58dac7d941d28: baseline-arm64 2025-09-27 05:29:50,588 - lava_callback - ERROR - Error processing callback for node 68d6009830c58dac7d941d28: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:30:33,783 - lava_callback - INFO - Received callback for node 68d6009b30c58dac7d941d2e INFO: 172.21.0.1:35068 - "POST /node/68d6009b30c58dac7d941d2e HTTP/1.0" 202 Accepted 2025-09-27 05:30:33,790 - lava_callback - INFO - Starting async job submit for node 68d6009b30c58dac7d941d2e 2025-09-27 05:30:33,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:30:33,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6009b30c58dac7d941d2e HTTP/1.1" 200 None 2025-09-27 05:30:33,832 - lava_callback - DEBUG - Processing node 68d6009b30c58dac7d941d2e: baseline-arm64 2025-09-27 05:30:33,923 - lava_callback - INFO - Received callback for node 68d6009a30c58dac7d941d2b INFO: 172.21.0.1:35082 - "POST /node/68d6009a30c58dac7d941d2b HTTP/1.0" 202 Accepted 2025-09-27 05:30:33,950 - lava_callback - INFO - Starting async job submit for node 68d6009a30c58dac7d941d2b 2025-09-27 05:30:33,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:30:34,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6009a30c58dac7d941d2b HTTP/1.1" 200 None 2025-09-27 05:30:34,073 - lava_callback - DEBUG - Processing node 68d6009a30c58dac7d941d2b: baseline-arm64 2025-09-27 05:30:34,287 - lava_callback - ERROR - Error processing callback for node 68d6009b30c58dac7d941d2e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:30:34,485 - lava_callback - ERROR - Error processing callback for node 68d6009a30c58dac7d941d2b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55502 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:31:05,899 - lava_callback - INFO - Received callback for node 68d6009d30c58dac7d941d31 INFO: 172.21.0.1:52954 - "POST /node/68d6009d30c58dac7d941d31 HTTP/1.0" 202 Accepted 2025-09-27 05:31:05,905 - lava_callback - INFO - Starting async job submit for node 68d6009d30c58dac7d941d31 2025-09-27 05:31:05,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:31:05,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6009d30c58dac7d941d31 HTTP/1.1" 200 None 2025-09-27 05:31:05,939 - lava_callback - DEBUG - Processing node 68d6009d30c58dac7d941d31: baseline-arm64 2025-09-27 05:31:06,237 - lava_callback - ERROR - Error processing callback for node 68d6009d30c58dac7d941d31: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:31:45,418 - lava_callback - INFO - Received callback for node 68d6009e30c58dac7d941d34 INFO: 172.21.0.1:51252 - "POST /node/68d6009e30c58dac7d941d34 HTTP/1.0" 202 Accepted 2025-09-27 05:31:45,424 - lava_callback - INFO - Starting async job submit for node 68d6009e30c58dac7d941d34 2025-09-27 05:31:45,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:31:45,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6009e30c58dac7d941d34 HTTP/1.1" 200 None 2025-09-27 05:31:45,477 - lava_callback - DEBUG - Processing node 68d6009e30c58dac7d941d34: baseline-arm64 2025-09-27 05:31:45,788 - lava_callback - ERROR - Error processing callback for node 68d6009e30c58dac7d941d34: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:32:01,726 - lava_callback - INFO - Received callback for node 68d6010930c58dac7d941dfd INFO: 172.21.0.1:51354 - "POST /node/68d6010930c58dac7d941dfd HTTP/1.0" 202 Accepted 2025-09-27 05:32:01,731 - lava_callback - INFO - Starting async job submit for node 68d6010930c58dac7d941dfd 2025-09-27 05:32:01,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:32:01,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6010930c58dac7d941dfd HTTP/1.1" 200 None 2025-09-27 05:32:01,803 - lava_callback - DEBUG - Processing node 68d6010930c58dac7d941dfd: baseline-arm64 2025-09-27 05:32:02,100 - lava_callback - ERROR - Error processing callback for node 68d6010930c58dac7d941dfd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:32:12,191 - lava_callback - INFO - Received callback for node 68d61a4430c58dac7d9421a4 INFO: 172.21.0.1:45298 - "POST /node/68d61a4430c58dac7d9421a4 HTTP/1.0" 202 Accepted 2025-09-27 05:32:12,197 - lava_callback - INFO - Starting async job submit for node 68d61a4430c58dac7d9421a4 2025-09-27 05:32:12,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:32:12,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61a4430c58dac7d9421a4 HTTP/1.1" 200 None 2025-09-27 05:32:12,231 - lava_callback - DEBUG - Processing node 68d61a4430c58dac7d9421a4: baseline-arm 2025-09-27 05:32:12,457 - lava_callback - ERROR - Error processing callback for node 68d61a4430c58dac7d9421a4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:32:26,395 - lava_callback - INFO - Received callback for node 68d6010a30c58dac7d941e00 INFO: 172.21.0.1:49036 - "POST /node/68d6010a30c58dac7d941e00 HTTP/1.0" 202 Accepted 2025-09-27 05:32:26,401 - lava_callback - INFO - Starting async job submit for node 68d6010a30c58dac7d941e00 2025-09-27 05:32:26,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:32:26,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6010a30c58dac7d941e00 HTTP/1.1" 200 None 2025-09-27 05:32:26,435 - lava_callback - DEBUG - Processing node 68d6010a30c58dac7d941e00: baseline-arm64 INFO: 172.21.0.1:49044 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:32:26,751 - lava_callback - ERROR - Error processing callback for node 68d6010a30c58dac7d941e00: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:33:08,696 - lava_callback - INFO - Received callback for node 68d6010d30c58dac7d941e03 INFO: 172.21.0.1:40498 - "POST /node/68d6010d30c58dac7d941e03 HTTP/1.0" 202 Accepted 2025-09-27 05:33:08,702 - lava_callback - INFO - Starting async job submit for node 68d6010d30c58dac7d941e03 2025-09-27 05:33:08,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:33:08,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6010d30c58dac7d941e03 HTTP/1.1" 200 None 2025-09-27 05:33:08,743 - lava_callback - DEBUG - Processing node 68d6010d30c58dac7d941e03: baseline-arm64 2025-09-27 05:33:09,044 - lava_callback - ERROR - Error processing callback for node 68d6010d30c58dac7d941e03: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39994 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 05:33:16,044 - lava_callback - INFO - Received callback for node 68d53d21b70fb2a1e20f23d0 INFO: 172.21.0.1:39996 - "POST /node/68d53d21b70fb2a1e20f23d0 HTTP/1.0" 202 Accepted 2025-09-27 05:33:16,050 - lava_callback - INFO - Starting async job submit for node 68d53d21b70fb2a1e20f23d0 2025-09-27 05:33:16,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:33:16,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d53d21b70fb2a1e20f23d0 HTTP/1.1" 200 None 2025-09-27 05:33:16,103 - lava_callback - DEBUG - Processing node 68d53d21b70fb2a1e20f23d0: baseline-arm64-broonie 2025-09-27 05:33:16,433 - lava_callback - ERROR - Error processing callback for node 68d53d21b70fb2a1e20f23d0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:33:38,734 - lava_callback - INFO - Received callback for node 68d6010d30c58dac7d941e06 INFO: 172.21.0.1:46320 - "POST /node/68d6010d30c58dac7d941e06 HTTP/1.0" 202 Accepted 2025-09-27 05:33:38,740 - lava_callback - INFO - Starting async job submit for node 68d6010d30c58dac7d941e06 2025-09-27 05:33:38,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:33:38,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6010d30c58dac7d941e06 HTTP/1.1" 200 None 2025-09-27 05:33:38,794 - lava_callback - DEBUG - Processing node 68d6010d30c58dac7d941e06: baseline-arm64 2025-09-27 05:33:39,087 - lava_callback - ERROR - Error processing callback for node 68d6010d30c58dac7d941e06: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:33:45,081 - lava_callback - INFO - Received callback for node 68d6011030c58dac7d941e09 INFO: 172.21.0.1:56834 - "POST /node/68d6011030c58dac7d941e09 HTTP/1.0" 202 Accepted 2025-09-27 05:33:45,087 - lava_callback - INFO - Starting async job submit for node 68d6011030c58dac7d941e09 2025-09-27 05:33:45,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:33:45,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6011030c58dac7d941e09 HTTP/1.1" 200 None 2025-09-27 05:33:45,120 - lava_callback - DEBUG - Processing node 68d6011030c58dac7d941e09: baseline-arm64 2025-09-27 05:33:45,414 - lava_callback - ERROR - Error processing callback for node 68d6011030c58dac7d941e09: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:34:25,384 - lava_callback - INFO - Received callback for node 68d6011030c58dac7d941e0c INFO: 172.21.0.1:49964 - "POST /node/68d6011030c58dac7d941e0c HTTP/1.0" 202 Accepted 2025-09-27 05:34:25,390 - lava_callback - INFO - Starting async job submit for node 68d6011030c58dac7d941e0c 2025-09-27 05:34:25,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:34:25,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6011030c58dac7d941e0c HTTP/1.1" 200 None 2025-09-27 05:34:25,446 - lava_callback - DEBUG - Processing node 68d6011030c58dac7d941e0c: baseline-arm64 2025-09-27 05:34:25,756 - lava_callback - ERROR - Error processing callback for node 68d6011030c58dac7d941e0c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:34:31,468 - lava_callback - INFO - Received callback for node 68d61cc830c58dac7d942279 INFO: 172.21.0.1:46856 - "POST /node/68d61cc830c58dac7d942279 HTTP/1.0" 202 Accepted 2025-09-27 05:34:31,474 - lava_callback - INFO - Starting async job submit for node 68d61cc830c58dac7d942279 2025-09-27 05:34:31,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:34:31,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cc830c58dac7d942279 HTTP/1.1" 200 None 2025-09-27 05:34:31,507 - lava_callback - DEBUG - Processing node 68d61cc830c58dac7d942279: baseline-arm 2025-09-27 05:34:31,733 - lava_callback - ERROR - Error processing callback for node 68d61cc830c58dac7d942279: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57340 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:35:14,024 - lava_callback - INFO - Received callback for node 68d6011330c58dac7d941e0f INFO: 172.21.0.1:43484 - "POST /node/68d6011330c58dac7d941e0f HTTP/1.0" 202 Accepted 2025-09-27 05:35:14,030 - lava_callback - INFO - Starting async job submit for node 68d6011330c58dac7d941e0f 2025-09-27 05:35:14,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:35:14,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6011330c58dac7d941e0f HTTP/1.1" 200 None 2025-09-27 05:35:14,064 - lava_callback - DEBUG - Processing node 68d6011330c58dac7d941e0f: baseline-arm64 2025-09-27 05:35:14,353 - lava_callback - ERROR - Error processing callback for node 68d6011330c58dac7d941e0f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:35:17,569 - lava_callback - INFO - Received callback for node 68d6011330c58dac7d941e12 INFO: 172.21.0.1:43520 - "POST /node/68d6011330c58dac7d941e12 HTTP/1.0" 202 Accepted 2025-09-27 05:35:17,575 - lava_callback - INFO - Starting async job submit for node 68d6011330c58dac7d941e12 2025-09-27 05:35:17,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:35:17,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6011330c58dac7d941e12 HTTP/1.1" 200 None 2025-09-27 05:35:17,608 - lava_callback - DEBUG - Processing node 68d6011330c58dac7d941e12: baseline-arm64 2025-09-27 05:35:17,923 - lava_callback - ERROR - Error processing callback for node 68d6011330c58dac7d941e12: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:35:45,916 - lava_callback - INFO - Received callback for node 68d6189630c58dac7d942039 INFO: 172.21.0.1:35510 - "POST /node/68d6189630c58dac7d942039 HTTP/1.0" 202 Accepted 2025-09-27 05:35:45,922 - lava_callback - INFO - Starting async job submit for node 68d6189630c58dac7d942039 2025-09-27 05:35:45,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:35:45,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6189630c58dac7d942039 HTTP/1.1" 200 None 2025-09-27 05:35:45,964 - lava_callback - DEBUG - Processing node 68d6189630c58dac7d942039: baseline-arm64 2025-09-27 05:35:46,292 - lava_callback - ERROR - Error processing callback for node 68d6189630c58dac7d942039: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:35:59,466 - lava_callback - INFO - Received callback for node 68d4dbdfa5c2c05277bd0cae INFO: 172.21.0.1:41178 - "POST /node/68d4dbdfa5c2c05277bd0cae HTTP/1.0" 202 Accepted 2025-09-27 05:35:59,478 - lava_callback - INFO - Starting async job submit for node 68d4dbdfa5c2c05277bd0cae 2025-09-27 05:35:59,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:35:59,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbdfa5c2c05277bd0cae HTTP/1.1" 200 None 2025-09-27 05:35:59,873 - lava_callback - DEBUG - Processing node 68d4dbdfa5c2c05277bd0cae: ltp-controllers 2025-09-27 05:36:01,135 - lava_callback - INFO - Received callback for node 68d4dbe5a5c2c05277bd0cb7 INFO: 172.21.0.1:41182 - "POST /node/68d4dbe5a5c2c05277bd0cb7 HTTP/1.0" 202 Accepted 2025-09-27 05:36:01,162 - lava_callback - INFO - Starting async job submit for node 68d4dbe5a5c2c05277bd0cb7 2025-09-27 05:36:01,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:36:01,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbe5a5c2c05277bd0cb7 HTTP/1.1" 200 None 2025-09-27 05:36:01,544 - lava_callback - DEBUG - Processing node 68d4dbe5a5c2c05277bd0cb7: ltp-fs-bind 2025-09-27 05:36:02,674 - lava_callback - ERROR - Error processing callback for node 68d4dbe5a5c2c05277bd0cb7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:36:03,450 - lava_callback - ERROR - Error processing callback for node 68d4dbdfa5c2c05277bd0cae: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:36:26,766 - lava_callback - INFO - Received callback for node 68d6189930c58dac7d94203f INFO: 172.21.0.1:60890 - "POST /node/68d6189930c58dac7d94203f HTTP/1.0" 202 Accepted 2025-09-27 05:36:26,773 - lava_callback - INFO - Starting async job submit for node 68d6189930c58dac7d94203f 2025-09-27 05:36:26,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:36:26,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6189930c58dac7d94203f HTTP/1.1" 200 None 2025-09-27 05:36:26,806 - lava_callback - DEBUG - Processing node 68d6189930c58dac7d94203f: baseline-arm64 2025-09-27 05:36:27,134 - lava_callback - ERROR - Error processing callback for node 68d6189930c58dac7d94203f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:36:34,115 - lava_callback - INFO - Received callback for node 68d4daeda5c2c05277bd0b8d INFO: 172.21.0.1:52546 - "POST /node/68d4daeda5c2c05277bd0b8d HTTP/1.0" 202 Accepted 2025-09-27 05:36:34,121 - lava_callback - INFO - Starting async job submit for node 68d4daeda5c2c05277bd0b8d 2025-09-27 05:36:34,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:36:34,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4daeda5c2c05277bd0b8d HTTP/1.1" 200 None 2025-09-27 05:36:34,164 - lava_callback - DEBUG - Processing node 68d4daeda5c2c05277bd0b8d: baseline-arm 2025-09-27 05:36:34,449 - lava_callback - ERROR - Error processing callback for node 68d4daeda5c2c05277bd0b8d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:36:41,200 - lava_callback - INFO - Received callback for node 68d6189730c58dac7d94203c INFO: 172.21.0.1:40078 - "POST /node/68d6189730c58dac7d94203c HTTP/1.0" 202 Accepted 2025-09-27 05:36:41,206 - lava_callback - INFO - Starting async job submit for node 68d6189730c58dac7d94203c 2025-09-27 05:36:41,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:36:41,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6189730c58dac7d94203c HTTP/1.1" 200 None 2025-09-27 05:36:41,241 - lava_callback - DEBUG - Processing node 68d6189730c58dac7d94203c: baseline-arm64 2025-09-27 05:36:41,569 - lava_callback - ERROR - Error processing callback for node 68d6189730c58dac7d94203c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:36:53,311 - lava_callback - INFO - Received callback for node 68d61cc930c58dac7d942288 INFO: 172.21.0.1:37814 - "POST /node/68d61cc930c58dac7d942288 HTTP/1.0" 202 Accepted 2025-09-27 05:36:53,318 - lava_callback - INFO - Starting async job submit for node 68d61cc930c58dac7d942288 2025-09-27 05:36:53,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:36:53,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cc930c58dac7d942288 HTTP/1.1" 200 None 2025-09-27 05:36:53,351 - lava_callback - DEBUG - Processing node 68d61cc930c58dac7d942288: baseline-arm 2025-09-27 05:36:53,581 - lava_callback - ERROR - Error processing callback for node 68d61cc930c58dac7d942288: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:37:11,035 - lava_callback - INFO - Received callback for node 68d6189a30c58dac7d942042 INFO: 172.21.0.1:54842 - "POST /node/68d6189a30c58dac7d942042 HTTP/1.0" 202 Accepted 2025-09-27 05:37:11,041 - lava_callback - INFO - Starting async job submit for node 68d6189a30c58dac7d942042 2025-09-27 05:37:11,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:37:11,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6189a30c58dac7d942042 HTTP/1.1" 200 None 2025-09-27 05:37:11,074 - lava_callback - DEBUG - Processing node 68d6189a30c58dac7d942042: baseline-arm64 2025-09-27 05:37:11,425 - lava_callback - ERROR - Error processing callback for node 68d6189a30c58dac7d942042: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:37:46,645 - lava_callback - INFO - Received callback for node 68d618d030c58dac7d9420b5 INFO: 172.21.0.1:43708 - "POST /node/68d618d030c58dac7d9420b5 HTTP/1.0" 202 Accepted 2025-09-27 05:37:46,652 - lava_callback - INFO - Starting async job submit for node 68d618d030c58dac7d9420b5 2025-09-27 05:37:46,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:37:46,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d618d030c58dac7d9420b5 HTTP/1.1" 200 None 2025-09-27 05:37:46,685 - lava_callback - DEBUG - Processing node 68d618d030c58dac7d9420b5: baseline-arm64 2025-09-27 05:37:47,015 - lava_callback - ERROR - Error processing callback for node 68d618d030c58dac7d9420b5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47878 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 05:38:15,940 - lava_callback - INFO - Received callback for node 68d618d130c58dac7d9420b8 INFO: 172.21.0.1:47886 - "POST /node/68d618d130c58dac7d9420b8 HTTP/1.0" 202 Accepted 2025-09-27 05:38:15,946 - lava_callback - INFO - Starting async job submit for node 68d618d130c58dac7d9420b8 2025-09-27 05:38:15,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:38:15,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d618d130c58dac7d9420b8 HTTP/1.1" 200 None 2025-09-27 05:38:15,979 - lava_callback - DEBUG - Processing node 68d618d130c58dac7d9420b8: baseline-arm64 2025-09-27 05:38:16,331 - lava_callback - ERROR - Error processing callback for node 68d618d130c58dac7d9420b8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:38:26,458 - lava_callback - INFO - Received callback for node 68d618d330c58dac7d9420bb INFO: 172.21.0.1:36164 - "POST /node/68d618d330c58dac7d9420bb HTTP/1.0" 202 Accepted 2025-09-27 05:38:26,465 - lava_callback - INFO - Starting async job submit for node 68d618d330c58dac7d9420bb 2025-09-27 05:38:26,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:38:26,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d618d330c58dac7d9420bb HTTP/1.1" 200 None 2025-09-27 05:38:26,498 - lava_callback - DEBUG - Processing node 68d618d330c58dac7d9420bb: baseline-arm64 INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:38:26,836 - lava_callback - ERROR - Error processing callback for node 68d618d330c58dac7d9420bb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:39:06,778 - lava_callback - INFO - Received callback for node 68d618d430c58dac7d9420be INFO: 172.21.0.1:58828 - "POST /node/68d618d430c58dac7d9420be HTTP/1.0" 202 Accepted 2025-09-27 05:39:06,784 - lava_callback - INFO - Starting async job submit for node 68d618d430c58dac7d9420be 2025-09-27 05:39:06,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:39:06,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d618d430c58dac7d9420be HTTP/1.1" 200 None 2025-09-27 05:39:06,822 - lava_callback - DEBUG - Processing node 68d618d430c58dac7d9420be: baseline-arm64 2025-09-27 05:39:07,150 - lava_callback - ERROR - Error processing callback for node 68d618d430c58dac7d9420be: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:39:11,880 - lava_callback - INFO - Received callback for node 68d61ccb30c58dac7d942299 INFO: 172.21.0.1:57172 - "POST /node/68d61ccb30c58dac7d942299 HTTP/1.0" 202 Accepted 2025-09-27 05:39:11,886 - lava_callback - INFO - Starting async job submit for node 68d61ccb30c58dac7d942299 2025-09-27 05:39:11,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:39:11,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ccb30c58dac7d942299 HTTP/1.1" 200 None 2025-09-27 05:39:11,932 - lava_callback - DEBUG - Processing node 68d61ccb30c58dac7d942299: baseline-arm 2025-09-27 05:39:12,181 - lava_callback - ERROR - Error processing callback for node 68d61ccb30c58dac7d942299: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:39:35,702 - lava_callback - INFO - Received callback for node 68d61e8030c58dac7d942422 INFO: 172.21.0.1:48286 - "POST /node/68d61e8030c58dac7d942422 HTTP/1.0" 202 Accepted 2025-09-27 05:39:35,708 - lava_callback - INFO - Starting async job submit for node 68d61e8030c58dac7d942422 2025-09-27 05:39:35,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:39:35,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61e8030c58dac7d942422 HTTP/1.1" 200 None 2025-09-27 05:39:35,762 - lava_callback - DEBUG - Processing node 68d61e8030c58dac7d942422: baseline-arm64 2025-09-27 05:39:36,107 - lava_callback - ERROR - Error processing callback for node 68d61e8030c58dac7d942422: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:39:45,293 - lava_callback - INFO - Received callback for node 68d61e8130c58dac7d942425 INFO: 172.21.0.1:58378 - "POST /node/68d61e8130c58dac7d942425 HTTP/1.0" 202 Accepted 2025-09-27 05:39:45,302 - lava_callback - INFO - Starting async job submit for node 68d61e8130c58dac7d942425 2025-09-27 05:39:45,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:39:45,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61e8130c58dac7d942425 HTTP/1.1" 200 None 2025-09-27 05:39:45,339 - lava_callback - DEBUG - Processing node 68d61e8130c58dac7d942425: baseline-arm64 2025-09-27 05:39:45,701 - lava_callback - ERROR - Error processing callback for node 68d61e8130c58dac7d942425: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:40:19,163 - lava_callback - INFO - Received callback for node 68d4dbe6a5c2c05277bd0cba INFO: 172.21.0.1:37228 - "POST /node/68d4dbe6a5c2c05277bd0cba HTTP/1.0" 202 Accepted 2025-09-27 05:40:19,170 - lava_callback - INFO - Starting async job submit for node 68d4dbe6a5c2c05277bd0cba 2025-09-27 05:40:19,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:40:19,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbe6a5c2c05277bd0cba HTTP/1.1" 200 None 2025-09-27 05:40:19,231 - lava_callback - DEBUG - Processing node 68d4dbe6a5c2c05277bd0cba: ltp-fsx 2025-09-27 05:40:19,552 - lava_callback - ERROR - Error processing callback for node 68d4dbe6a5c2c05277bd0cba: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:40:20,796 - lava_callback - INFO - Received callback for node 68d4dbe8a5c2c05277bd0cbd INFO: 172.21.0.1:45638 - "POST /node/68d4dbe8a5c2c05277bd0cbd HTTP/1.0" 202 Accepted 2025-09-27 05:40:20,802 - lava_callback - INFO - Starting async job submit for node 68d4dbe8a5c2c05277bd0cbd 2025-09-27 05:40:20,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:40:20,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbe8a5c2c05277bd0cbd HTTP/1.1" 200 None 2025-09-27 05:40:20,852 - lava_callback - DEBUG - Processing node 68d4dbe8a5c2c05277bd0cbd: ltp-input 2025-09-27 05:40:21,274 - lava_callback - ERROR - Error processing callback for node 68d4dbe8a5c2c05277bd0cbd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:40:28,156 - lava_callback - INFO - Received callback for node 68d61e8330c58dac7d942428 INFO: 172.21.0.1:45662 - "POST /node/68d61e8330c58dac7d942428 HTTP/1.0" 202 Accepted 2025-09-27 05:40:28,162 - lava_callback - INFO - Starting async job submit for node 68d61e8330c58dac7d942428 2025-09-27 05:40:28,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:40:28,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61e8330c58dac7d942428 HTTP/1.1" 200 None 2025-09-27 05:40:28,196 - lava_callback - DEBUG - Processing node 68d61e8330c58dac7d942428: baseline-arm64 2025-09-27 05:40:28,529 - lava_callback - ERROR - Error processing callback for node 68d61e8330c58dac7d942428: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59534 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:40:55,840 - lava_callback - INFO - Received callback for node 68d61e8430c58dac7d94242b INFO: 172.21.0.1:44614 - "POST /node/68d61e8430c58dac7d94242b HTTP/1.0" 202 Accepted 2025-09-27 05:40:55,846 - lava_callback - INFO - Starting async job submit for node 68d61e8430c58dac7d94242b 2025-09-27 05:40:55,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:40:55,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61e8430c58dac7d94242b HTTP/1.1" 200 None 2025-09-27 05:40:55,879 - lava_callback - DEBUG - Processing node 68d61e8430c58dac7d94242b: baseline-arm64 2025-09-27 05:40:56,215 - lava_callback - ERROR - Error processing callback for node 68d61e8430c58dac7d94242b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:41:06,610 - lava_callback - INFO - Received callback for node 68d61ebb30c58dac7d9424a3 INFO: 172.21.0.1:38214 - "POST /node/68d61ebb30c58dac7d9424a3 HTTP/1.0" 202 Accepted 2025-09-27 05:41:06,617 - lava_callback - INFO - Starting async job submit for node 68d61ebb30c58dac7d9424a3 2025-09-27 05:41:06,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:41:06,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ebb30c58dac7d9424a3 HTTP/1.1" 200 None 2025-09-27 05:41:06,672 - lava_callback - DEBUG - Processing node 68d61ebb30c58dac7d9424a3: baseline-arm64 2025-09-27 05:41:07,022 - lava_callback - ERROR - Error processing callback for node 68d61ebb30c58dac7d9424a3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58130 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:41:46,770 - lava_callback - INFO - Received callback for node 68d61ebb30c58dac7d9424a6 INFO: 172.21.0.1:58138 - "POST /node/68d61ebb30c58dac7d9424a6 HTTP/1.0" 202 Accepted 2025-09-27 05:41:46,777 - lava_callback - INFO - Starting async job submit for node 68d61ebb30c58dac7d9424a6 2025-09-27 05:41:46,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:41:46,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ebb30c58dac7d9424a6 HTTP/1.1" 200 None 2025-09-27 05:41:46,810 - lava_callback - DEBUG - Processing node 68d61ebb30c58dac7d9424a6: baseline-arm64 2025-09-27 05:41:47,145 - lava_callback - ERROR - Error processing callback for node 68d61ebb30c58dac7d9424a6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:42:20,385 - lava_callback - INFO - Received callback for node 68d5566cb70fb2a1e20f26cc INFO: 172.21.0.1:46094 - "POST /node/68d5566cb70fb2a1e20f26cc HTTP/1.0" 202 Accepted 2025-09-27 05:42:20,391 - lava_callback - INFO - Starting async job submit for node 68d5566cb70fb2a1e20f26cc 2025-09-27 05:42:20,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:42:20,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5566cb70fb2a1e20f26cc HTTP/1.1" 200 None 2025-09-27 05:42:20,445 - lava_callback - DEBUG - Processing node 68d5566cb70fb2a1e20f26cc: baseline-arm64-broonie 2025-09-27 05:42:20,756 - lava_callback - ERROR - Error processing callback for node 68d5566cb70fb2a1e20f26cc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:42:26,471 - lava_callback - INFO - Received callback for node 68d61ebf30c58dac7d9424ac INFO: 172.21.0.1:46126 - "POST /node/68d61ebf30c58dac7d9424ac HTTP/1.0" 202 Accepted 2025-09-27 05:42:26,477 - lava_callback - INFO - Starting async job submit for node 68d61ebf30c58dac7d9424ac 2025-09-27 05:42:26,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:42:26,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ebf30c58dac7d9424ac HTTP/1.1" 200 None 2025-09-27 05:42:26,510 - lava_callback - DEBUG - Processing node 68d61ebf30c58dac7d9424ac: baseline-arm64 INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:42:26,841 - lava_callback - ERROR - Error processing callback for node 68d61ebf30c58dac7d9424ac: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:42:31,138 - lava_callback - INFO - Received callback for node 68d61ccc30c58dac7d94229c INFO: 172.21.0.1:53472 - "POST /node/68d61ccc30c58dac7d94229c HTTP/1.0" 202 Accepted 2025-09-27 05:42:31,144 - lava_callback - INFO - Starting async job submit for node 68d61ccc30c58dac7d94229c 2025-09-27 05:42:31,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:42:31,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ccc30c58dac7d94229c HTTP/1.1" 200 None 2025-09-27 05:42:31,181 - lava_callback - DEBUG - Processing node 68d61ccc30c58dac7d94229c: baseline-arm 2025-09-27 05:42:31,416 - lava_callback - ERROR - Error processing callback for node 68d61ccc30c58dac7d94229c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:42:45,007 - lava_callback - INFO - Received callback for node 68d61ebe30c58dac7d9424a9 INFO: 172.21.0.1:35926 - "POST /node/68d61ebe30c58dac7d9424a9 HTTP/1.0" 202 Accepted 2025-09-27 05:42:45,013 - lava_callback - INFO - Starting async job submit for node 68d61ebe30c58dac7d9424a9 2025-09-27 05:42:45,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:42:45,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ebe30c58dac7d9424a9 HTTP/1.1" 200 None 2025-09-27 05:42:45,048 - lava_callback - DEBUG - Processing node 68d61ebe30c58dac7d9424a9: baseline-arm64 2025-09-27 05:42:45,400 - lava_callback - ERROR - Error processing callback for node 68d61ebe30c58dac7d9424a9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:44:39,267 - lava_callback - INFO - Received callback for node 68d4dbeaa5c2c05277bd0cc0 INFO: 172.21.0.1:35626 - "POST /node/68d4dbeaa5c2c05277bd0cc0 HTTP/1.0" 202 Accepted 2025-09-27 05:44:39,274 - lava_callback - INFO - Starting async job submit for node 68d4dbeaa5c2c05277bd0cc0 2025-09-27 05:44:39,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:44:39,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbeaa5c2c05277bd0cc0 HTTP/1.1" 200 None 2025-09-27 05:44:39,313 - lava_callback - DEBUG - Processing node 68d4dbeaa5c2c05277bd0cc0: ltp-ipc 2025-09-27 05:44:39,626 - lava_callback - ERROR - Error processing callback for node 68d4dbeaa5c2c05277bd0cc0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 05:44:42,152 - lava_callback - INFO - Received callback for node 68d556fdb70fb2a1e20f278a INFO: 172.21.0.1:49322 - "POST /node/68d556fdb70fb2a1e20f278a HTTP/1.0" 202 Accepted 2025-09-27 05:44:42,157 - lava_callback - INFO - Starting async job submit for node 68d556fdb70fb2a1e20f278a 2025-09-27 05:44:42,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:44:42,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d556fdb70fb2a1e20f278a HTTP/1.1" 200 None 2025-09-27 05:44:42,191 - lava_callback - DEBUG - Processing node 68d556fdb70fb2a1e20f278a: baseline-arm64-broonie 2025-09-27 05:44:42,514 - lava_callback - ERROR - Error processing callback for node 68d556fdb70fb2a1e20f278a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:44:48,327 - lava_callback - INFO - Received callback for node 68d61ccd30c58dac7d94229f INFO: 172.21.0.1:49354 - "POST /node/68d61ccd30c58dac7d94229f HTTP/1.0" 202 Accepted 2025-09-27 05:44:48,333 - lava_callback - INFO - Starting async job submit for node 68d61ccd30c58dac7d94229f 2025-09-27 05:44:48,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:44:48,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ccd30c58dac7d94229f HTTP/1.1" 200 None 2025-09-27 05:44:48,375 - lava_callback - DEBUG - Processing node 68d61ccd30c58dac7d94229f: baseline-arm 2025-09-27 05:44:48,606 - lava_callback - ERROR - Error processing callback for node 68d61ccd30c58dac7d94229f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:47:08,002 - lava_callback - INFO - Received callback for node 68d61cce30c58dac7d9422a2 INFO: 172.21.0.1:40590 - "POST /node/68d61cce30c58dac7d9422a2 HTTP/1.0" 202 Accepted 2025-09-27 05:47:08,008 - lava_callback - INFO - Starting async job submit for node 68d61cce30c58dac7d9422a2 2025-09-27 05:47:08,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:47:08,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cce30c58dac7d9422a2 HTTP/1.1" 200 None 2025-09-27 05:47:08,041 - lava_callback - DEBUG - Processing node 68d61cce30c58dac7d9422a2: baseline-arm 2025-09-27 05:47:08,268 - lava_callback - ERROR - Error processing callback for node 68d61cce30c58dac7d9422a2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:47:39,549 - lava_callback - INFO - Received callback for node 68d56f792be2da4660699402 INFO: 172.21.0.1:54920 - "POST /node/68d56f792be2da4660699402 HTTP/1.0" 202 Accepted 2025-09-27 05:47:39,555 - lava_callback - INFO - Starting async job submit for node 68d56f792be2da4660699402 2025-09-27 05:47:39,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:47:39,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56f792be2da4660699402 HTTP/1.1" 200 None 2025-09-27 05:47:39,596 - lava_callback - DEBUG - Processing node 68d56f792be2da4660699402: baseline-arm64-broonie 2025-09-27 05:47:39,933 - lava_callback - ERROR - Error processing callback for node 68d56f792be2da4660699402: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34252 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:49:28,162 - lava_callback - INFO - Received callback for node 68d61ccf30c58dac7d9422a5 INFO: 172.21.0.1:34264 - "POST /node/68d61ccf30c58dac7d9422a5 HTTP/1.0" 202 Accepted 2025-09-27 05:49:28,168 - lava_callback - INFO - Starting async job submit for node 68d61ccf30c58dac7d9422a5 2025-09-27 05:49:28,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:49:28,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ccf30c58dac7d9422a5 HTTP/1.1" 200 None 2025-09-27 05:49:28,201 - lava_callback - DEBUG - Processing node 68d61ccf30c58dac7d9422a5: baseline-arm 2025-09-27 05:49:28,429 - lava_callback - ERROR - Error processing callback for node 68d61ccf30c58dac7d9422a5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:49:59,571 - lava_callback - INFO - Received callback for node 68d4dbeca5c2c05277bd0cc3 INFO: 172.21.0.1:39626 - "POST /node/68d4dbeca5c2c05277bd0cc3 HTTP/1.0" 202 Accepted 2025-09-27 05:49:59,578 - lava_callback - INFO - Starting async job submit for node 68d4dbeca5c2c05277bd0cc3 2025-09-27 05:49:59,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:49:59,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbeca5c2c05277bd0cc3 HTTP/1.1" 200 None 2025-09-27 05:49:59,631 - lava_callback - DEBUG - Processing node 68d4dbeca5c2c05277bd0cc3: ltp-pty 2025-09-27 05:50:00,036 - lava_callback - ERROR - Error processing callback for node 68d4dbeca5c2c05277bd0cc3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:50:17,767 - lava_callback - INFO - Received callback for node 68d4dbe1a5c2c05277bd0cb1 INFO: 172.21.0.1:48722 - "POST /node/68d4dbe1a5c2c05277bd0cb1 HTTP/1.0" 202 Accepted 2025-09-27 05:50:17,774 - lava_callback - INFO - Starting async job submit for node 68d4dbe1a5c2c05277bd0cb1 2025-09-27 05:50:17,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:50:17,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbe1a5c2c05277bd0cb1 HTTP/1.1" 200 None 2025-09-27 05:50:17,891 - lava_callback - DEBUG - Processing node 68d4dbe1a5c2c05277bd0cb1: ltp-cve 2025-09-27 05:50:18,604 - lava_callback - ERROR - Error processing callback for node 68d4dbe1a5c2c05277bd0cb1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:51:39,587 - lava_callback - INFO - Received callback for node 68d4dbeda5c2c05277bd0cc6 INFO: 172.21.0.1:36346 - "POST /node/68d4dbeda5c2c05277bd0cc6 HTTP/1.0" 202 Accepted 2025-09-27 05:51:39,594 - lava_callback - INFO - Starting async job submit for node 68d4dbeda5c2c05277bd0cc6 2025-09-27 05:51:39,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:51:39,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbeda5c2c05277bd0cc6 HTTP/1.1" 200 None 2025-09-27 05:51:39,640 - lava_callback - DEBUG - Processing node 68d4dbeda5c2c05277bd0cc6: ltp-sched 2025-09-27 05:51:40,104 - lava_callback - ERROR - Error processing callback for node 68d4dbeda5c2c05277bd0cc6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:53:00,820 - lava_callback - INFO - Received callback for node 68d4cd18a5c2c05277bd0733 INFO: 172.21.0.1:52826 - "POST /node/68d4cd18a5c2c05277bd0733 HTTP/1.0" 202 Accepted 2025-09-27 05:53:00,838 - lava_callback - INFO - Starting async job submit for node 68d4cd18a5c2c05277bd0733 2025-09-27 05:53:02,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:53:02,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4cd18a5c2c05277bd0733 HTTP/1.1" 200 None 2025-09-27 05:53:02,194 - lava_callback - DEBUG - Processing node 68d4cd18a5c2c05277bd0733: ltp-syscalls INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:53:09,130 - lava_callback - ERROR - Error processing callback for node 68d4cd18a5c2c05277bd0733: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:54:19,512 - lava_callback - INFO - Received callback for node 68d4db75a5c2c05277bd0c5d INFO: 172.21.0.1:35378 - "POST /node/68d4db75a5c2c05277bd0c5d HTTP/1.0" 202 Accepted 2025-09-27 05:54:19,517 - lava_callback - INFO - Starting async job submit for node 68d4db75a5c2c05277bd0c5d 2025-09-27 05:54:19,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:54:19,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db75a5c2c05277bd0c5d HTTP/1.1" 200 None 2025-09-27 05:54:19,556 - lava_callback - DEBUG - Processing node 68d4db75a5c2c05277bd0c5d: baseline-arm-broonie 2025-09-27 05:54:19,775 - lava_callback - ERROR - Error processing callback for node 68d4db75a5c2c05277bd0c5d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:55:59,673 - lava_callback - INFO - Received callback for node 68d4dbf4a5c2c05277bd0cd2 INFO: 172.21.0.1:50946 - "POST /node/68d4dbf4a5c2c05277bd0cd2 HTTP/1.0" 202 Accepted 2025-09-27 05:55:59,679 - lava_callback - INFO - Starting async job submit for node 68d4dbf4a5c2c05277bd0cd2 2025-09-27 05:55:59,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:55:59,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbf4a5c2c05277bd0cd2 HTTP/1.1" 200 None 2025-09-27 05:55:59,742 - lava_callback - DEBUG - Processing node 68d4dbf4a5c2c05277bd0cd2: ltp-timers 2025-09-27 05:56:00,071 - lava_callback - ERROR - Error processing callback for node 68d4dbf4a5c2c05277bd0cd2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:56:14,923 - lava_callback - INFO - Received callback for node 68d4daeda5c2c05277bd0b90 INFO: 172.21.0.1:39320 - "POST /node/68d4daeda5c2c05277bd0b90 HTTP/1.0" 202 Accepted 2025-09-27 05:56:14,929 - lava_callback - INFO - Starting async job submit for node 68d4daeda5c2c05277bd0b90 2025-09-27 05:56:14,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:56:14,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4daeda5c2c05277bd0b90 HTTP/1.1" 200 None 2025-09-27 05:56:14,972 - lava_callback - DEBUG - Processing node 68d4daeda5c2c05277bd0b90: baseline-arm INFO: 172.21.0.1:39336 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 05:56:15,236 - lava_callback - ERROR - Error processing callback for node 68d4daeda5c2c05277bd0b90: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:58:29,139 - lava_callback - INFO - Received callback for node 68d61cd030c58dac7d9422a8 INFO: 172.21.0.1:45438 - "POST /node/68d61cd030c58dac7d9422a8 HTTP/1.0" 202 Accepted 2025-09-27 05:58:29,145 - lava_callback - INFO - Starting async job submit for node 68d61cd030c58dac7d9422a8 2025-09-27 05:58:29,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:58:29,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cd030c58dac7d9422a8 HTTP/1.1" 200 None 2025-09-27 05:58:29,193 - lava_callback - DEBUG - Processing node 68d61cd030c58dac7d9422a8: baseline-arm 2025-09-27 05:58:29,610 - lava_callback - ERROR - Error processing callback for node 68d61cd030c58dac7d9422a8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK 2025-09-27 05:59:19,874 - lava_callback - INFO - Received callback for node 68d4dbefa5c2c05277bd0cc9 INFO: 172.21.0.1:33198 - "POST /node/68d4dbefa5c2c05277bd0cc9 HTTP/1.0" 202 Accepted 2025-09-27 05:59:19,882 - lava_callback - INFO - Starting async job submit for node 68d4dbefa5c2c05277bd0cc9 2025-09-27 05:59:19,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 05:59:19,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbefa5c2c05277bd0cc9 HTTP/1.1" 200 None 2025-09-27 05:59:19,933 - lava_callback - DEBUG - Processing node 68d4dbefa5c2c05277bd0cc9: ltp-smoketest 2025-09-27 05:59:20,323 - lava_callback - ERROR - Error processing callback for node 68d4dbefa5c2c05277bd0cc9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:00:20,395 - lava_callback - INFO - Received callback for node 68d4dbf6a5c2c05277bd0cd5 INFO: 172.21.0.1:51484 - "POST /node/68d4dbf6a5c2c05277bd0cd5 HTTP/1.0" 202 Accepted 2025-09-27 06:00:20,402 - lava_callback - INFO - Starting async job submit for node 68d4dbf6a5c2c05277bd0cd5 2025-09-27 06:00:20,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:00:20,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbf6a5c2c05277bd0cd5 HTTP/1.1" 200 None 2025-09-27 06:00:20,448 - lava_callback - DEBUG - Processing node 68d4dbf6a5c2c05277bd0cd5: ltp-watchqueue 2025-09-27 06:00:20,847 - lava_callback - ERROR - Error processing callback for node 68d4dbf6a5c2c05277bd0cd5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:00:53,492 - lava_callback - INFO - Received callback for node 68d61cea30c58dac7d9422f3 INFO: 172.21.0.1:54040 - "POST /node/68d61cea30c58dac7d9422f3 HTTP/1.0" 202 Accepted 2025-09-27 06:00:53,498 - lava_callback - INFO - Starting async job submit for node 68d61cea30c58dac7d9422f3 2025-09-27 06:00:53,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:00:53,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cea30c58dac7d9422f3 HTTP/1.1" 200 None 2025-09-27 06:00:53,549 - lava_callback - DEBUG - Processing node 68d61cea30c58dac7d9422f3: baseline-arm 2025-09-27 06:00:53,775 - lava_callback - ERROR - Error processing callback for node 68d61cea30c58dac7d9422f3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:02:20,893 - lava_callback - INFO - Received callback for node 68d61f8430c58dac7d9425be INFO: 172.21.0.1:56396 - "POST /node/68d61f8430c58dac7d9425be HTTP/1.0" 202 Accepted 2025-09-27 06:02:20,901 - lava_callback - INFO - Starting async job submit for node 68d61f8430c58dac7d9425be 2025-09-27 06:02:20,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:02:20,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61f8430c58dac7d9425be HTTP/1.1" 200 None 2025-09-27 06:02:20,955 - lava_callback - DEBUG - Processing node 68d61f8430c58dac7d9425be: baseline-arm64 2025-09-27 06:02:21,857 - lava_callback - ERROR - Error processing callback for node 68d61f8430c58dac7d9425be: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:02:40,501 - lava_callback - INFO - Received callback for node 68d4daefa5c2c05277bd0b96 INFO: 172.21.0.1:52744 - "POST /node/68d4daefa5c2c05277bd0b96 HTTP/1.0" 202 Accepted 2025-09-27 06:02:40,507 - lava_callback - INFO - Starting async job submit for node 68d4daefa5c2c05277bd0b96 2025-09-27 06:02:40,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:02:40,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4daefa5c2c05277bd0b96 HTTP/1.1" 200 None 2025-09-27 06:02:40,658 - lava_callback - DEBUG - Processing node 68d4daefa5c2c05277bd0b96: baseline-arm 2025-09-27 06:02:40,658 - lava_callback - ERROR - Error processing callback for node 68d4daefa5c2c05277bd0b96: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:02:41,150 - lava_callback - INFO - Received callback for node 68d4daf1a5c2c05277bd0b99 INFO: 172.21.0.1:52746 - "POST /node/68d4daf1a5c2c05277bd0b99 HTTP/1.0" 202 Accepted 2025-09-27 06:02:41,155 - lava_callback - INFO - Starting async job submit for node 68d4daf1a5c2c05277bd0b99 2025-09-27 06:02:41,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:02:41,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4daf1a5c2c05277bd0b99 HTTP/1.1" 200 None 2025-09-27 06:02:41,168 - lava_callback - DEBUG - Processing node 68d4daf1a5c2c05277bd0b99: baseline-arm 2025-09-27 06:02:41,169 - lava_callback - ERROR - Error processing callback for node 68d4daf1a5c2c05277bd0b99: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:02:41,806 - lava_callback - INFO - Received callback for node 68d4daf1a5c2c05277bd0b9c INFO: 172.21.0.1:52750 - "POST /node/68d4daf1a5c2c05277bd0b9c HTTP/1.0" 202 Accepted 2025-09-27 06:02:41,811 - lava_callback - INFO - Starting async job submit for node 68d4daf1a5c2c05277bd0b9c 2025-09-27 06:02:41,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:02:41,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4daf1a5c2c05277bd0b9c HTTP/1.1" 200 None 2025-09-27 06:02:41,851 - lava_callback - DEBUG - Processing node 68d4daf1a5c2c05277bd0b9c: baseline-arm 2025-09-27 06:02:41,852 - lava_callback - ERROR - Error processing callback for node 68d4daf1a5c2c05277bd0b9c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:02:42,491 - lava_callback - INFO - Received callback for node 68d4daf3a5c2c05277bd0b9f INFO: 172.21.0.1:52762 - "POST /node/68d4daf3a5c2c05277bd0b9f HTTP/1.0" 202 Accepted 2025-09-27 06:02:42,497 - lava_callback - INFO - Starting async job submit for node 68d4daf3a5c2c05277bd0b9f 2025-09-27 06:02:42,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:02:42,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4daf3a5c2c05277bd0b9f HTTP/1.1" 200 None 2025-09-27 06:02:42,532 - lava_callback - DEBUG - Processing node 68d4daf3a5c2c05277bd0b9f: baseline-arm 2025-09-27 06:02:42,532 - lava_callback - ERROR - Error processing callback for node 68d4daf3a5c2c05277bd0b9f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:02:43,141 - lava_callback - INFO - Received callback for node 68d4daf3a5c2c05277bd0ba2 INFO: 172.21.0.1:52770 - "POST /node/68d4daf3a5c2c05277bd0ba2 HTTP/1.0" 202 Accepted 2025-09-27 06:02:43,147 - lava_callback - INFO - Starting async job submit for node 68d4daf3a5c2c05277bd0ba2 2025-09-27 06:02:43,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:02:43,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4daf3a5c2c05277bd0ba2 HTTP/1.1" 200 None 2025-09-27 06:02:43,161 - lava_callback - DEBUG - Processing node 68d4daf3a5c2c05277bd0ba2: baseline-arm 2025-09-27 06:02:43,161 - lava_callback - ERROR - Error processing callback for node 68d4daf3a5c2c05277bd0ba2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:03:01,664 - lava_callback - INFO - Received callback for node 68d61f8430c58dac7d9425c1 INFO: 172.21.0.1:34344 - "POST /node/68d61f8430c58dac7d9425c1 HTTP/1.0" 202 Accepted 2025-09-27 06:03:01,673 - lava_callback - INFO - Starting async job submit for node 68d61f8430c58dac7d9425c1 2025-09-27 06:03:01,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:03:01,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61f8430c58dac7d9425c1 HTTP/1.1" 200 None 2025-09-27 06:03:01,732 - lava_callback - DEBUG - Processing node 68d61f8430c58dac7d9425c1: baseline-arm64 2025-09-27 06:03:02,784 - lava_callback - ERROR - Error processing callback for node 68d61f8430c58dac7d9425c1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:03:13,443 - lava_callback - INFO - Received callback for node 68d61ceb30c58dac7d9422f6 INFO: 172.21.0.1:36594 - "POST /node/68d61ceb30c58dac7d9422f6 HTTP/1.0" 202 Accepted 2025-09-27 06:03:13,449 - lava_callback - INFO - Starting async job submit for node 68d61ceb30c58dac7d9422f6 2025-09-27 06:03:13,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:03:13,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ceb30c58dac7d9422f6 HTTP/1.1" 200 None 2025-09-27 06:03:13,482 - lava_callback - DEBUG - Processing node 68d61ceb30c58dac7d9422f6: baseline-arm 2025-09-27 06:03:13,711 - lava_callback - ERROR - Error processing callback for node 68d61ceb30c58dac7d9422f6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:03:30,321 - lava_callback - INFO - Received callback for node 68d61f8b30c58dac7d9425c4 INFO: 172.21.0.1:57578 - "POST /node/68d61f8b30c58dac7d9425c4 HTTP/1.0" 202 Accepted 2025-09-27 06:03:30,328 - lava_callback - INFO - Starting async job submit for node 68d61f8b30c58dac7d9425c4 2025-09-27 06:03:30,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:03:30,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61f8b30c58dac7d9425c4 HTTP/1.1" 200 None 2025-09-27 06:03:30,386 - lava_callback - DEBUG - Processing node 68d61f8b30c58dac7d9425c4: baseline-arm64 2025-09-27 06:03:31,279 - lava_callback - ERROR - Error processing callback for node 68d61f8b30c58dac7d9425c4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:03:40,471 - lava_callback - INFO - Received callback for node 68d4db3ba5c2c05277bd0c02 INFO: 172.21.0.1:53094 - "POST /node/68d4db3ba5c2c05277bd0c02 HTTP/1.0" 202 Accepted 2025-09-27 06:03:40,477 - lava_callback - INFO - Starting async job submit for node 68d4db3ba5c2c05277bd0c02 2025-09-27 06:03:40,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:03:40,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db3ba5c2c05277bd0c02 HTTP/1.1" 200 None 2025-09-27 06:03:40,491 - lava_callback - DEBUG - Processing node 68d4db3ba5c2c05277bd0c02: baseline-arm 2025-09-27 06:03:40,491 - lava_callback - ERROR - Error processing callback for node 68d4db3ba5c2c05277bd0c02: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:04:00,870 - lava_callback - INFO - Received callback for node 68d4db3ba5c2c05277bd0c05 INFO: 172.21.0.1:53576 - "POST /node/68d4db3ba5c2c05277bd0c05 HTTP/1.0" 202 Accepted 2025-09-27 06:04:00,875 - lava_callback - INFO - Starting async job submit for node 68d4db3ba5c2c05277bd0c05 2025-09-27 06:04:00,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:00,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db3ba5c2c05277bd0c05 HTTP/1.1" 200 None 2025-09-27 06:04:00,907 - lava_callback - DEBUG - Processing node 68d4db3ba5c2c05277bd0c05: baseline-arm 2025-09-27 06:04:00,907 - lava_callback - ERROR - Error processing callback for node 68d4db3ba5c2c05277bd0c05: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:04:01,561 - lava_callback - INFO - Received callback for node 68d4db3da5c2c05277bd0c08 INFO: 172.21.0.1:53586 - "POST /node/68d4db3da5c2c05277bd0c08 HTTP/1.0" 202 Accepted 2025-09-27 06:04:01,570 - lava_callback - INFO - Starting async job submit for node 68d4db3da5c2c05277bd0c08 2025-09-27 06:04:01,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:01,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db3da5c2c05277bd0c08 HTTP/1.1" 200 None 2025-09-27 06:04:01,603 - lava_callback - DEBUG - Processing node 68d4db3da5c2c05277bd0c08: baseline-arm 2025-09-27 06:04:01,604 - lava_callback - ERROR - Error processing callback for node 68d4db3da5c2c05277bd0c08: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:04:02,291 - lava_callback - INFO - Received callback for node 68d4db3da5c2c05277bd0c0b INFO: 172.21.0.1:53600 - "POST /node/68d4db3da5c2c05277bd0c0b HTTP/1.0" 202 Accepted 2025-09-27 06:04:02,297 - lava_callback - INFO - Starting async job submit for node 68d4db3da5c2c05277bd0c0b 2025-09-27 06:04:02,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:02,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db3da5c2c05277bd0c0b HTTP/1.1" 200 None 2025-09-27 06:04:02,312 - lava_callback - DEBUG - Processing node 68d4db3da5c2c05277bd0c0b: baseline-arm 2025-09-27 06:04:02,312 - lava_callback - ERROR - Error processing callback for node 68d4db3da5c2c05277bd0c0b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:04:02,968 - lava_callback - INFO - Received callback for node 68d4db3fa5c2c05277bd0c0e INFO: 172.21.0.1:53616 - "POST /node/68d4db3fa5c2c05277bd0c0e HTTP/1.0" 202 Accepted 2025-09-27 06:04:02,974 - lava_callback - INFO - Starting async job submit for node 68d4db3fa5c2c05277bd0c0e 2025-09-27 06:04:02,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:03,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db3fa5c2c05277bd0c0e HTTP/1.1" 200 None 2025-09-27 06:04:03,008 - lava_callback - DEBUG - Processing node 68d4db3fa5c2c05277bd0c0e: baseline-arm 2025-09-27 06:04:03,008 - lava_callback - ERROR - Error processing callback for node 68d4db3fa5c2c05277bd0c0e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:04:03,649 - lava_callback - INFO - Received callback for node 68d4db40a5c2c05277bd0c11 INFO: 172.21.0.1:53626 - "POST /node/68d4db40a5c2c05277bd0c11 HTTP/1.0" 202 Accepted 2025-09-27 06:04:03,655 - lava_callback - INFO - Starting async job submit for node 68d4db40a5c2c05277bd0c11 2025-09-27 06:04:03,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:03,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db40a5c2c05277bd0c11 HTTP/1.1" 200 None 2025-09-27 06:04:03,668 - lava_callback - DEBUG - Processing node 68d4db40a5c2c05277bd0c11: baseline-arm 2025-09-27 06:04:03,668 - lava_callback - ERROR - Error processing callback for node 68d4db40a5c2c05277bd0c11: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:04:04,341 - lava_callback - INFO - Received callback for node 68d4db41a5c2c05277bd0c14 INFO: 172.21.0.1:53638 - "POST /node/68d4db41a5c2c05277bd0c14 HTTP/1.0" 202 Accepted 2025-09-27 06:04:04,346 - lava_callback - INFO - Starting async job submit for node 68d4db41a5c2c05277bd0c14 2025-09-27 06:04:04,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:04,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db41a5c2c05277bd0c14 HTTP/1.1" 200 None 2025-09-27 06:04:04,362 - lava_callback - DEBUG - Processing node 68d4db41a5c2c05277bd0c14: baseline-arm 2025-09-27 06:04:04,363 - lava_callback - ERROR - Error processing callback for node 68d4db41a5c2c05277bd0c14: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:04:05,013 - lava_callback - INFO - Received callback for node 68d4db42a5c2c05277bd0c17 INFO: 172.21.0.1:53644 - "POST /node/68d4db42a5c2c05277bd0c17 HTTP/1.0" 202 Accepted 2025-09-27 06:04:05,018 - lava_callback - INFO - Starting async job submit for node 68d4db42a5c2c05277bd0c17 2025-09-27 06:04:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:05,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4db42a5c2c05277bd0c17 HTTP/1.1" 200 None 2025-09-27 06:04:05,032 - lava_callback - DEBUG - Processing node 68d4db42a5c2c05277bd0c17: baseline-arm 2025-09-27 06:04:05,032 - lava_callback - ERROR - Error processing callback for node 68d4db42a5c2c05277bd0c17: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44780 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:04:39,946 - lava_callback - INFO - Received callback for node 68d4e09ba5c2c05277bd0d4a INFO: 172.21.0.1:50802 - "POST /node/68d4e09ba5c2c05277bd0d4a HTTP/1.0" 202 Accepted 2025-09-27 06:04:39,952 - lava_callback - INFO - Starting async job submit for node 68d4e09ba5c2c05277bd0d4a 2025-09-27 06:04:39,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:40,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e09ba5c2c05277bd0d4a HTTP/1.1" 200 None 2025-09-27 06:04:40,017 - lava_callback - DEBUG - Processing node 68d4e09ba5c2c05277bd0d4a: baseline-arm-broonie 2025-09-27 06:04:40,247 - lava_callback - ERROR - Error processing callback for node 68d4e09ba5c2c05277bd0d4a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 06:04:41,551 - lava_callback - INFO - Received callback for node 68d4e0aca5c2c05277bd0d65 INFO: 172.21.0.1:50808 - "POST /node/68d4e0aca5c2c05277bd0d65 HTTP/1.0" 202 Accepted 2025-09-27 06:04:41,558 - lava_callback - INFO - Starting async job submit for node 68d4e0aca5c2c05277bd0d65 2025-09-27 06:04:41,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:04:41,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0aca5c2c05277bd0d65 HTTP/1.1" 200 None 2025-09-27 06:04:41,599 - lava_callback - DEBUG - Processing node 68d4e0aca5c2c05277bd0d65: ltp-cap-bounds 2025-09-27 06:04:41,952 - lava_callback - ERROR - Error processing callback for node 68d4e0aca5c2c05277bd0d65: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:05:24,754 - lava_callback - INFO - Received callback for node 68d4dba0a5c2c05277bd0c77 INFO: 172.21.0.1:53594 - "POST /node/68d4dba0a5c2c05277bd0c77 HTTP/1.0" 202 Accepted 2025-09-27 06:05:24,759 - lava_callback - INFO - Starting async job submit for node 68d4dba0a5c2c05277bd0c77 2025-09-27 06:05:24,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:05:24,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dba0a5c2c05277bd0c77 HTTP/1.1" 200 None 2025-09-27 06:05:24,777 - lava_callback - DEBUG - Processing node 68d4dba0a5c2c05277bd0c77: baseline-arm-clabbe 2025-09-27 06:05:24,777 - lava_callback - ERROR - Error processing callback for node 68d4dba0a5c2c05277bd0c77: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:05:33,229 - lava_callback - INFO - Received callback for node 68d61cec30c58dac7d9422f9 INFO: 172.21.0.1:33652 - "POST /node/68d61cec30c58dac7d9422f9 HTTP/1.0" 202 Accepted 2025-09-27 06:05:33,235 - lava_callback - INFO - Starting async job submit for node 68d61cec30c58dac7d9422f9 2025-09-27 06:05:33,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:05:33,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cec30c58dac7d9422f9 HTTP/1.1" 200 None 2025-09-27 06:05:33,291 - lava_callback - DEBUG - Processing node 68d61cec30c58dac7d9422f9: baseline-arm 2025-09-27 06:05:33,518 - lava_callback - ERROR - Error processing callback for node 68d61cec30c58dac7d9422f9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:05:44,675 - lava_callback - INFO - Received callback for node 68d4dba5a5c2c05277bd0c7d INFO: 172.21.0.1:51852 - "POST /node/68d4dba5a5c2c05277bd0c7d HTTP/1.0" 202 Accepted 2025-09-27 06:05:44,680 - lava_callback - INFO - Starting async job submit for node 68d4dba5a5c2c05277bd0c7d 2025-09-27 06:05:44,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:05:44,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dba5a5c2c05277bd0c7d HTTP/1.1" 200 None 2025-09-27 06:05:44,693 - lava_callback - DEBUG - Processing node 68d4dba5a5c2c05277bd0c7d: baseline-arm-clabbe 2025-09-27 06:05:44,693 - lava_callback - ERROR - Error processing callback for node 68d4dba5a5c2c05277bd0c7d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:05:45,333 - lava_callback - INFO - Received callback for node 68d4dbaea5c2c05277bd0c8c INFO: 172.21.0.1:51868 - "POST /node/68d4dbaea5c2c05277bd0c8c HTTP/1.0" 202 Accepted 2025-09-27 06:05:45,338 - lava_callback - INFO - Starting async job submit for node 68d4dbaea5c2c05277bd0c8c 2025-09-27 06:05:45,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:05:45,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbaea5c2c05277bd0c8c HTTP/1.1" 200 None 2025-09-27 06:05:45,351 - lava_callback - DEBUG - Processing node 68d4dbaea5c2c05277bd0c8c: baseline-arm-clabbe 2025-09-27 06:05:45,352 - lava_callback - ERROR - Error processing callback for node 68d4dbaea5c2c05277bd0c8c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:05:45,987 - lava_callback - INFO - Received callback for node 68d4dba6a5c2c05277bd0c80 INFO: 172.21.0.1:51880 - "POST /node/68d4dba6a5c2c05277bd0c80 HTTP/1.0" 202 Accepted 2025-09-27 06:05:45,992 - lava_callback - INFO - Starting async job submit for node 68d4dba6a5c2c05277bd0c80 2025-09-27 06:05:45,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:05:46,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dba6a5c2c05277bd0c80 HTTP/1.1" 200 None 2025-09-27 06:05:46,006 - lava_callback - DEBUG - Processing node 68d4dba6a5c2c05277bd0c80: baseline-arm-clabbe 2025-09-27 06:05:46,006 - lava_callback - ERROR - Error processing callback for node 68d4dba6a5c2c05277bd0c80: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:07:52,610 - lava_callback - INFO - Received callback for node 68d61ced30c58dac7d9422fc INFO: 172.21.0.1:38224 - "POST /node/68d61ced30c58dac7d9422fc HTTP/1.0" 202 Accepted 2025-09-27 06:07:52,616 - lava_callback - INFO - Starting async job submit for node 68d61ced30c58dac7d9422fc 2025-09-27 06:07:52,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:07:52,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61ced30c58dac7d9422fc HTTP/1.1" 200 None 2025-09-27 06:07:52,657 - lava_callback - DEBUG - Processing node 68d61ced30c58dac7d9422fc: baseline-arm 2025-09-27 06:07:52,883 - lava_callback - ERROR - Error processing callback for node 68d61ced30c58dac7d9422fc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:09:37,746 - lava_callback - INFO - Received callback for node 68d4dbf2a5c2c05277bd0ccf INFO: 172.21.0.1:59288 - "POST /node/68d4dbf2a5c2c05277bd0ccf HTTP/1.0" 202 Accepted 2025-09-27 06:09:37,754 - lava_callback - INFO - Starting async job submit for node 68d4dbf2a5c2c05277bd0ccf 2025-09-27 06:09:37,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:09:37,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbf2a5c2c05277bd0ccf HTTP/1.1" 200 None 2025-09-27 06:09:37,825 - lava_callback - DEBUG - Processing node 68d4dbf2a5c2c05277bd0ccf: ltp-syscalls-ipc 2025-09-27 06:09:38,545 - lava_callback - ERROR - Error processing callback for node 68d4dbf2a5c2c05277bd0ccf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 06:10:15,250 - lava_callback - INFO - Received callback for node 68d61cee30c58dac7d9422ff INFO: 172.21.0.1:43646 - "POST /node/68d61cee30c58dac7d9422ff HTTP/1.0" 202 Accepted 2025-09-27 06:10:15,256 - lava_callback - INFO - Starting async job submit for node 68d61cee30c58dac7d9422ff 2025-09-27 06:10:15,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:10:15,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cee30c58dac7d9422ff HTTP/1.1" 200 None 2025-09-27 06:10:15,314 - lava_callback - DEBUG - Processing node 68d61cee30c58dac7d9422ff: baseline-arm 2025-09-27 06:10:15,571 - lava_callback - ERROR - Error processing callback for node 68d61cee30c58dac7d9422ff: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:10:40,509 - lava_callback - INFO - Received callback for node 68d4e0aea5c2c05277bd0d68 INFO: 172.21.0.1:59866 - "POST /node/68d4e0aea5c2c05277bd0d68 HTTP/1.0" 202 Accepted 2025-09-27 06:10:40,516 - lava_callback - INFO - Starting async job submit for node 68d4e0aea5c2c05277bd0d68 2025-09-27 06:10:40,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:10:40,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0aea5c2c05277bd0d68 HTTP/1.1" 200 None 2025-09-27 06:10:40,634 - lava_callback - DEBUG - Processing node 68d4e0aea5c2c05277bd0d68: ltp-containers 2025-09-27 06:10:41,434 - lava_callback - ERROR - Error processing callback for node 68d4e0aea5c2c05277bd0d68: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:12:34,047 - lava_callback - INFO - Received callback for node 68d61cef30c58dac7d942302 INFO: 172.21.0.1:39148 - "POST /node/68d61cef30c58dac7d942302 HTTP/1.0" 202 Accepted 2025-09-27 06:12:34,053 - lava_callback - INFO - Starting async job submit for node 68d61cef30c58dac7d942302 2025-09-27 06:12:34,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:12:34,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cef30c58dac7d942302 HTTP/1.1" 200 None 2025-09-27 06:12:34,108 - lava_callback - DEBUG - Processing node 68d61cef30c58dac7d942302: baseline-arm 2025-09-27 06:12:34,338 - lava_callback - ERROR - Error processing callback for node 68d61cef30c58dac7d942302: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:14:53,974 - lava_callback - INFO - Received callback for node 68d61cf030c58dac7d942305 INFO: 172.21.0.1:34170 - "POST /node/68d61cf030c58dac7d942305 HTTP/1.0" 202 Accepted 2025-09-27 06:14:53,980 - lava_callback - INFO - Starting async job submit for node 68d61cf030c58dac7d942305 2025-09-27 06:14:54,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:14:54,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cf030c58dac7d942305 HTTP/1.1" 200 None 2025-09-27 06:14:54,017 - lava_callback - DEBUG - Processing node 68d61cf030c58dac7d942305: baseline-arm 2025-09-27 06:14:54,249 - lava_callback - ERROR - Error processing callback for node 68d61cf030c58dac7d942305: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:15:56,064 - lava_callback - INFO - Received callback for node 68d4daefa5c2c05277bd0b93 INFO: 172.21.0.1:53480 - "POST /node/68d4daefa5c2c05277bd0b93 HTTP/1.0" 202 Accepted 2025-09-27 06:15:56,070 - lava_callback - INFO - Starting async job submit for node 68d4daefa5c2c05277bd0b93 2025-09-27 06:15:56,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:15:56,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4daefa5c2c05277bd0b93 HTTP/1.1" 200 None 2025-09-27 06:15:56,112 - lava_callback - DEBUG - Processing node 68d4daefa5c2c05277bd0b93: baseline-arm 2025-09-27 06:15:56,395 - lava_callback - ERROR - Error processing callback for node 68d4daefa5c2c05277bd0b93: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:17:13,023 - lava_callback - INFO - Received callback for node 68d61cf130c58dac7d942308 INFO: 172.21.0.1:56940 - "POST /node/68d61cf130c58dac7d942308 HTTP/1.0" 202 Accepted 2025-09-27 06:17:13,029 - lava_callback - INFO - Starting async job submit for node 68d61cf130c58dac7d942308 2025-09-27 06:17:13,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:17:13,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61cf130c58dac7d942308 HTTP/1.1" 200 None 2025-09-27 06:17:13,071 - lava_callback - DEBUG - Processing node 68d61cf130c58dac7d942308: baseline-arm 2025-09-27 06:17:13,293 - lava_callback - ERROR - Error processing callback for node 68d61cf130c58dac7d942308: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:18:00,670 - lava_callback - INFO - Received callback for node 68d4e0b5a5c2c05277bd0d74 INFO: 172.21.0.1:47300 - "POST /node/68d4e0b5a5c2c05277bd0d74 HTTP/1.0" 202 Accepted 2025-09-27 06:18:00,678 - lava_callback - INFO - Starting async job submit for node 68d4e0b5a5c2c05277bd0d74 2025-09-27 06:18:00,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:18:00,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0b5a5c2c05277bd0d74 HTTP/1.1" 200 None 2025-09-27 06:18:00,811 - lava_callback - DEBUG - Processing node 68d4e0b5a5c2c05277bd0d74: ltp-fs-bind 2025-09-27 06:18:01,346 - lava_callback - ERROR - Error processing callback for node 68d4e0b5a5c2c05277bd0d74: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:19:33,922 - lava_callback - INFO - Received callback for node 68d63378c1bc82a30b37ad00 INFO: 172.21.0.1:35962 - "POST /node/68d63378c1bc82a30b37ad00 HTTP/1.0" 202 Accepted 2025-09-27 06:19:33,928 - lava_callback - INFO - Starting async job submit for node 68d63378c1bc82a30b37ad00 2025-09-27 06:19:33,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:19:33,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63378c1bc82a30b37ad00 HTTP/1.1" 200 None 2025-09-27 06:19:33,965 - lava_callback - DEBUG - Processing node 68d63378c1bc82a30b37ad00: baseline-arm 2025-09-27 06:19:34,189 - lava_callback - ERROR - Error processing callback for node 68d63378c1bc82a30b37ad00: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:21:21,213 - lava_callback - INFO - Received callback for node 68d4e0b0a5c2c05277bd0d6b INFO: 172.21.0.1:36630 - "POST /node/68d4e0b0a5c2c05277bd0d6b HTTP/1.0" 202 Accepted 2025-09-27 06:21:21,224 - lava_callback - INFO - Starting async job submit for node 68d4e0b0a5c2c05277bd0d6b 2025-09-27 06:21:21,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:21:21,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0b0a5c2c05277bd0d6b HTTP/1.1" 200 None 2025-09-27 06:21:21,628 - lava_callback - DEBUG - Processing node 68d4e0b0a5c2c05277bd0d6b: ltp-controllers 2025-09-27 06:21:24,390 - lava_callback - ERROR - Error processing callback for node 68d4e0b0a5c2c05277bd0d6b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:21:48,741 - lava_callback - INFO - Received callback for node 68d6337ac1bc82a30b37ad0c INFO: 172.21.0.1:45622 - "POST /node/68d6337ac1bc82a30b37ad0c HTTP/1.0" 202 Accepted 2025-09-27 06:21:48,746 - lava_callback - INFO - Starting async job submit for node 68d6337ac1bc82a30b37ad0c 2025-09-27 06:21:48,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:21:48,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6337ac1bc82a30b37ad0c HTTP/1.1" 200 None 2025-09-27 06:21:48,777 - lava_callback - DEBUG - Processing node 68d6337ac1bc82a30b37ad0c: baseline-arm 2025-09-27 06:21:49,003 - lava_callback - ERROR - Error processing callback for node 68d6337ac1bc82a30b37ad0c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:22:20,789 - lava_callback - INFO - Received callback for node 68d4e0b7a5c2c05277bd0d77 INFO: 172.21.0.1:39420 - "POST /node/68d4e0b7a5c2c05277bd0d77 HTTP/1.0" 202 Accepted 2025-09-27 06:22:20,795 - lava_callback - INFO - Starting async job submit for node 68d4e0b7a5c2c05277bd0d77 2025-09-27 06:22:20,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:22:20,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0b7a5c2c05277bd0d77 HTTP/1.1" 200 None 2025-09-27 06:22:20,834 - lava_callback - DEBUG - Processing node 68d4e0b7a5c2c05277bd0d77: ltp-fsx 2025-09-27 06:22:21,187 - lava_callback - ERROR - Error processing callback for node 68d4e0b7a5c2c05277bd0d77: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:23:01,918 - lava_callback - INFO - Received callback for node 68d61f8c30c58dac7d9425c7 INFO: 172.21.0.1:56508 - "POST /node/68d61f8c30c58dac7d9425c7 HTTP/1.0" 202 Accepted 2025-09-27 06:23:01,925 - lava_callback - INFO - Starting async job submit for node 68d61f8c30c58dac7d9425c7 2025-09-27 06:23:01,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:23:01,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61f8c30c58dac7d9425c7 HTTP/1.1" 200 None 2025-09-27 06:23:01,998 - lava_callback - DEBUG - Processing node 68d61f8c30c58dac7d9425c7: baseline-arm64 2025-09-27 06:23:02,886 - lava_callback - ERROR - Error processing callback for node 68d61f8c30c58dac7d9425c7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:23:41,958 - lava_callback - INFO - Received callback for node 68d61f8e30c58dac7d9425ca INFO: 172.21.0.1:42556 - "POST /node/68d61f8e30c58dac7d9425ca HTTP/1.0" 202 Accepted 2025-09-27 06:23:41,965 - lava_callback - INFO - Starting async job submit for node 68d61f8e30c58dac7d9425ca 2025-09-27 06:23:42,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:23:42,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61f8e30c58dac7d9425ca HTTP/1.1" 200 None 2025-09-27 06:23:42,019 - lava_callback - DEBUG - Processing node 68d61f8e30c58dac7d9425ca: baseline-arm64 2025-09-27 06:23:42,892 - lava_callback - ERROR - Error processing callback for node 68d61f8e30c58dac7d9425ca: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:24:10,820 - lava_callback - INFO - Received callback for node 68d61f8f30c58dac7d9425cd INFO: 172.21.0.1:42306 - "POST /node/68d61f8f30c58dac7d9425cd HTTP/1.0" 202 Accepted 2025-09-27 06:24:10,827 - lava_callback - INFO - Starting async job submit for node 68d61f8f30c58dac7d9425cd 2025-09-27 06:24:10,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:24:10,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61f8f30c58dac7d9425cd HTTP/1.1" 200 None 2025-09-27 06:24:10,880 - lava_callback - DEBUG - Processing node 68d61f8f30c58dac7d9425cd: baseline-arm64 2025-09-27 06:24:11,744 - lava_callback - ERROR - Error processing callback for node 68d61f8f30c58dac7d9425cd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:24:17,793 - lava_callback - INFO - Received callback for node 68d63395c1bc82a30b37addc INFO: 172.21.0.1:42340 - "POST /node/68d63395c1bc82a30b37addc HTTP/1.0" 202 Accepted 2025-09-27 06:24:17,799 - lava_callback - INFO - Starting async job submit for node 68d63395c1bc82a30b37addc 2025-09-27 06:24:17,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:24:17,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63395c1bc82a30b37addc HTTP/1.1" 200 None 2025-09-27 06:24:17,853 - lava_callback - DEBUG - Processing node 68d63395c1bc82a30b37addc: baseline-arm 2025-09-27 06:24:18,082 - lava_callback - ERROR - Error processing callback for node 68d63395c1bc82a30b37addc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:25:40,986 - lava_callback - INFO - Received callback for node 68d4e0b8a5c2c05277bd0d7a INFO: 172.21.0.1:58712 - "POST /node/68d4e0b8a5c2c05277bd0d7a HTTP/1.0" 202 Accepted 2025-09-27 06:25:40,993 - lava_callback - INFO - Starting async job submit for node 68d4e0b8a5c2c05277bd0d7a 2025-09-27 06:25:41,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:25:41,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0b8a5c2c05277bd0d7a HTTP/1.1" 200 None 2025-09-27 06:25:41,049 - lava_callback - DEBUG - Processing node 68d4e0b8a5c2c05277bd0d7a: ltp-input 2025-09-27 06:25:41,439 - lava_callback - ERROR - Error processing callback for node 68d4e0b8a5c2c05277bd0d7a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 06:25:41,564 - lava_callback - INFO - Received callback for node 68d4e058a5c2c05277bd0d0b INFO: 172.21.0.1:58728 - "POST /node/68d4e058a5c2c05277bd0d0b HTTP/1.0" 202 Accepted 2025-09-27 06:25:41,569 - lava_callback - INFO - Starting async job submit for node 68d4e058a5c2c05277bd0d0b 2025-09-27 06:25:41,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:25:41,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e058a5c2c05277bd0d0b HTTP/1.1" 200 None 2025-09-27 06:25:41,582 - lava_callback - DEBUG - Processing node 68d4e058a5c2c05277bd0d0b: baseline-arm 2025-09-27 06:25:41,583 - lava_callback - ERROR - Error processing callback for node 68d4e058a5c2c05277bd0d0b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:26:34,718 - lava_callback - INFO - Received callback for node 68d63396c1bc82a30b37ade0 INFO: 172.21.0.1:42874 - "POST /node/68d63396c1bc82a30b37ade0 HTTP/1.0" 202 Accepted 2025-09-27 06:26:34,724 - lava_callback - INFO - Starting async job submit for node 68d63396c1bc82a30b37ade0 2025-09-27 06:26:34,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:26:34,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63396c1bc82a30b37ade0 HTTP/1.1" 200 None 2025-09-27 06:26:34,758 - lava_callback - DEBUG - Processing node 68d63396c1bc82a30b37ade0: baseline-arm 2025-09-27 06:26:34,984 - lava_callback - ERROR - Error processing callback for node 68d63396c1bc82a30b37ade0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42888 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:26:40,920 - lava_callback - INFO - Received callback for node 68d4e0baa5c2c05277bd0d7d INFO: 172.21.0.1:42738 - "POST /node/68d4e0baa5c2c05277bd0d7d HTTP/1.0" 202 Accepted 2025-09-27 06:26:40,926 - lava_callback - INFO - Starting async job submit for node 68d4e0baa5c2c05277bd0d7d 2025-09-27 06:26:40,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:26:40,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0baa5c2c05277bd0d7d HTTP/1.1" 200 None 2025-09-27 06:26:40,979 - lava_callback - DEBUG - Processing node 68d4e0baa5c2c05277bd0d7d: ltp-ipc 2025-09-27 06:26:41,330 - lava_callback - ERROR - Error processing callback for node 68d4e0baa5c2c05277bd0d7d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 06:26:41,460 - lava_callback - INFO - Received callback for node 68d4e097a5c2c05277bd0d3e INFO: 172.21.0.1:42746 - "POST /node/68d4e097a5c2c05277bd0d3e HTTP/1.0" 202 Accepted 2025-09-27 06:26:41,465 - lava_callback - INFO - Starting async job submit for node 68d4e097a5c2c05277bd0d3e 2025-09-27 06:26:41,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:26:41,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e097a5c2c05277bd0d3e HTTP/1.1" 200 None 2025-09-27 06:26:41,479 - lava_callback - DEBUG - Processing node 68d4e097a5c2c05277bd0d3e: baseline-arm 2025-09-27 06:26:41,479 - lava_callback - ERROR - Error processing callback for node 68d4e097a5c2c05277bd0d3e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:26:42,125 - lava_callback - INFO - Received callback for node 68d4e098a5c2c05277bd0d41 INFO: 172.21.0.1:42756 - "POST /node/68d4e098a5c2c05277bd0d41 HTTP/1.0" 202 Accepted 2025-09-27 06:26:42,130 - lava_callback - INFO - Starting async job submit for node 68d4e098a5c2c05277bd0d41 2025-09-27 06:26:42,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:26:42,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e098a5c2c05277bd0d41 HTTP/1.1" 200 None 2025-09-27 06:26:42,144 - lava_callback - DEBUG - Processing node 68d4e098a5c2c05277bd0d41: baseline-arm 2025-09-27 06:26:42,144 - lava_callback - ERROR - Error processing callback for node 68d4e098a5c2c05277bd0d41: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:26:50,627 - lava_callback - INFO - Received callback for node 68d4e0a1a5c2c05277bd0d53 INFO: 172.21.0.1:46992 - "POST /node/68d4e0a1a5c2c05277bd0d53 HTTP/1.0" 202 Accepted 2025-09-27 06:26:50,632 - lava_callback - INFO - Starting async job submit for node 68d4e0a1a5c2c05277bd0d53 2025-09-27 06:26:50,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:26:50,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0a1a5c2c05277bd0d53 HTTP/1.1" 200 None 2025-09-27 06:26:50,667 - lava_callback - DEBUG - Processing node 68d4e0a1a5c2c05277bd0d53: baseline-arm-broonie 2025-09-27 06:26:50,667 - lava_callback - ERROR - Error processing callback for node 68d4e0a1a5c2c05277bd0d53: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:27:30,463 - lava_callback - INFO - Received callback for node 68d4e0c0a5c2c05277bd0d86 INFO: 172.21.0.1:44220 - "POST /node/68d4e0c0a5c2c05277bd0d86 HTTP/1.0" 202 Accepted 2025-09-27 06:27:30,469 - lava_callback - INFO - Starting async job submit for node 68d4e0c0a5c2c05277bd0d86 2025-09-27 06:27:30,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:27:30,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0c0a5c2c05277bd0d86 HTTP/1.1" 200 None 2025-09-27 06:27:30,501 - lava_callback - DEBUG - Processing node 68d4e0c0a5c2c05277bd0d86: ltp-smoketest 2025-09-27 06:27:30,501 - lava_callback - ERROR - Error processing callback for node 68d4e0c0a5c2c05277bd0d86: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:27:31,301 - lava_callback - INFO - Received callback for node 68d4e0c1a5c2c05277bd0d89 INFO: 172.21.0.1:44234 - "POST /node/68d4e0c1a5c2c05277bd0d89 HTTP/1.0" 202 Accepted 2025-09-27 06:27:31,306 - lava_callback - INFO - Starting async job submit for node 68d4e0c1a5c2c05277bd0d89 2025-09-27 06:27:31,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:27:31,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0c1a5c2c05277bd0d89 HTTP/1.1" 200 None 2025-09-27 06:27:31,337 - lava_callback - DEBUG - Processing node 68d4e0c1a5c2c05277bd0d89: ltp-syscalls 2025-09-27 06:27:31,338 - lava_callback - ERROR - Error processing callback for node 68d4e0c1a5c2c05277bd0d89: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:27:32,093 - lava_callback - INFO - Received callback for node 68d4e0c3a5c2c05277bd0d8c INFO: 172.21.0.1:44240 - "POST /node/68d4e0c3a5c2c05277bd0d8c HTTP/1.0" 202 Accepted 2025-09-27 06:27:32,099 - lava_callback - INFO - Starting async job submit for node 68d4e0c3a5c2c05277bd0d8c 2025-09-27 06:27:32,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:27:32,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0c3a5c2c05277bd0d8c HTTP/1.1" 200 None 2025-09-27 06:27:32,113 - lava_callback - DEBUG - Processing node 68d4e0c3a5c2c05277bd0d8c: ltp-syscalls-ipc 2025-09-27 06:27:32,113 - lava_callback - ERROR - Error processing callback for node 68d4e0c3a5c2c05277bd0d8c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:27:32,949 - lava_callback - INFO - Received callback for node 68d4e0c5a5c2c05277bd0d8f INFO: 172.21.0.1:44256 - "POST /node/68d4e0c5a5c2c05277bd0d8f HTTP/1.0" 202 Accepted 2025-09-27 06:27:32,955 - lava_callback - INFO - Starting async job submit for node 68d4e0c5a5c2c05277bd0d8f 2025-09-27 06:27:32,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:27:32,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0c5a5c2c05277bd0d8f HTTP/1.1" 200 None 2025-09-27 06:27:32,974 - lava_callback - DEBUG - Processing node 68d4e0c5a5c2c05277bd0d8f: ltp-timers 2025-09-27 06:27:32,974 - lava_callback - ERROR - Error processing callback for node 68d4e0c5a5c2c05277bd0d8f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:27:33,703 - lava_callback - INFO - Received callback for node 68d4e0c6a5c2c05277bd0d92 INFO: 172.21.0.1:44272 - "POST /node/68d4e0c6a5c2c05277bd0d92 HTTP/1.0" 202 Accepted 2025-09-27 06:27:33,709 - lava_callback - INFO - Starting async job submit for node 68d4e0c6a5c2c05277bd0d92 2025-09-27 06:27:33,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:27:33,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0c6a5c2c05277bd0d92 HTTP/1.1" 200 None 2025-09-27 06:27:33,723 - lava_callback - DEBUG - Processing node 68d4e0c6a5c2c05277bd0d92: ltp-watchqueue 2025-09-27 06:27:33,723 - lava_callback - ERROR - Error processing callback for node 68d4e0c6a5c2c05277bd0d92: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49812 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:28:41,225 - lava_callback - INFO - Received callback for node 68d4e112a5c2c05277bd0dc5 INFO: 172.21.0.1:57990 - "POST /node/68d4e112a5c2c05277bd0dc5 HTTP/1.0" 202 Accepted 2025-09-27 06:28:41,230 - lava_callback - INFO - Starting async job submit for node 68d4e112a5c2c05277bd0dc5 2025-09-27 06:28:41,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:28:41,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e112a5c2c05277bd0dc5 HTTP/1.1" 200 None 2025-09-27 06:28:41,244 - lava_callback - DEBUG - Processing node 68d4e112a5c2c05277bd0dc5: baseline-arm 2025-09-27 06:28:41,244 - lava_callback - ERROR - Error processing callback for node 68d4e112a5c2c05277bd0dc5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:28:41,879 - lava_callback - INFO - Received callback for node 68d4e113a5c2c05277bd0dc8 INFO: 172.21.0.1:57998 - "POST /node/68d4e113a5c2c05277bd0dc8 HTTP/1.0" 202 Accepted 2025-09-27 06:28:41,885 - lava_callback - INFO - Starting async job submit for node 68d4e113a5c2c05277bd0dc8 2025-09-27 06:28:41,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:28:41,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e113a5c2c05277bd0dc8 HTTP/1.1" 200 None 2025-09-27 06:28:41,898 - lava_callback - DEBUG - Processing node 68d4e113a5c2c05277bd0dc8: baseline-arm 2025-09-27 06:28:41,898 - lava_callback - ERROR - Error processing callback for node 68d4e113a5c2c05277bd0dc8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:28:42,504 - lava_callback - INFO - Received callback for node 68d4e114a5c2c05277bd0dcb INFO: 172.21.0.1:58010 - "POST /node/68d4e114a5c2c05277bd0dcb HTTP/1.0" 202 Accepted 2025-09-27 06:28:42,509 - lava_callback - INFO - Starting async job submit for node 68d4e114a5c2c05277bd0dcb 2025-09-27 06:28:42,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:28:42,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e114a5c2c05277bd0dcb HTTP/1.1" 200 None 2025-09-27 06:28:42,532 - lava_callback - DEBUG - Processing node 68d4e114a5c2c05277bd0dcb: baseline-arm 2025-09-27 06:28:42,532 - lava_callback - ERROR - Error processing callback for node 68d4e114a5c2c05277bd0dcb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:28:43,208 - lava_callback - INFO - Received callback for node 68d4e115a5c2c05277bd0dce INFO: 172.21.0.1:58014 - "POST /node/68d4e115a5c2c05277bd0dce HTTP/1.0" 202 Accepted 2025-09-27 06:28:43,213 - lava_callback - INFO - Starting async job submit for node 68d4e115a5c2c05277bd0dce 2025-09-27 06:28:43,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:28:43,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e115a5c2c05277bd0dce HTTP/1.1" 200 None 2025-09-27 06:28:43,244 - lava_callback - DEBUG - Processing node 68d4e115a5c2c05277bd0dce: baseline-arm 2025-09-27 06:28:43,244 - lava_callback - ERROR - Error processing callback for node 68d4e115a5c2c05277bd0dce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58032 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:28:54,376 - lava_callback - INFO - Received callback for node 68d6339ec1bc82a30b37adf5 INFO: 172.21.0.1:39206 - "POST /node/68d6339ec1bc82a30b37adf5 HTTP/1.0" 202 Accepted 2025-09-27 06:28:54,382 - lava_callback - INFO - Starting async job submit for node 68d6339ec1bc82a30b37adf5 2025-09-27 06:28:54,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:28:54,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6339ec1bc82a30b37adf5 HTTP/1.1" 200 None 2025-09-27 06:28:54,550 - lava_callback - DEBUG - Processing node 68d6339ec1bc82a30b37adf5: baseline-arm 2025-09-27 06:28:54,776 - lava_callback - ERROR - Error processing callback for node 68d6339ec1bc82a30b37adf5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39220 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:29:02,215 - lava_callback - INFO - Received callback for node 68d4e123a5c2c05277bd0df5 INFO: 172.21.0.1:46580 - "POST /node/68d4e123a5c2c05277bd0df5 HTTP/1.0" 202 Accepted 2025-09-27 06:29:02,221 - lava_callback - INFO - Starting async job submit for node 68d4e123a5c2c05277bd0df5 2025-09-27 06:29:02,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:02,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e123a5c2c05277bd0df5 HTTP/1.1" 200 None 2025-09-27 06:29:02,238 - lava_callback - DEBUG - Processing node 68d4e123a5c2c05277bd0df5: baseline-arm 2025-09-27 06:29:02,239 - lava_callback - ERROR - Error processing callback for node 68d4e123a5c2c05277bd0df5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:02,911 - lava_callback - INFO - Received callback for node 68d4e124a5c2c05277bd0df8 INFO: 172.21.0.1:46590 - "POST /node/68d4e124a5c2c05277bd0df8 HTTP/1.0" 202 Accepted 2025-09-27 06:29:02,917 - lava_callback - INFO - Starting async job submit for node 68d4e124a5c2c05277bd0df8 2025-09-27 06:29:02,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:02,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e124a5c2c05277bd0df8 HTTP/1.1" 200 None 2025-09-27 06:29:02,951 - lava_callback - DEBUG - Processing node 68d4e124a5c2c05277bd0df8: baseline-arm 2025-09-27 06:29:02,951 - lava_callback - ERROR - Error processing callback for node 68d4e124a5c2c05277bd0df8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:03,650 - lava_callback - INFO - Received callback for node 68d4e125a5c2c05277bd0dfb INFO: 172.21.0.1:46602 - "POST /node/68d4e125a5c2c05277bd0dfb HTTP/1.0" 202 Accepted 2025-09-27 06:29:03,656 - lava_callback - INFO - Starting async job submit for node 68d4e125a5c2c05277bd0dfb 2025-09-27 06:29:03,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:03,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e125a5c2c05277bd0dfb HTTP/1.1" 200 None 2025-09-27 06:29:03,670 - lava_callback - DEBUG - Processing node 68d4e125a5c2c05277bd0dfb: baseline-arm 2025-09-27 06:29:03,670 - lava_callback - ERROR - Error processing callback for node 68d4e125a5c2c05277bd0dfb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:04,358 - lava_callback - INFO - Received callback for node 68d4e126a5c2c05277bd0dfe INFO: 172.21.0.1:46612 - "POST /node/68d4e126a5c2c05277bd0dfe HTTP/1.0" 202 Accepted 2025-09-27 06:29:04,363 - lava_callback - INFO - Starting async job submit for node 68d4e126a5c2c05277bd0dfe 2025-09-27 06:29:04,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:04,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e126a5c2c05277bd0dfe HTTP/1.1" 200 None 2025-09-27 06:29:04,397 - lava_callback - DEBUG - Processing node 68d4e126a5c2c05277bd0dfe: baseline-arm 2025-09-27 06:29:04,397 - lava_callback - ERROR - Error processing callback for node 68d4e126a5c2c05277bd0dfe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:29:10,605 - lava_callback - INFO - Received callback for node 68d4e12ca5c2c05277bd0e0d INFO: 172.21.0.1:58656 - "POST /node/68d4e12ca5c2c05277bd0e0d HTTP/1.0" 202 Accepted 2025-09-27 06:29:10,610 - lava_callback - INFO - Starting async job submit for node 68d4e12ca5c2c05277bd0e0d 2025-09-27 06:29:10,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:10,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e12ca5c2c05277bd0e0d HTTP/1.1" 200 None 2025-09-27 06:29:10,629 - lava_callback - DEBUG - Processing node 68d4e12ca5c2c05277bd0e0d: baseline-arm-broonie 2025-09-27 06:29:10,629 - lava_callback - ERROR - Error processing callback for node 68d4e12ca5c2c05277bd0e0d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:11,400 - lava_callback - INFO - Received callback for node 68d4e131a5c2c05277bd0e16 INFO: 172.21.0.1:58668 - "POST /node/68d4e131a5c2c05277bd0e16 HTTP/1.0" 202 Accepted 2025-09-27 06:29:11,407 - lava_callback - INFO - Starting async job submit for node 68d4e131a5c2c05277bd0e16 2025-09-27 06:29:11,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:11,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e131a5c2c05277bd0e16 HTTP/1.1" 200 None 2025-09-27 06:29:11,426 - lava_callback - DEBUG - Processing node 68d4e131a5c2c05277bd0e16: baseline-arm-broonie 2025-09-27 06:29:11,426 - lava_callback - ERROR - Error processing callback for node 68d4e131a5c2c05277bd0e16: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:58682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:29:50,472 - lava_callback - INFO - Received callback for node 68d4e14aa5c2c05277bd0e39 INFO: 172.21.0.1:42290 - "POST /node/68d4e14aa5c2c05277bd0e39 HTTP/1.0" 202 Accepted 2025-09-27 06:29:50,477 - lava_callback - INFO - Starting async job submit for node 68d4e14aa5c2c05277bd0e39 2025-09-27 06:29:50,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:50,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e14aa5c2c05277bd0e39 HTTP/1.1" 200 None 2025-09-27 06:29:50,491 - lava_callback - DEBUG - Processing node 68d4e14aa5c2c05277bd0e39: ltp-cap-bounds 2025-09-27 06:29:50,491 - lava_callback - ERROR - Error processing callback for node 68d4e14aa5c2c05277bd0e39: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:51,239 - lava_callback - INFO - Received callback for node 68d4e14ba5c2c05277bd0e3c INFO: 172.21.0.1:42292 - "POST /node/68d4e14ba5c2c05277bd0e3c HTTP/1.0" 202 Accepted 2025-09-27 06:29:51,245 - lava_callback - INFO - Starting async job submit for node 68d4e14ba5c2c05277bd0e3c 2025-09-27 06:29:51,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:51,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e14ba5c2c05277bd0e3c HTTP/1.1" 200 None 2025-09-27 06:29:51,282 - lava_callback - DEBUG - Processing node 68d4e14ba5c2c05277bd0e3c: ltp-containers 2025-09-27 06:29:51,282 - lava_callback - ERROR - Error processing callback for node 68d4e14ba5c2c05277bd0e3c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:52,042 - lava_callback - INFO - Received callback for node 68d4e14da5c2c05277bd0e3f INFO: 172.21.0.1:42304 - "POST /node/68d4e14da5c2c05277bd0e3f HTTP/1.0" 202 Accepted 2025-09-27 06:29:52,048 - lava_callback - INFO - Starting async job submit for node 68d4e14da5c2c05277bd0e3f 2025-09-27 06:29:52,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:52,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e14da5c2c05277bd0e3f HTTP/1.1" 200 None 2025-09-27 06:29:52,083 - lava_callback - DEBUG - Processing node 68d4e14da5c2c05277bd0e3f: ltp-controllers 2025-09-27 06:29:52,083 - lava_callback - ERROR - Error processing callback for node 68d4e14da5c2c05277bd0e3f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:52,778 - lava_callback - INFO - Received callback for node 68d4e14fa5c2c05277bd0e42 INFO: 172.21.0.1:42308 - "POST /node/68d4e14fa5c2c05277bd0e42 HTTP/1.0" 202 Accepted 2025-09-27 06:29:52,784 - lava_callback - INFO - Starting async job submit for node 68d4e14fa5c2c05277bd0e42 2025-09-27 06:29:52,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:52,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e14fa5c2c05277bd0e42 HTTP/1.1" 200 None 2025-09-27 06:29:52,798 - lava_callback - DEBUG - Processing node 68d4e14fa5c2c05277bd0e42: ltp-cve 2025-09-27 06:29:52,798 - lava_callback - ERROR - Error processing callback for node 68d4e14fa5c2c05277bd0e42: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:53,512 - lava_callback - INFO - Received callback for node 68d4e153a5c2c05277bd0e48 INFO: 172.21.0.1:42314 - "POST /node/68d4e153a5c2c05277bd0e48 HTTP/1.0" 202 Accepted 2025-09-27 06:29:53,518 - lava_callback - INFO - Starting async job submit for node 68d4e153a5c2c05277bd0e48 2025-09-27 06:29:53,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:53,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e153a5c2c05277bd0e48 HTTP/1.1" 200 None 2025-09-27 06:29:53,537 - lava_callback - DEBUG - Processing node 68d4e153a5c2c05277bd0e48: ltp-fs-bind 2025-09-27 06:29:53,537 - lava_callback - ERROR - Error processing callback for node 68d4e153a5c2c05277bd0e48: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:54,335 - lava_callback - INFO - Received callback for node 68d4e154a5c2c05277bd0e4b INFO: 172.21.0.1:42318 - "POST /node/68d4e154a5c2c05277bd0e4b HTTP/1.0" 202 Accepted 2025-09-27 06:29:54,341 - lava_callback - INFO - Starting async job submit for node 68d4e154a5c2c05277bd0e4b 2025-09-27 06:29:54,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:54,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e154a5c2c05277bd0e4b HTTP/1.1" 200 None 2025-09-27 06:29:54,355 - lava_callback - DEBUG - Processing node 68d4e154a5c2c05277bd0e4b: ltp-fsx 2025-09-27 06:29:54,355 - lava_callback - ERROR - Error processing callback for node 68d4e154a5c2c05277bd0e4b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:55,106 - lava_callback - INFO - Received callback for node 68d4e156a5c2c05277bd0e4e INFO: 172.21.0.1:42328 - "POST /node/68d4e156a5c2c05277bd0e4e HTTP/1.0" 202 Accepted 2025-09-27 06:29:55,111 - lava_callback - INFO - Starting async job submit for node 68d4e156a5c2c05277bd0e4e 2025-09-27 06:29:55,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:55,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e156a5c2c05277bd0e4e HTTP/1.1" 200 None 2025-09-27 06:29:55,125 - lava_callback - DEBUG - Processing node 68d4e156a5c2c05277bd0e4e: ltp-input 2025-09-27 06:29:55,125 - lava_callback - ERROR - Error processing callback for node 68d4e156a5c2c05277bd0e4e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:55,877 - lava_callback - INFO - Received callback for node 68d4e158a5c2c05277bd0e51 INFO: 172.21.0.1:42342 - "POST /node/68d4e158a5c2c05277bd0e51 HTTP/1.0" 202 Accepted 2025-09-27 06:29:55,882 - lava_callback - INFO - Starting async job submit for node 68d4e158a5c2c05277bd0e51 2025-09-27 06:29:55,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:55,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e158a5c2c05277bd0e51 HTTP/1.1" 200 None 2025-09-27 06:29:55,915 - lava_callback - DEBUG - Processing node 68d4e158a5c2c05277bd0e51: ltp-ipc 2025-09-27 06:29:55,915 - lava_callback - ERROR - Error processing callback for node 68d4e158a5c2c05277bd0e51: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:29:56,649 - lava_callback - INFO - Received callback for node 68d4e15aa5c2c05277bd0e54 INFO: 172.21.0.1:42352 - "POST /node/68d4e15aa5c2c05277bd0e54 HTTP/1.0" 202 Accepted 2025-09-27 06:29:56,655 - lava_callback - INFO - Starting async job submit for node 68d4e15aa5c2c05277bd0e54 2025-09-27 06:29:56,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:56,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e15aa5c2c05277bd0e54 HTTP/1.1" 200 None 2025-09-27 06:29:56,691 - lava_callback - DEBUG - Processing node 68d4e15aa5c2c05277bd0e54: ltp-pty 2025-09-27 06:29:56,691 - lava_callback - ERROR - Error processing callback for node 68d4e15aa5c2c05277bd0e54: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:57,428 - lava_callback - INFO - Received callback for node 68d4e15ba5c2c05277bd0e57 INFO: 172.21.0.1:42356 - "POST /node/68d4e15ba5c2c05277bd0e57 HTTP/1.0" 202 Accepted 2025-09-27 06:29:57,434 - lava_callback - INFO - Starting async job submit for node 68d4e15ba5c2c05277bd0e57 2025-09-27 06:29:57,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:57,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e15ba5c2c05277bd0e57 HTTP/1.1" 200 None 2025-09-27 06:29:57,448 - lava_callback - DEBUG - Processing node 68d4e15ba5c2c05277bd0e57: ltp-sched 2025-09-27 06:29:57,448 - lava_callback - ERROR - Error processing callback for node 68d4e15ba5c2c05277bd0e57: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:58,186 - lava_callback - INFO - Received callback for node 68d4e15da5c2c05277bd0e5a INFO: 172.21.0.1:42362 - "POST /node/68d4e15da5c2c05277bd0e5a HTTP/1.0" 202 Accepted 2025-09-27 06:29:58,192 - lava_callback - INFO - Starting async job submit for node 68d4e15da5c2c05277bd0e5a 2025-09-27 06:29:58,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:58,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e15da5c2c05277bd0e5a HTTP/1.1" 200 None 2025-09-27 06:29:58,206 - lava_callback - DEBUG - Processing node 68d4e15da5c2c05277bd0e5a: ltp-smoketest 2025-09-27 06:29:58,206 - lava_callback - ERROR - Error processing callback for node 68d4e15da5c2c05277bd0e5a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:58,934 - lava_callback - INFO - Received callback for node 68d4e15fa5c2c05277bd0e5d INFO: 172.21.0.1:42368 - "POST /node/68d4e15fa5c2c05277bd0e5d HTTP/1.0" 202 Accepted 2025-09-27 06:29:58,940 - lava_callback - INFO - Starting async job submit for node 68d4e15fa5c2c05277bd0e5d 2025-09-27 06:29:58,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:58,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e15fa5c2c05277bd0e5d HTTP/1.1" 200 None 2025-09-27 06:29:58,953 - lava_callback - DEBUG - Processing node 68d4e15fa5c2c05277bd0e5d: ltp-syscalls 2025-09-27 06:29:58,953 - lava_callback - ERROR - Error processing callback for node 68d4e15fa5c2c05277bd0e5d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:29:59,673 - lava_callback - INFO - Received callback for node 68d4e160a5c2c05277bd0e60 INFO: 172.21.0.1:39530 - "POST /node/68d4e160a5c2c05277bd0e60 HTTP/1.0" 202 Accepted 2025-09-27 06:29:59,679 - lava_callback - INFO - Starting async job submit for node 68d4e160a5c2c05277bd0e60 2025-09-27 06:29:59,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:29:59,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e160a5c2c05277bd0e60 HTTP/1.1" 200 None 2025-09-27 06:29:59,693 - lava_callback - DEBUG - Processing node 68d4e160a5c2c05277bd0e60: ltp-syscalls-ipc 2025-09-27 06:29:59,693 - lava_callback - ERROR - Error processing callback for node 68d4e160a5c2c05277bd0e60: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:30:00,408 - lava_callback - INFO - Received callback for node 68d4e162a5c2c05277bd0e63 INFO: 172.21.0.1:39540 - "POST /node/68d4e162a5c2c05277bd0e63 HTTP/1.0" 202 Accepted 2025-09-27 06:30:00,414 - lava_callback - INFO - Starting async job submit for node 68d4e162a5c2c05277bd0e63 2025-09-27 06:30:00,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:30:00,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e162a5c2c05277bd0e63 HTTP/1.1" 200 None 2025-09-27 06:30:00,432 - lava_callback - DEBUG - Processing node 68d4e162a5c2c05277bd0e63: ltp-timers 2025-09-27 06:30:00,432 - lava_callback - ERROR - Error processing callback for node 68d4e162a5c2c05277bd0e63: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 06:30:01,140 - lava_callback - INFO - Received callback for node 68d4e164a5c2c05277bd0e66 INFO: 172.21.0.1:39554 - "POST /node/68d4e164a5c2c05277bd0e66 HTTP/1.0" 202 Accepted 2025-09-27 06:30:01,145 - lava_callback - INFO - Starting async job submit for node 68d4e164a5c2c05277bd0e66 2025-09-27 06:30:01,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:30:01,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e164a5c2c05277bd0e66 HTTP/1.1" 200 None 2025-09-27 06:30:01,162 - lava_callback - DEBUG - Processing node 68d4e164a5c2c05277bd0e66: ltp-watchqueue 2025-09-27 06:30:01,162 - lava_callback - ERROR - Error processing callback for node 68d4e164a5c2c05277bd0e66: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:31:13,943 - lava_callback - INFO - Received callback for node 68d6339fc1bc82a30b37adf8 INFO: 172.21.0.1:33562 - "POST /node/68d6339fc1bc82a30b37adf8 HTTP/1.0" 202 Accepted 2025-09-27 06:31:13,949 - lava_callback - INFO - Starting async job submit for node 68d6339fc1bc82a30b37adf8 2025-09-27 06:31:13,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:31:13,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6339fc1bc82a30b37adf8 HTTP/1.1" 200 None 2025-09-27 06:31:13,984 - lava_callback - DEBUG - Processing node 68d6339fc1bc82a30b37adf8: baseline-arm 2025-09-27 06:31:14,209 - lava_callback - ERROR - Error processing callback for node 68d6339fc1bc82a30b37adf8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:32:18,755 - lava_callback - INFO - Received callback for node 68d4e0b2a5c2c05277bd0d6e INFO: 172.21.0.1:54470 - "POST /node/68d4e0b2a5c2c05277bd0d6e HTTP/1.0" 202 Accepted 2025-09-27 06:32:18,763 - lava_callback - INFO - Starting async job submit for node 68d4e0b2a5c2c05277bd0d6e 2025-09-27 06:32:18,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:32:18,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0b2a5c2c05277bd0d6e HTTP/1.1" 200 None 2025-09-27 06:32:18,899 - lava_callback - DEBUG - Processing node 68d4e0b2a5c2c05277bd0d6e: ltp-cve 2025-09-27 06:32:19,588 - lava_callback - ERROR - Error processing callback for node 68d4e0b2a5c2c05277bd0d6e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:33:33,664 - lava_callback - INFO - Received callback for node 68d63482c1bc82a30b37aea9 INFO: 172.21.0.1:40220 - "POST /node/68d63482c1bc82a30b37aea9 HTTP/1.0" 202 Accepted 2025-09-27 06:33:33,669 - lava_callback - INFO - Starting async job submit for node 68d63482c1bc82a30b37aea9 2025-09-27 06:33:33,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:33:33,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63482c1bc82a30b37aea9 HTTP/1.1" 200 None 2025-09-27 06:33:33,708 - lava_callback - DEBUG - Processing node 68d63482c1bc82a30b37aea9: baseline-arm 2025-09-27 06:33:33,956 - lava_callback - ERROR - Error processing callback for node 68d63482c1bc82a30b37aea9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:34:03,444 - lava_callback - INFO - Received callback for node 68d4fcb9ef0c6c1c7020603a INFO: 172.21.0.1:46064 - "POST /node/68d4fcb9ef0c6c1c7020603a HTTP/1.0" 202 Accepted 2025-09-27 06:34:03,450 - lava_callback - INFO - Starting async job submit for node 68d4fcb9ef0c6c1c7020603a 2025-09-27 06:34:03,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:34:03,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcb9ef0c6c1c7020603a HTTP/1.1" 200 None 2025-09-27 06:34:03,484 - lava_callback - DEBUG - Processing node 68d4fcb9ef0c6c1c7020603a: baseline-arm-broonie 2025-09-27 06:34:03,674 - lava_callback - ERROR - Error processing callback for node 68d4fcb9ef0c6c1c7020603a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:35:21,298 - lava_callback - INFO - Received callback for node 68d4e0bca5c2c05277bd0d80 INFO: 172.21.0.1:40364 - "POST /node/68d4e0bca5c2c05277bd0d80 HTTP/1.0" 202 Accepted 2025-09-27 06:35:21,304 - lava_callback - INFO - Starting async job submit for node 68d4e0bca5c2c05277bd0d80 2025-09-27 06:35:21,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:35:21,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0bca5c2c05277bd0d80 HTTP/1.1" 200 None 2025-09-27 06:35:21,361 - lava_callback - DEBUG - Processing node 68d4e0bca5c2c05277bd0d80: ltp-pty 2025-09-27 06:35:21,726 - lava_callback - ERROR - Error processing callback for node 68d4e0bca5c2c05277bd0d80: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:35:37,274 - lava_callback - INFO - Received callback for node 68d4e058a5c2c05277bd0d08 INFO: 172.21.0.1:50702 - "POST /node/68d4e058a5c2c05277bd0d08 HTTP/1.0" 202 Accepted 2025-09-27 06:35:37,280 - lava_callback - INFO - Starting async job submit for node 68d4e058a5c2c05277bd0d08 2025-09-27 06:35:37,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:35:37,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e058a5c2c05277bd0d08 HTTP/1.1" 200 None 2025-09-27 06:35:37,323 - lava_callback - DEBUG - Processing node 68d4e058a5c2c05277bd0d08: baseline-arm 2025-09-27 06:35:37,607 - lava_callback - ERROR - Error processing callback for node 68d4e058a5c2c05277bd0d08: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:35:54,095 - lava_callback - INFO - Received callback for node 68d63483c1bc82a30b37aeac INFO: 172.21.0.1:44290 - "POST /node/68d63483c1bc82a30b37aeac HTTP/1.0" 202 Accepted 2025-09-27 06:35:54,101 - lava_callback - INFO - Starting async job submit for node 68d63483c1bc82a30b37aeac 2025-09-27 06:35:54,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:35:54,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63483c1bc82a30b37aeac HTTP/1.1" 200 None 2025-09-27 06:35:54,133 - lava_callback - DEBUG - Processing node 68d63483c1bc82a30b37aeac: baseline-arm 2025-09-27 06:35:54,353 - lava_callback - ERROR - Error processing callback for node 68d63483c1bc82a30b37aeac: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:38:09,353 - lava_callback - INFO - Received callback for node 68d6348bc1bc82a30b37aec3 INFO: 172.21.0.1:39814 - "POST /node/68d6348bc1bc82a30b37aec3 HTTP/1.0" 202 Accepted 2025-09-27 06:38:09,358 - lava_callback - INFO - Starting async job submit for node 68d6348bc1bc82a30b37aec3 2025-09-27 06:38:09,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:38:09,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6348bc1bc82a30b37aec3 HTTP/1.1" 200 None 2025-09-27 06:38:09,392 - lava_callback - DEBUG - Processing node 68d6348bc1bc82a30b37aec3: baseline-arm 2025-09-27 06:38:09,618 - lava_callback - ERROR - Error processing callback for node 68d6348bc1bc82a30b37aec3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39826 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:38:19,086 - lava_callback - INFO - Received callback for node 68d4fcc1ef0c6c1c7020605e INFO: 172.21.0.1:39832 - "POST /node/68d4fcc1ef0c6c1c7020605e HTTP/1.0" 202 Accepted 2025-09-27 06:38:19,093 - lava_callback - INFO - Starting async job submit for node 68d4fcc1ef0c6c1c7020605e 2025-09-27 06:38:19,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:38:19,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc1ef0c6c1c7020605e HTTP/1.1" 200 None 2025-09-27 06:38:19,131 - lava_callback - DEBUG - Processing node 68d4fcc1ef0c6c1c7020605e: ltp-cap-bounds 2025-09-27 06:38:19,480 - lava_callback - ERROR - Error processing callback for node 68d4fcc1ef0c6c1c7020605e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:40:34,051 - lava_callback - INFO - Received callback for node 68d6348cc1bc82a30b37aec6 INFO: 172.21.0.1:52508 - "POST /node/68d6348cc1bc82a30b37aec6 HTTP/1.0" 202 Accepted 2025-09-27 06:40:34,057 - lava_callback - INFO - Starting async job submit for node 68d6348cc1bc82a30b37aec6 2025-09-27 06:40:34,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:40:34,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6348cc1bc82a30b37aec6 HTTP/1.1" 200 None 2025-09-27 06:40:34,113 - lava_callback - DEBUG - Processing node 68d6348cc1bc82a30b37aec6: baseline-arm 2025-09-27 06:40:34,333 - lava_callback - ERROR - Error processing callback for node 68d6348cc1bc82a30b37aec6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:41:06,303 - lava_callback - INFO - Received callback for node 68d5756a2be2da466069978e INFO: 172.21.0.1:53598 - "POST /node/68d5756a2be2da466069978e HTTP/1.0" 202 Accepted 2025-09-27 06:41:06,309 - lava_callback - INFO - Starting async job submit for node 68d5756a2be2da466069978e 2025-09-27 06:41:06,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:41:06,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5756a2be2da466069978e HTTP/1.1" 200 None 2025-09-27 06:41:06,339 - lava_callback - DEBUG - Processing node 68d5756a2be2da466069978e: baseline-arm64-broonie INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:41:06,642 - lava_callback - ERROR - Error processing callback for node 68d5756a2be2da466069978e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:41:21,716 - lava_callback - INFO - Received callback for node 68d4fcc1ef0c6c1c70206064 INFO: 172.21.0.1:56052 - "POST /node/68d4fcc1ef0c6c1c70206064 HTTP/1.0" 202 Accepted 2025-09-27 06:41:21,724 - lava_callback - INFO - Starting async job submit for node 68d4fcc1ef0c6c1c70206064 2025-09-27 06:41:21,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:41:21,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc1ef0c6c1c70206064 HTTP/1.1" 200 None 2025-09-27 06:41:21,856 - lava_callback - DEBUG - Processing node 68d4fcc1ef0c6c1c70206064: ltp-containers 2025-09-27 06:41:22,678 - lava_callback - ERROR - Error processing callback for node 68d4fcc1ef0c6c1c70206064: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:42:54,895 - lava_callback - INFO - Received callback for node 68d640215d233c363a762242 INFO: 172.21.0.1:52934 - "POST /node/68d640215d233c363a762242 HTTP/1.0" 202 Accepted 2025-09-27 06:42:54,901 - lava_callback - INFO - Starting async job submit for node 68d640215d233c363a762242 2025-09-27 06:42:54,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:42:54,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d640215d233c363a762242 HTTP/1.1" 200 None 2025-09-27 06:42:54,935 - lava_callback - DEBUG - Processing node 68d640215d233c363a762242: baseline-arm 2025-09-27 06:42:55,166 - lava_callback - ERROR - Error processing callback for node 68d640215d233c363a762242: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37066 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:43:42,094 - lava_callback - INFO - Received callback for node 68d61f9230c58dac7d9425d0 INFO: 172.21.0.1:37080 - "POST /node/68d61f9230c58dac7d9425d0 HTTP/1.0" 202 Accepted 2025-09-27 06:43:42,101 - lava_callback - INFO - Starting async job submit for node 68d61f9230c58dac7d9425d0 2025-09-27 06:43:42,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:43:42,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61f9230c58dac7d9425d0 HTTP/1.1" 200 None 2025-09-27 06:43:42,160 - lava_callback - DEBUG - Processing node 68d61f9230c58dac7d9425d0: baseline-arm64 2025-09-27 06:43:43,050 - lava_callback - ERROR - Error processing callback for node 68d61f9230c58dac7d9425d0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:44:22,290 - lava_callback - INFO - Received callback for node 68d61f9230c58dac7d9425d3 INFO: 172.21.0.1:53622 - "POST /node/68d61f9230c58dac7d9425d3 HTTP/1.0" 202 Accepted 2025-09-27 06:44:22,297 - lava_callback - INFO - Starting async job submit for node 68d61f9230c58dac7d9425d3 2025-09-27 06:44:22,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:44:22,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d61f9230c58dac7d9425d3 HTTP/1.1" 200 None 2025-09-27 06:44:22,351 - lava_callback - DEBUG - Processing node 68d61f9230c58dac7d9425d3: baseline-arm64 2025-09-27 06:44:22,663 - lava_callback - INFO - Received callback for node 68d4dbf1a5c2c05277bd0ccc INFO: 172.21.0.1:53634 - "POST /node/68d4dbf1a5c2c05277bd0ccc HTTP/1.0" 202 Accepted 2025-09-27 06:44:22,817 - lava_callback - INFO - Starting async job submit for node 68d4dbf1a5c2c05277bd0ccc 2025-09-27 06:44:23,666 - lava_callback - ERROR - Error processing callback for node 68d61f9230c58dac7d9425d3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 06:44:24,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:44:24,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4dbf1a5c2c05277bd0ccc HTTP/1.1" 200 None 2025-09-27 06:44:24,379 - lava_callback - DEBUG - Processing node 68d4dbf1a5c2c05277bd0ccc: ltp-syscalls INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:44:30,508 - lava_callback - ERROR - Error processing callback for node 68d4dbf1a5c2c05277bd0ccc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:44:51,880 - lava_callback - INFO - Received callback for node 68d6200230c58dac7d9426d4 INFO: 172.21.0.1:51372 - "POST /node/68d6200230c58dac7d9426d4 HTTP/1.0" 202 Accepted 2025-09-27 06:44:51,887 - lava_callback - INFO - Starting async job submit for node 68d6200230c58dac7d9426d4 2025-09-27 06:44:51,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:44:51,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6200230c58dac7d9426d4 HTTP/1.1" 200 None 2025-09-27 06:44:51,942 - lava_callback - DEBUG - Processing node 68d6200230c58dac7d9426d4: baseline-arm64 2025-09-27 06:44:52,784 - lava_callback - ERROR - Error processing callback for node 68d6200230c58dac7d9426d4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:45:09,395 - lava_callback - INFO - Received callback for node 68d640235d233c363a76224e INFO: 172.21.0.1:39158 - "POST /node/68d640235d233c363a76224e HTTP/1.0" 202 Accepted 2025-09-27 06:45:09,401 - lava_callback - INFO - Starting async job submit for node 68d640235d233c363a76224e 2025-09-27 06:45:09,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:45:09,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d640235d233c363a76224e HTTP/1.1" 200 None 2025-09-27 06:45:09,452 - lava_callback - DEBUG - Processing node 68d640235d233c363a76224e: baseline-arm 2025-09-27 06:45:09,674 - lava_callback - ERROR - Error processing callback for node 68d640235d233c363a76224e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:45:41,736 - lava_callback - INFO - Received callback for node 68d4e0bea5c2c05277bd0d83 INFO: 172.21.0.1:56288 - "POST /node/68d4e0bea5c2c05277bd0d83 HTTP/1.0" 202 Accepted 2025-09-27 06:45:41,743 - lava_callback - INFO - Starting async job submit for node 68d4e0bea5c2c05277bd0d83 2025-09-27 06:45:41,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:45:41,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e0bea5c2c05277bd0d83 HTTP/1.1" 200 None 2025-09-27 06:45:41,784 - lava_callback - DEBUG - Processing node 68d4e0bea5c2c05277bd0d83: ltp-sched 2025-09-27 06:45:42,120 - lava_callback - ERROR - Error processing callback for node 68d4e0bea5c2c05277bd0d83: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:46:01,759 - lava_callback - INFO - Received callback for node 68d4fcbbef0c6c1c70206043 INFO: 172.21.0.1:60272 - "POST /node/68d4fcbbef0c6c1c70206043 HTTP/1.0" 202 Accepted 2025-09-27 06:46:01,765 - lava_callback - INFO - Starting async job submit for node 68d4fcbbef0c6c1c70206043 2025-09-27 06:46:01,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:46:01,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcbbef0c6c1c70206043 HTTP/1.1" 200 None 2025-09-27 06:46:01,805 - lava_callback - DEBUG - Processing node 68d4fcbbef0c6c1c70206043: baseline-arm-broonie 2025-09-27 06:46:02,042 - lava_callback - ERROR - Error processing callback for node 68d4fcbbef0c6c1c70206043: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:47:35,844 - lava_callback - INFO - Received callback for node 68d64cb1a5c3ab168ecc799b INFO: 172.21.0.1:59608 - "POST /node/68d64cb1a5c3ab168ecc799b HTTP/1.0" 202 Accepted 2025-09-27 06:47:35,850 - lava_callback - INFO - Starting async job submit for node 68d64cb1a5c3ab168ecc799b 2025-09-27 06:47:35,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:47:35,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64cb1a5c3ab168ecc799b HTTP/1.1" 200 None 2025-09-27 06:47:35,887 - lava_callback - DEBUG - Processing node 68d64cb1a5c3ab168ecc799b: baseline-arm 2025-09-27 06:47:36,112 - lava_callback - ERROR - Error processing callback for node 68d64cb1a5c3ab168ecc799b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:49:58,254 - lava_callback - INFO - Received callback for node 68d64cb3a5c3ab168ecc79a7 INFO: 172.21.0.1:58914 - "POST /node/68d64cb3a5c3ab168ecc79a7 HTTP/1.0" 202 Accepted 2025-09-27 06:49:58,260 - lava_callback - INFO - Starting async job submit for node 68d64cb3a5c3ab168ecc79a7 2025-09-27 06:49:58,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:49:58,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64cb3a5c3ab168ecc79a7 HTTP/1.1" 200 None 2025-09-27 06:49:58,293 - lava_callback - DEBUG - Processing node 68d64cb3a5c3ab168ecc79a7: baseline-arm 2025-09-27 06:49:58,521 - lava_callback - ERROR - Error processing callback for node 68d64cb3a5c3ab168ecc79a7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51602 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:53:02,047 - lava_callback - INFO - Received callback for node 68d4fcc3ef0c6c1c70206070 INFO: 172.21.0.1:46478 - "POST /node/68d4fcc3ef0c6c1c70206070 HTTP/1.0" 202 Accepted 2025-09-27 06:53:02,054 - lava_callback - INFO - Starting async job submit for node 68d4fcc3ef0c6c1c70206070 2025-09-27 06:53:02,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:53:02,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc3ef0c6c1c70206070 HTTP/1.1" 200 None 2025-09-27 06:53:02,197 - lava_callback - DEBUG - Processing node 68d4fcc3ef0c6c1c70206070: ltp-fs-bind 2025-09-27 06:53:02,710 - lava_callback - ERROR - Error processing callback for node 68d4fcc3ef0c6c1c70206070: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:55:16,905 - lava_callback - INFO - Received callback for node 68d4e761a5c2c05277bd0e73 INFO: 172.21.0.1:48982 - "POST /node/68d4e761a5c2c05277bd0e73 HTTP/1.0" 202 Accepted 2025-09-27 06:55:16,910 - lava_callback - INFO - Starting async job submit for node 68d4e761a5c2c05277bd0e73 2025-09-27 06:55:16,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:55:16,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e761a5c2c05277bd0e73 HTTP/1.1" 200 None 2025-09-27 06:55:16,954 - lava_callback - DEBUG - Processing node 68d4e761a5c2c05277bd0e73: baseline-arm 2025-09-27 06:55:17,220 - lava_callback - ERROR - Error processing callback for node 68d4e761a5c2c05277bd0e73: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:55:42,083 - lava_callback - INFO - Received callback for node 68d4e764a5c2c05277bd0e79 INFO: 172.21.0.1:48532 - "POST /node/68d4e764a5c2c05277bd0e79 HTTP/1.0" 202 Accepted 2025-09-27 06:55:42,089 - lava_callback - INFO - Starting async job submit for node 68d4e764a5c2c05277bd0e79 2025-09-27 06:55:42,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:55:42,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e764a5c2c05277bd0e79 HTTP/1.1" 200 None 2025-09-27 06:55:42,102 - lava_callback - DEBUG - Processing node 68d4e764a5c2c05277bd0e79: baseline-arm 2025-09-27 06:55:42,103 - lava_callback - ERROR - Error processing callback for node 68d4e764a5c2c05277bd0e79: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:55:42,719 - lava_callback - INFO - Received callback for node 68d4e764a5c2c05277bd0e7c INFO: 172.21.0.1:48550 - "POST /node/68d4e764a5c2c05277bd0e7c HTTP/1.0" 202 Accepted 2025-09-27 06:55:42,724 - lava_callback - INFO - Starting async job submit for node 68d4e764a5c2c05277bd0e7c 2025-09-27 06:55:42,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:55:42,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e764a5c2c05277bd0e7c HTTP/1.1" 200 None 2025-09-27 06:55:42,759 - lava_callback - DEBUG - Processing node 68d4e764a5c2c05277bd0e7c: baseline-arm 2025-09-27 06:55:42,759 - lava_callback - ERROR - Error processing callback for node 68d4e764a5c2c05277bd0e7c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:56:41,668 - lava_callback - INFO - Received callback for node 68d4fcc2ef0c6c1c70206067 INFO: 172.21.0.1:47926 - "POST /node/68d4fcc2ef0c6c1c70206067 HTTP/1.0" 202 Accepted 2025-09-27 06:56:41,680 - lava_callback - INFO - Starting async job submit for node 68d4fcc2ef0c6c1c70206067 2025-09-27 06:56:42,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:56:42,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc2ef0c6c1c70206067 HTTP/1.1" 200 None 2025-09-27 06:56:42,072 - lava_callback - DEBUG - Processing node 68d4fcc2ef0c6c1c70206067: ltp-controllers INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:56:44,800 - lava_callback - ERROR - Error processing callback for node 68d4fcc2ef0c6c1c70206067: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50096 - "GET / HTTP/1.0" 200 OK 2025-09-27 06:57:22,241 - lava_callback - INFO - Received callback for node 68d4fcc4ef0c6c1c70206073 INFO: 172.21.0.1:45880 - "POST /node/68d4fcc4ef0c6c1c70206073 HTTP/1.0" 202 Accepted 2025-09-27 06:57:22,247 - lava_callback - INFO - Starting async job submit for node 68d4fcc4ef0c6c1c70206073 2025-09-27 06:57:22,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 06:57:22,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc4ef0c6c1c70206073 HTTP/1.1" 200 None 2025-09-27 06:57:22,316 - lava_callback - DEBUG - Processing node 68d4fcc4ef0c6c1c70206073: ltp-fsx 2025-09-27 06:57:22,685 - lava_callback - ERROR - Error processing callback for node 68d4fcc4ef0c6c1c70206073: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:01:00,562 - lava_callback - INFO - Received callback for node 68d4fcc4ef0c6c1c70206076 INFO: 172.21.0.1:38482 - "POST /node/68d4fcc4ef0c6c1c70206076 HTTP/1.0" 202 Accepted 2025-09-27 07:01:00,569 - lava_callback - INFO - Starting async job submit for node 68d4fcc4ef0c6c1c70206076 2025-09-27 07:01:00,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:01:00,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc4ef0c6c1c70206076 HTTP/1.1" 200 None 2025-09-27 07:01:00,631 - lava_callback - DEBUG - Processing node 68d4fcc4ef0c6c1c70206076: ltp-input 2025-09-27 07:01:01,008 - lava_callback - ERROR - Error processing callback for node 68d4fcc4ef0c6c1c70206076: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:01:42,292 - lava_callback - INFO - Received callback for node 68d4fcc5ef0c6c1c70206079 INFO: 172.21.0.1:58656 - "POST /node/68d4fcc5ef0c6c1c70206079 HTTP/1.0" 202 Accepted 2025-09-27 07:01:42,299 - lava_callback - INFO - Starting async job submit for node 68d4fcc5ef0c6c1c70206079 2025-09-27 07:01:42,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:01:42,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc5ef0c6c1c70206079 HTTP/1.1" 200 None 2025-09-27 07:01:42,337 - lava_callback - DEBUG - Processing node 68d4fcc5ef0c6c1c70206079: ltp-ipc 2025-09-27 07:01:42,687 - lava_callback - ERROR - Error processing callback for node 68d4fcc5ef0c6c1c70206079: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:01:51,271 - lava_callback - INFO - Received callback for node 68d65c672f83206171a8fda1 INFO: 172.21.0.1:50160 - "POST /node/68d65c672f83206171a8fda1 HTTP/1.0" 202 Accepted 2025-09-27 07:01:51,277 - lava_callback - INFO - Starting async job submit for node 68d65c672f83206171a8fda1 2025-09-27 07:01:51,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:01:51,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c672f83206171a8fda1 HTTP/1.1" 200 None 2025-09-27 07:01:51,328 - lava_callback - DEBUG - Processing node 68d65c672f83206171a8fda1: baseline-arm 2025-09-27 07:01:51,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:01:51,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:01:51,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c672f83206171a8fda1/log.txt.gz 2025-09-27 07:01:51,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:01:51,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:01:51,847 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c672f83206171a8fda1/lava_callback.json.gz 2025-09-27 07:01:51,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:01:51,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c672f83206171a8fda1 HTTP/1.1" 200 None 2025-09-27 07:01:51,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:01:51,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 07:01:51,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:01:51,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c672f83206171a8fda1 HTTP/1.1" 200 None 2025-09-27 07:01:51,946 - lava_callback - INFO - Completed processing callback for node 68d65c672f83206171a8fda1 INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:03:22,584 - lava_callback - INFO - Received callback for node 68d4fcc2ef0c6c1c7020606a INFO: 172.21.0.1:35558 - "POST /node/68d4fcc2ef0c6c1c7020606a HTTP/1.0" 202 Accepted 2025-09-27 07:03:22,592 - lava_callback - INFO - Starting async job submit for node 68d4fcc2ef0c6c1c7020606a 2025-09-27 07:03:22,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:03:22,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc2ef0c6c1c7020606a HTTP/1.1" 200 None 2025-09-27 07:03:22,731 - lava_callback - DEBUG - Processing node 68d4fcc2ef0c6c1c7020606a: ltp-cve 2025-09-27 07:03:23,501 - lava_callback - ERROR - Error processing callback for node 68d4fcc2ef0c6c1c7020606a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 07:04:15,446 - lava_callback - INFO - Received callback for node 68d65c692f83206171a8fdad INFO: 172.21.0.1:34316 - "POST /node/68d65c692f83206171a8fdad HTTP/1.0" 202 Accepted 2025-09-27 07:04:15,452 - lava_callback - INFO - Starting async job submit for node 68d65c692f83206171a8fdad 2025-09-27 07:04:15,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:04:15,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c692f83206171a8fdad HTTP/1.1" 200 None 2025-09-27 07:04:15,485 - lava_callback - DEBUG - Processing node 68d65c692f83206171a8fdad: baseline-arm 2025-09-27 07:04:15,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:04:15,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:04:15,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c692f83206171a8fdad/log.txt.gz 2025-09-27 07:04:15,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:04:15,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:04:15,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c692f83206171a8fdad/lava_callback.json.gz 2025-09-27 07:04:16,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:04:16,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c692f83206171a8fdad HTTP/1.1" 200 None 2025-09-27 07:04:16,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:04:16,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 07:04:16,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:04:16,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c692f83206171a8fdad HTTP/1.1" 200 None 2025-09-27 07:04:16,095 - lava_callback - INFO - Completed processing callback for node 68d65c692f83206171a8fdad INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:04:23,174 - lava_callback - INFO - Received callback for node 68d6200330c58dac7d9426d7 INFO: 172.21.0.1:47462 - "POST /node/68d6200330c58dac7d9426d7 HTTP/1.0" 202 Accepted 2025-09-27 07:04:23,182 - lava_callback - INFO - Starting async job submit for node 68d6200330c58dac7d9426d7 2025-09-27 07:04:23,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:04:23,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6200330c58dac7d9426d7 HTTP/1.1" 200 None 2025-09-27 07:04:23,235 - lava_callback - DEBUG - Processing node 68d6200330c58dac7d9426d7: baseline-arm64 2025-09-27 07:04:24,106 - lava_callback - ERROR - Error processing callback for node 68d6200330c58dac7d9426d7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40360 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:05:03,839 - lava_callback - INFO - Received callback for node 68d6200530c58dac7d9426da INFO: 172.21.0.1:46930 - "POST /node/68d6200530c58dac7d9426da HTTP/1.0" 202 Accepted 2025-09-27 07:05:03,846 - lava_callback - INFO - Starting async job submit for node 68d6200530c58dac7d9426da 2025-09-27 07:05:03,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:05:03,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6200530c58dac7d9426da HTTP/1.1" 200 None 2025-09-27 07:05:03,919 - lava_callback - DEBUG - Processing node 68d6200530c58dac7d9426da: baseline-arm64 2025-09-27 07:05:04,762 - lava_callback - ERROR - Error processing callback for node 68d6200530c58dac7d9426da: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:05:32,295 - lava_callback - INFO - Received callback for node 68d6200630c58dac7d9426dd INFO: 172.21.0.1:33796 - "POST /node/68d6200630c58dac7d9426dd HTTP/1.0" 202 Accepted 2025-09-27 07:05:32,302 - lava_callback - INFO - Starting async job submit for node 68d6200630c58dac7d9426dd 2025-09-27 07:05:32,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:05:32,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6200630c58dac7d9426dd HTTP/1.1" 200 None 2025-09-27 07:05:32,501 - lava_callback - DEBUG - Processing node 68d6200630c58dac7d9426dd: baseline-arm64 2025-09-27 07:05:33,414 - lava_callback - ERROR - Error processing callback for node 68d6200630c58dac7d9426dd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:06:37,542 - lava_callback - INFO - Received callback for node 68d660a92f83206171a900e1 INFO: 172.21.0.1:59910 - "POST /node/68d660a92f83206171a900e1 HTTP/1.0" 202 Accepted 2025-09-27 07:06:37,548 - lava_callback - INFO - Starting async job submit for node 68d660a92f83206171a900e1 2025-09-27 07:06:37,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:06:37,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660a92f83206171a900e1 HTTP/1.1" 200 None 2025-09-27 07:06:37,592 - lava_callback - DEBUG - Processing node 68d660a92f83206171a900e1: baseline-arm 2025-09-27 07:06:37,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:06:37,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:06:37,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660a92f83206171a900e1/log.txt.gz 2025-09-27 07:06:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:06:38,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:06:38,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660a92f83206171a900e1/lava_callback.json.gz 2025-09-27 07:06:38,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:06:38,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660a92f83206171a900e1 HTTP/1.1" 200 None 2025-09-27 07:06:38,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:06:38,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 07:06:38,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:06:38,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660a92f83206171a900e1 HTTP/1.1" 200 None 2025-09-27 07:06:38,204 - lava_callback - INFO - Completed processing callback for node 68d660a92f83206171a900e1 INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33674 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:08:54,680 - lava_callback - INFO - Received callback for node 68d660ab2f83206171a900ed INFO: 172.21.0.1:33470 - "POST /node/68d660ab2f83206171a900ed HTTP/1.0" 202 Accepted 2025-09-27 07:08:54,686 - lava_callback - INFO - Starting async job submit for node 68d660ab2f83206171a900ed 2025-09-27 07:08:54,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:08:54,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660ab2f83206171a900ed HTTP/1.1" 200 None 2025-09-27 07:08:54,719 - lava_callback - DEBUG - Processing node 68d660ab2f83206171a900ed: baseline-arm 2025-09-27 07:08:54,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:08:55,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:08:55,101 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660ab2f83206171a900ed/log.txt.gz 2025-09-27 07:08:55,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:08:55,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:08:55,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660ab2f83206171a900ed/lava_callback.json.gz 2025-09-27 07:08:55,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:08:55,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660ab2f83206171a900ed HTTP/1.1" 200 None 2025-09-27 07:08:55,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:08:55,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 07:08:55,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:08:55,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660ab2f83206171a900ed HTTP/1.1" 200 None 2025-09-27 07:08:55,355 - lava_callback - INFO - Completed processing callback for node 68d660ab2f83206171a900ed INFO: 172.21.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:10:40,691 - lava_callback - INFO - Received callback for node 68d4fcc5ef0c6c1c7020607c INFO: 172.21.0.1:40682 - "POST /node/68d4fcc5ef0c6c1c7020607c HTTP/1.0" 202 Accepted 2025-09-27 07:10:40,698 - lava_callback - INFO - Starting async job submit for node 68d4fcc5ef0c6c1c7020607c 2025-09-27 07:10:40,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:10:40,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc5ef0c6c1c7020607c HTTP/1.1" 200 None 2025-09-27 07:10:40,754 - lava_callback - DEBUG - Processing node 68d4fcc5ef0c6c1c7020607c: ltp-pty 2025-09-27 07:10:41,125 - lava_callback - ERROR - Error processing callback for node 68d4fcc5ef0c6c1c7020607c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:11:02,664 - lava_callback - INFO - Received callback for node 68d4fcc6ef0c6c1c70206084 INFO: 172.21.0.1:40616 - "POST /node/68d4fcc6ef0c6c1c70206084 HTTP/1.0" 202 Accepted 2025-09-27 07:11:02,671 - lava_callback - INFO - Starting async job submit for node 68d4fcc6ef0c6c1c70206084 2025-09-27 07:11:02,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:11:02,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc6ef0c6c1c70206084 HTTP/1.1" 200 None 2025-09-27 07:11:02,721 - lava_callback - DEBUG - Processing node 68d4fcc6ef0c6c1c70206084: ltp-smoketest 2025-09-27 07:11:02,843 - lava_callback - INFO - Received callback for node 68d66be32f83206171a9046a INFO: 172.21.0.1:40620 - "POST /node/68d66be32f83206171a9046a HTTP/1.0" 202 Accepted 2025-09-27 07:11:02,870 - lava_callback - INFO - Starting async job submit for node 68d66be32f83206171a9046a 2025-09-27 07:11:02,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:11:02,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66be32f83206171a9046a HTTP/1.1" 200 None 2025-09-27 07:11:02,990 - lava_callback - DEBUG - Processing node 68d66be32f83206171a9046a: baseline-arm 2025-09-27 07:11:03,367 - lava_callback - ERROR - Error processing callback for node 68d4fcc6ef0c6c1c70206084: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 07:11:03,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:11:03,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:11:03,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66be32f83206171a9046a/log.txt.gz 2025-09-27 07:11:03,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:11:03,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:11:03,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66be32f83206171a9046a/lava_callback.json.gz 2025-09-27 07:11:03,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:11:03,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66be32f83206171a9046a HTTP/1.1" 200 None 2025-09-27 07:11:03,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:11:03,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:11:03,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:11:04,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66be32f83206171a9046a HTTP/1.1" 200 None 2025-09-27 07:11:04,009 - lava_callback - INFO - Completed processing callback for node 68d66be32f83206171a9046a INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:13:20,201 - lava_callback - INFO - Received callback for node 68d576b02be2da466069993e INFO: 172.21.0.1:36660 - "POST /node/68d576b02be2da466069993e HTTP/1.0" 202 Accepted 2025-09-27 07:13:20,207 - lava_callback - INFO - Starting async job submit for node 68d576b02be2da466069993e 2025-09-27 07:13:20,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:13:20,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576b02be2da466069993e HTTP/1.1" 200 None 2025-09-27 07:13:20,257 - lava_callback - DEBUG - Processing node 68d576b02be2da466069993e: baseline-arm64-broonie 2025-09-27 07:13:20,556 - lava_callback - ERROR - Error processing callback for node 68d576b02be2da466069993e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:13:34,797 - lava_callback - INFO - Received callback for node 68d66be52f83206171a9048c INFO: 172.21.0.1:35766 - "POST /node/68d66be52f83206171a9048c HTTP/1.0" 202 Accepted 2025-09-27 07:13:34,803 - lava_callback - INFO - Starting async job submit for node 68d66be52f83206171a9048c 2025-09-27 07:13:34,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:13:34,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66be52f83206171a9048c HTTP/1.1" 200 None 2025-09-27 07:13:34,835 - lava_callback - DEBUG - Processing node 68d66be52f83206171a9048c: baseline-arm 2025-09-27 07:13:35,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:13:35,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:13:35,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66be52f83206171a9048c/log.txt.gz 2025-09-27 07:13:35,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:13:35,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:13:35,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66be52f83206171a9048c/lava_callback.json.gz 2025-09-27 07:13:35,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:13:35,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66be52f83206171a9048c HTTP/1.1" 200 None 2025-09-27 07:13:35,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:13:35,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:13:35,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:13:35,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66be52f83206171a9048c HTTP/1.1" 200 None 2025-09-27 07:13:35,583 - lava_callback - INFO - Completed processing callback for node 68d66be52f83206171a9048c INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:14:57,813 - lava_callback - INFO - Received callback for node 68d4e762a5c2c05277bd0e76 INFO: 172.21.0.1:53322 - "POST /node/68d4e762a5c2c05277bd0e76 HTTP/1.0" 202 Accepted 2025-09-27 07:14:57,820 - lava_callback - INFO - Starting async job submit for node 68d4e762a5c2c05277bd0e76 2025-09-27 07:14:57,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:14:57,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4e762a5c2c05277bd0e76 HTTP/1.1" 200 None 2025-09-27 07:14:57,885 - lava_callback - DEBUG - Processing node 68d4e762a5c2c05277bd0e76: baseline-arm 2025-09-27 07:14:58,143 - lava_callback - ERROR - Error processing callback for node 68d4e762a5c2c05277bd0e76: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:15:23,608 - lava_callback - INFO - Received callback for node 68d4fcc8ef0c6c1c70206091 INFO: 172.21.0.1:40598 - "POST /node/68d4fcc8ef0c6c1c70206091 HTTP/1.0" 202 Accepted 2025-09-27 07:15:23,614 - lava_callback - INFO - Starting async job submit for node 68d4fcc8ef0c6c1c70206091 2025-09-27 07:15:23,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:15:23,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc8ef0c6c1c70206091 HTTP/1.1" 200 None 2025-09-27 07:15:23,672 - lava_callback - DEBUG - Processing node 68d4fcc8ef0c6c1c70206091: ltp-timers 2025-09-27 07:15:23,992 - lava_callback - ERROR - Error processing callback for node 68d4fcc8ef0c6c1c70206091: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:15:42,860 - lava_callback - INFO - Received callback for node 68d4ec16a5c2c05277bd0f46 INFO: 172.21.0.1:60170 - "POST /node/68d4ec16a5c2c05277bd0f46 HTTP/1.0" 202 Accepted 2025-09-27 07:15:42,866 - lava_callback - INFO - Starting async job submit for node 68d4ec16a5c2c05277bd0f46 2025-09-27 07:15:42,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:15:42,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ec16a5c2c05277bd0f46 HTTP/1.1" 200 None 2025-09-27 07:15:42,879 - lava_callback - DEBUG - Processing node 68d4ec16a5c2c05277bd0f46: baseline-arm 2025-09-27 07:15:42,879 - lava_callback - ERROR - Error processing callback for node 68d4ec16a5c2c05277bd0f46: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 07:15:43,546 - lava_callback - INFO - Received callback for node 68d4ec18a5c2c05277bd0f49 INFO: 172.21.0.1:60174 - "POST /node/68d4ec18a5c2c05277bd0f49 HTTP/1.0" 202 Accepted 2025-09-27 07:15:43,551 - lava_callback - INFO - Starting async job submit for node 68d4ec18a5c2c05277bd0f49 2025-09-27 07:15:43,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:15:43,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ec18a5c2c05277bd0f49 HTTP/1.1" 200 None 2025-09-27 07:15:43,565 - lava_callback - DEBUG - Processing node 68d4ec18a5c2c05277bd0f49: baseline-arm 2025-09-27 07:15:43,565 - lava_callback - ERROR - Error processing callback for node 68d4ec18a5c2c05277bd0f49: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 07:15:44,211 - lava_callback - INFO - Received callback for node 68d4ec18a5c2c05277bd0f4c INFO: 172.21.0.1:60178 - "POST /node/68d4ec18a5c2c05277bd0f4c HTTP/1.0" 202 Accepted 2025-09-27 07:15:44,216 - lava_callback - INFO - Starting async job submit for node 68d4ec18a5c2c05277bd0f4c 2025-09-27 07:15:44,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:15:44,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ec18a5c2c05277bd0f4c HTTP/1.1" 200 None 2025-09-27 07:15:44,230 - lava_callback - DEBUG - Processing node 68d4ec18a5c2c05277bd0f4c: baseline-arm 2025-09-27 07:15:44,230 - lava_callback - ERROR - Error processing callback for node 68d4ec18a5c2c05277bd0f4c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:15:58,460 - lava_callback - INFO - Received callback for node 68d66be92f83206171a9048f INFO: 172.21.0.1:49060 - "POST /node/68d66be92f83206171a9048f HTTP/1.0" 202 Accepted 2025-09-27 07:15:58,466 - lava_callback - INFO - Starting async job submit for node 68d66be92f83206171a9048f 2025-09-27 07:15:58,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:15:58,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66be92f83206171a9048f HTTP/1.1" 200 None 2025-09-27 07:15:58,520 - lava_callback - DEBUG - Processing node 68d66be92f83206171a9048f: baseline-arm 2025-09-27 07:15:58,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:15:58,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:15:58,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66be92f83206171a9048f/log.txt.gz 2025-09-27 07:15:58,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:15:59,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:15:59,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66be92f83206171a9048f/lava_callback.json.gz 2025-09-27 07:15:59,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:15:59,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66be92f83206171a9048f HTTP/1.1" 200 None 2025-09-27 07:15:59,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:15:59,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:15:59,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:15:59,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66be92f83206171a9048f HTTP/1.1" 200 None 2025-09-27 07:15:59,187 - lava_callback - INFO - Completed processing callback for node 68d66be92f83206171a9048f INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 07:18:15,441 - lava_callback - INFO - Received callback for node 68d66beb2f83206171a90492 INFO: 172.21.0.1:44418 - "POST /node/68d66beb2f83206171a90492 HTTP/1.0" 202 Accepted 2025-09-27 07:18:15,447 - lava_callback - INFO - Starting async job submit for node 68d66beb2f83206171a90492 2025-09-27 07:18:15,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:18:15,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66beb2f83206171a90492 HTTP/1.1" 200 None 2025-09-27 07:18:15,500 - lava_callback - DEBUG - Processing node 68d66beb2f83206171a90492: baseline-arm 2025-09-27 07:18:15,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:18:15,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:18:15,879 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66beb2f83206171a90492/log.txt.gz 2025-09-27 07:18:15,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:18:16,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:18:16,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66beb2f83206171a90492/lava_callback.json.gz 2025-09-27 07:18:16,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:18:16,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66beb2f83206171a90492 HTTP/1.1" 200 None 2025-09-27 07:18:16,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:18:16,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:18:16,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:18:16,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66beb2f83206171a90492 HTTP/1.1" 200 None 2025-09-27 07:18:16,169 - lava_callback - INFO - Completed processing callback for node 68d66beb2f83206171a90492 INFO: 172.21.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:19:42,961 - lava_callback - INFO - Received callback for node 68d4fcc8ef0c6c1c70206094 INFO: 172.21.0.1:53354 - "POST /node/68d4fcc8ef0c6c1c70206094 HTTP/1.0" 202 Accepted 2025-09-27 07:19:42,968 - lava_callback - INFO - Starting async job submit for node 68d4fcc8ef0c6c1c70206094 2025-09-27 07:19:43,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:19:43,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc8ef0c6c1c70206094 HTTP/1.1" 200 None 2025-09-27 07:19:43,017 - lava_callback - DEBUG - Processing node 68d4fcc8ef0c6c1c70206094: ltp-watchqueue 2025-09-27 07:19:43,422 - lava_callback - ERROR - Error processing callback for node 68d4fcc8ef0c6c1c70206094: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35738 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:20:36,181 - lava_callback - INFO - Received callback for node 68d66bee2f83206171a90495 INFO: 172.21.0.1:49474 - "POST /node/68d66bee2f83206171a90495 HTTP/1.0" 202 Accepted 2025-09-27 07:20:36,187 - lava_callback - INFO - Starting async job submit for node 68d66bee2f83206171a90495 2025-09-27 07:20:36,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:20:36,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bee2f83206171a90495 HTTP/1.1" 200 None 2025-09-27 07:20:36,220 - lava_callback - DEBUG - Processing node 68d66bee2f83206171a90495: baseline-arm 2025-09-27 07:20:36,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:20:36,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:20:36,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bee2f83206171a90495/log.txt.gz 2025-09-27 07:20:36,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:20:36,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:20:36,746 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bee2f83206171a90495/lava_callback.json.gz 2025-09-27 07:20:36,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:20:36,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bee2f83206171a90495 HTTP/1.1" 200 None 2025-09-27 07:20:36,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:20:36,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:20:36,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:20:36,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bee2f83206171a90495 HTTP/1.1" 200 None 2025-09-27 07:20:36,850 - lava_callback - INFO - Completed processing callback for node 68d66bee2f83206171a90495 2025-09-27 07:20:43,004 - lava_callback - INFO - Received callback for node 68d4fcc6ef0c6c1c7020607f INFO: 172.21.0.1:35306 - "POST /node/68d4fcc6ef0c6c1c7020607f HTTP/1.0" 202 Accepted 2025-09-27 07:20:43,010 - lava_callback - INFO - Starting async job submit for node 68d4fcc6ef0c6c1c7020607f 2025-09-27 07:20:43,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:20:43,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc6ef0c6c1c7020607f HTTP/1.1" 200 None 2025-09-27 07:20:43,051 - lava_callback - DEBUG - Processing node 68d4fcc6ef0c6c1c7020607f: ltp-sched 2025-09-27 07:20:43,377 - lava_callback - ERROR - Error processing callback for node 68d4fcc6ef0c6c1c7020607f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:22:51,158 - lava_callback - INFO - Received callback for node 68d66bf02f83206171a90498 INFO: 172.21.0.1:33282 - "POST /node/68d66bf02f83206171a90498 HTTP/1.0" 202 Accepted 2025-09-27 07:22:51,164 - lava_callback - INFO - Starting async job submit for node 68d66bf02f83206171a90498 2025-09-27 07:22:51,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:22:51,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bf02f83206171a90498 HTTP/1.1" 200 None 2025-09-27 07:22:51,219 - lava_callback - DEBUG - Processing node 68d66bf02f83206171a90498: baseline-arm 2025-09-27 07:22:51,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:22:51,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:22:51,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bf02f83206171a90498/log.txt.gz 2025-09-27 07:22:51,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:22:51,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:22:51,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bf02f83206171a90498/lava_callback.json.gz 2025-09-27 07:22:51,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:22:51,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bf02f83206171a90498 HTTP/1.1" 200 None 2025-09-27 07:22:51,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:22:51,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:22:51,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:22:51,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bf02f83206171a90498 HTTP/1.1" 200 None 2025-09-27 07:22:51,910 - lava_callback - INFO - Completed processing callback for node 68d66bf02f83206171a90498 INFO: 172.21.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:25:04,882 - lava_callback - INFO - Received callback for node 68d6200930c58dac7d9426e0 INFO: 172.21.0.1:36184 - "POST /node/68d6200930c58dac7d9426e0 HTTP/1.0" 202 Accepted 2025-09-27 07:25:04,889 - lava_callback - INFO - Starting async job submit for node 68d6200930c58dac7d9426e0 2025-09-27 07:25:04,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:25:04,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6200930c58dac7d9426e0 HTTP/1.1" 200 None 2025-09-27 07:25:04,965 - lava_callback - DEBUG - Processing node 68d6200930c58dac7d9426e0: baseline-arm64 2025-09-27 07:25:05,794 - lava_callback - ERROR - Error processing callback for node 68d6200930c58dac7d9426e0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:25:11,184 - lava_callback - INFO - Received callback for node 68d66bf32f83206171a9049b INFO: 172.21.0.1:37312 - "POST /node/68d66bf32f83206171a9049b HTTP/1.0" 202 Accepted 2025-09-27 07:25:11,189 - lava_callback - INFO - Starting async job submit for node 68d66bf32f83206171a9049b 2025-09-27 07:25:11,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:25:11,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bf32f83206171a9049b HTTP/1.1" 200 None 2025-09-27 07:25:11,227 - lava_callback - DEBUG - Processing node 68d66bf32f83206171a9049b: baseline-arm 2025-09-27 07:25:11,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:25:11,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:25:11,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bf32f83206171a9049b/log.txt.gz 2025-09-27 07:25:11,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:25:11,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:25:11,772 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bf32f83206171a9049b/lava_callback.json.gz 2025-09-27 07:25:11,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:25:11,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bf32f83206171a9049b HTTP/1.1" 200 None 2025-09-27 07:25:11,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:25:11,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:25:11,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:25:11,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bf32f83206171a9049b HTTP/1.1" 200 None 2025-09-27 07:25:11,887 - lava_callback - INFO - Completed processing callback for node 68d66bf32f83206171a9049b INFO: 172.21.0.1:37316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:25:45,049 - lava_callback - INFO - Received callback for node 68d6200930c58dac7d9426e3 INFO: 172.21.0.1:56100 - "POST /node/68d6200930c58dac7d9426e3 HTTP/1.0" 202 Accepted 2025-09-27 07:25:45,056 - lava_callback - INFO - Starting async job submit for node 68d6200930c58dac7d9426e3 2025-09-27 07:25:45,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:25:45,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6200930c58dac7d9426e3 HTTP/1.1" 200 None 2025-09-27 07:25:45,119 - lava_callback - DEBUG - Processing node 68d6200930c58dac7d9426e3: baseline-arm64 2025-09-27 07:25:45,946 - lava_callback - ERROR - Error processing callback for node 68d6200930c58dac7d9426e3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45738 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:26:14,048 - lava_callback - INFO - Received callback for node 68d6200c30c58dac7d9426e6 INFO: 172.21.0.1:44222 - "POST /node/68d6200c30c58dac7d9426e6 HTTP/1.0" 202 Accepted 2025-09-27 07:26:14,056 - lava_callback - INFO - Starting async job submit for node 68d6200c30c58dac7d9426e6 2025-09-27 07:26:14,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:26:14,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6200c30c58dac7d9426e6 HTTP/1.1" 200 None 2025-09-27 07:26:14,120 - lava_callback - DEBUG - Processing node 68d6200c30c58dac7d9426e6: baseline-arm64 2025-09-27 07:26:15,016 - lava_callback - ERROR - Error processing callback for node 68d6200c30c58dac7d9426e6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:27:37,892 - lava_callback - INFO - Received callback for node 68d66bf52f83206171a9049e INFO: 172.21.0.1:59484 - "POST /node/68d66bf52f83206171a9049e HTTP/1.0" 202 Accepted 2025-09-27 07:27:37,898 - lava_callback - INFO - Starting async job submit for node 68d66bf52f83206171a9049e 2025-09-27 07:27:37,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:27:38,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bf52f83206171a9049e HTTP/1.1" 200 None 2025-09-27 07:27:38,069 - lava_callback - DEBUG - Processing node 68d66bf52f83206171a9049e: baseline-arm 2025-09-27 07:27:38,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:27:38,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:27:38,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bf52f83206171a9049e/log.txt.gz 2025-09-27 07:27:38,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:27:38,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:27:38,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bf52f83206171a9049e/lava_callback.json.gz 2025-09-27 07:27:38,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:27:38,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bf52f83206171a9049e HTTP/1.1" 200 None 2025-09-27 07:27:38,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:27:38,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:27:38,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:27:38,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bf52f83206171a9049e HTTP/1.1" 200 None 2025-09-27 07:27:38,701 - lava_callback - INFO - Completed processing callback for node 68d66bf52f83206171a9049e INFO: 172.21.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:29:40,970 - lava_callback - INFO - Received callback for node 68d4fcc7ef0c6c1c7020608d INFO: 172.21.0.1:34592 - "POST /node/68d4fcc7ef0c6c1c7020608d HTTP/1.0" 202 Accepted 2025-09-27 07:29:40,977 - lava_callback - INFO - Starting async job submit for node 68d4fcc7ef0c6c1c7020608d 2025-09-27 07:29:41,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:29:41,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc7ef0c6c1c7020608d HTTP/1.1" 200 None 2025-09-27 07:29:41,019 - lava_callback - DEBUG - Processing node 68d4fcc7ef0c6c1c7020608d: ltp-syscalls-ipc 2025-09-27 07:29:41,807 - lava_callback - ERROR - Error processing callback for node 68d4fcc7ef0c6c1c7020608d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:29:56,584 - lava_callback - INFO - Received callback for node 68d66c282f83206171a9051b INFO: 172.21.0.1:58160 - "POST /node/68d66c282f83206171a9051b HTTP/1.0" 202 Accepted 2025-09-27 07:29:56,592 - lava_callback - INFO - Starting async job submit for node 68d66c282f83206171a9051b 2025-09-27 07:29:56,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:29:56,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c282f83206171a9051b HTTP/1.1" 200 None 2025-09-27 07:29:56,629 - lava_callback - DEBUG - Processing node 68d66c282f83206171a9051b: baseline-arm 2025-09-27 07:29:56,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:29:57,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:29:57,013 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c282f83206171a9051b/log.txt.gz 2025-09-27 07:29:57,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:29:57,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:29:57,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c282f83206171a9051b/lava_callback.json.gz 2025-09-27 07:29:57,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:29:57,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c282f83206171a9051b HTTP/1.1" 200 None 2025-09-27 07:29:57,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:29:57,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:29:57,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:29:57,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c282f83206171a9051b HTTP/1.1" 200 None 2025-09-27 07:29:57,222 - lava_callback - INFO - Completed processing callback for node 68d66c282f83206171a9051b INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 07:32:16,001 - lava_callback - INFO - Received callback for node 68d66c282f83206171a9051e INFO: 172.21.0.1:42134 - "POST /node/68d66c282f83206171a9051e HTTP/1.0" 202 Accepted 2025-09-27 07:32:16,007 - lava_callback - INFO - Starting async job submit for node 68d66c282f83206171a9051e 2025-09-27 07:32:16,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:32:16,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c282f83206171a9051e HTTP/1.1" 200 None 2025-09-27 07:32:16,040 - lava_callback - DEBUG - Processing node 68d66c282f83206171a9051e: baseline-arm 2025-09-27 07:32:16,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:32:16,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:32:16,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c282f83206171a9051e/log.txt.gz 2025-09-27 07:32:16,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:32:16,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:32:16,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c282f83206171a9051e/lava_callback.json.gz 2025-09-27 07:32:16,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:32:16,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c282f83206171a9051e HTTP/1.1" 200 None 2025-09-27 07:32:16,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:32:16,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:32:16,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:32:16,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c282f83206171a9051e HTTP/1.1" 200 None 2025-09-27 07:32:16,681 - lava_callback - INFO - Completed processing callback for node 68d66c282f83206171a9051e INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40480 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:34:36,508 - lava_callback - INFO - Received callback for node 68d66c2a2f83206171a90521 INFO: 172.21.0.1:44530 - "POST /node/68d66c2a2f83206171a90521 HTTP/1.0" 202 Accepted 2025-09-27 07:34:36,514 - lava_callback - INFO - Starting async job submit for node 68d66c2a2f83206171a90521 2025-09-27 07:34:36,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:34:36,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c2a2f83206171a90521 HTTP/1.1" 200 None 2025-09-27 07:34:36,564 - lava_callback - DEBUG - Processing node 68d66c2a2f83206171a90521: baseline-arm 2025-09-27 07:34:36,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:34:36,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:34:36,929 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c2a2f83206171a90521/log.txt.gz 2025-09-27 07:34:36,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:34:37,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:34:37,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c2a2f83206171a90521/lava_callback.json.gz 2025-09-27 07:34:37,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:34:37,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c2a2f83206171a90521 HTTP/1.1" 200 None 2025-09-27 07:34:37,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:34:37,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:34:37,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:34:37,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c2a2f83206171a90521 HTTP/1.1" 200 None 2025-09-27 07:34:37,163 - lava_callback - INFO - Completed processing callback for node 68d66c2a2f83206171a90521 2025-09-27 07:34:38,149 - lava_callback - INFO - Received callback for node 68d4ec15a5c2c05277bd0f43 INFO: 172.21.0.1:44544 - "POST /node/68d4ec15a5c2c05277bd0f43 HTTP/1.0" 202 Accepted 2025-09-27 07:34:38,155 - lava_callback - INFO - Starting async job submit for node 68d4ec15a5c2c05277bd0f43 2025-09-27 07:34:38,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:34:38,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4ec15a5c2c05277bd0f43 HTTP/1.1" 200 None 2025-09-27 07:34:38,198 - lava_callback - DEBUG - Processing node 68d4ec15a5c2c05277bd0f43: baseline-arm 2025-09-27 07:34:38,460 - lava_callback - ERROR - Error processing callback for node 68d4ec15a5c2c05277bd0f43: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:36:52,052 - lava_callback - INFO - Received callback for node 68d66c2b2f83206171a90524 INFO: 172.21.0.1:51064 - "POST /node/68d66c2b2f83206171a90524 HTTP/1.0" 202 Accepted 2025-09-27 07:36:52,058 - lava_callback - INFO - Starting async job submit for node 68d66c2b2f83206171a90524 2025-09-27 07:36:52,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:36:52,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c2b2f83206171a90524 HTTP/1.1" 200 None 2025-09-27 07:36:52,092 - lava_callback - DEBUG - Processing node 68d66c2b2f83206171a90524: baseline-arm 2025-09-27 07:36:52,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:36:52,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:36:52,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c2b2f83206171a90524/log.txt.gz 2025-09-27 07:36:52,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:36:52,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:36:52,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c2b2f83206171a90524/lava_callback.json.gz 2025-09-27 07:36:52,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:36:52,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c2b2f83206171a90524 HTTP/1.1" 200 None 2025-09-27 07:36:52,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:36:52,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:36:52,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:36:52,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c2b2f83206171a90524 HTTP/1.1" 200 None 2025-09-27 07:36:52,695 - lava_callback - INFO - Completed processing callback for node 68d66c2b2f83206171a90524 INFO: 172.21.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:38:05,252 - lava_callback - INFO - Received callback for node 68d4fcc7ef0c6c1c70206088 INFO: 172.21.0.1:49706 - "POST /node/68d4fcc7ef0c6c1c70206088 HTTP/1.0" 202 Accepted 2025-09-27 07:38:05,270 - lava_callback - INFO - Starting async job submit for node 68d4fcc7ef0c6c1c70206088 INFO: 172.21.0.1:49720 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:38:06,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:38:06,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcc7ef0c6c1c70206088 HTTP/1.1" 200 None 2025-09-27 07:38:06,639 - lava_callback - DEBUG - Processing node 68d4fcc7ef0c6c1c70206088: ltp-syscalls 2025-09-27 07:38:13,446 - lava_callback - ERROR - Error processing callback for node 68d4fcc7ef0c6c1c70206088: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 07:39:16,125 - lava_callback - INFO - Received callback for node 68d66c2f2f83206171a90527 INFO: 172.21.0.1:40818 - "POST /node/68d66c2f2f83206171a90527 HTTP/1.0" 202 Accepted 2025-09-27 07:39:16,131 - lava_callback - INFO - Starting async job submit for node 68d66c2f2f83206171a90527 2025-09-27 07:39:16,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:39:16,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c2f2f83206171a90527 HTTP/1.1" 200 None 2025-09-27 07:39:16,162 - lava_callback - DEBUG - Processing node 68d66c2f2f83206171a90527: baseline-arm 2025-09-27 07:39:16,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40828 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:39:16,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:39:16,544 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c2f2f83206171a90527/log.txt.gz 2025-09-27 07:39:16,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:39:16,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:39:16,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c2f2f83206171a90527/lava_callback.json.gz 2025-09-27 07:39:16,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:39:16,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c2f2f83206171a90527 HTTP/1.1" 200 None 2025-09-27 07:39:16,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:39:16,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:39:16,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:39:16,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c2f2f83206171a90527 HTTP/1.1" 200 None 2025-09-27 07:39:16,797 - lava_callback - INFO - Completed processing callback for node 68d66c2f2f83206171a90527 INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:41:37,475 - lava_callback - INFO - Received callback for node 68d66c302f83206171a9052a INFO: 172.21.0.1:49152 - "POST /node/68d66c302f83206171a9052a HTTP/1.0" 202 Accepted 2025-09-27 07:41:37,481 - lava_callback - INFO - Starting async job submit for node 68d66c302f83206171a9052a 2025-09-27 07:41:37,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:41:37,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c302f83206171a9052a HTTP/1.1" 200 None 2025-09-27 07:41:37,524 - lava_callback - DEBUG - Processing node 68d66c302f83206171a9052a: baseline-arm 2025-09-27 07:41:37,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:41:37,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:41:37,895 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c302f83206171a9052a/log.txt.gz 2025-09-27 07:41:37,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:41:38,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:41:38,038 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c302f83206171a9052a/lava_callback.json.gz 2025-09-27 07:41:38,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:41:38,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c302f83206171a9052a HTTP/1.1" 200 None 2025-09-27 07:41:38,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:41:38,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:41:38,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:41:38,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c302f83206171a9052a HTTP/1.1" 200 None 2025-09-27 07:41:38,125 - lava_callback - INFO - Completed processing callback for node 68d66c302f83206171a9052a INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:43:56,820 - lava_callback - INFO - Received callback for node 68d66c342f83206171a9052d INFO: 172.21.0.1:47806 - "POST /node/68d66c342f83206171a9052d HTTP/1.0" 202 Accepted 2025-09-27 07:43:56,826 - lava_callback - INFO - Starting async job submit for node 68d66c342f83206171a9052d 2025-09-27 07:43:56,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:43:56,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c342f83206171a9052d HTTP/1.1" 200 None 2025-09-27 07:43:56,859 - lava_callback - DEBUG - Processing node 68d66c342f83206171a9052d: baseline-arm 2025-09-27 07:43:57,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:43:57,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:43:57,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c342f83206171a9052d/log.txt.gz 2025-09-27 07:43:57,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:43:57,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:43:57,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c342f83206171a9052d/lava_callback.json.gz 2025-09-27 07:43:57,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:43:57,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c342f83206171a9052d HTTP/1.1" 200 None 2025-09-27 07:43:57,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:43:57,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:43:57,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:43:57,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c342f83206171a9052d HTTP/1.1" 200 None 2025-09-27 07:43:57,604 - lava_callback - INFO - Completed processing callback for node 68d66c342f83206171a9052d INFO: 172.21.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:45:44,757 - lava_callback - INFO - Received callback for node 68d6200c30c58dac7d9426e9 INFO: 172.21.0.1:34570 - "POST /node/68d6200c30c58dac7d9426e9 HTTP/1.0" 202 Accepted 2025-09-27 07:45:44,765 - lava_callback - INFO - Starting async job submit for node 68d6200c30c58dac7d9426e9 2025-09-27 07:45:44,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:45:44,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6200c30c58dac7d9426e9 HTTP/1.1" 200 None 2025-09-27 07:45:44,818 - lava_callback - DEBUG - Processing node 68d6200c30c58dac7d9426e9: baseline-arm64 INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:45:45,671 - lava_callback - ERROR - Error processing callback for node 68d6200c30c58dac7d9426e9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 07:46:16,072 - lava_callback - INFO - Received callback for node 68d66c342f83206171a90530 INFO: 172.21.0.1:39212 - "POST /node/68d66c342f83206171a90530 HTTP/1.0" 202 Accepted 2025-09-27 07:46:16,078 - lava_callback - INFO - Starting async job submit for node 68d66c342f83206171a90530 2025-09-27 07:46:16,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:46:16,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c342f83206171a90530 HTTP/1.1" 200 None 2025-09-27 07:46:16,114 - lava_callback - DEBUG - Processing node 68d66c342f83206171a90530: baseline-arm 2025-09-27 07:46:16,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:46:16,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:46:16,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c342f83206171a90530/log.txt.gz 2025-09-27 07:46:16,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:46:16,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:46:16,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c342f83206171a90530/lava_callback.json.gz 2025-09-27 07:46:16,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:46:16,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c342f83206171a90530 HTTP/1.1" 200 None 2025-09-27 07:46:16,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:46:16,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-27 07:46:16,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:46:16,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c342f83206171a90530 HTTP/1.1" 200 None 2025-09-27 07:46:16,712 - lava_callback - INFO - Completed processing callback for node 68d66c342f83206171a90530 2025-09-27 07:46:25,280 - lava_callback - INFO - Received callback for node 68d6351cc1bc82a30b37af5a INFO: 172.21.0.1:35456 - "POST /node/68d6351cc1bc82a30b37af5a HTTP/1.0" 202 Accepted 2025-09-27 07:46:25,287 - lava_callback - INFO - Starting async job submit for node 68d6351cc1bc82a30b37af5a 2025-09-27 07:46:25,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:46:25,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6351cc1bc82a30b37af5a HTTP/1.1" 200 None 2025-09-27 07:46:25,340 - lava_callback - DEBUG - Processing node 68d6351cc1bc82a30b37af5a: baseline-arm64 2025-09-27 07:46:26,163 - lava_callback - ERROR - Error processing callback for node 68d6351cc1bc82a30b37af5a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:46:53,339 - lava_callback - INFO - Received callback for node 68d63520c1bc82a30b37af75 INFO: 172.21.0.1:48056 - "POST /node/68d63520c1bc82a30b37af75 HTTP/1.0" 202 Accepted 2025-09-27 07:46:53,346 - lava_callback - INFO - Starting async job submit for node 68d63520c1bc82a30b37af75 2025-09-27 07:46:53,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:46:53,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63520c1bc82a30b37af75 HTTP/1.1" 200 None 2025-09-27 07:46:53,409 - lava_callback - DEBUG - Processing node 68d63520c1bc82a30b37af75: baseline-arm64 2025-09-27 07:46:54,229 - lava_callback - ERROR - Error processing callback for node 68d63520c1bc82a30b37af75: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 07:47:15,798 - lava_callback - INFO - Received callback for node 68d63b285d233c363a761f97 INFO: 172.21.0.1:59002 - "POST /node/68d63b285d233c363a761f97 HTTP/1.0" 202 Accepted 2025-09-27 07:47:15,804 - lava_callback - INFO - Starting async job submit for node 68d63b285d233c363a761f97 2025-09-27 07:47:15,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:47:15,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63b285d233c363a761f97 HTTP/1.1" 200 None 2025-09-27 07:47:15,838 - lava_callback - DEBUG - Processing node 68d63b285d233c363a761f97: baseline-arm64 2025-09-27 07:47:16,152 - lava_callback - ERROR - Error processing callback for node 68d63b285d233c363a761f97: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:47:55,490 - lava_callback - INFO - Received callback for node 68d63b285d233c363a761f9c INFO: 172.21.0.1:43032 - "POST /node/68d63b285d233c363a761f9c HTTP/1.0" 202 Accepted 2025-09-27 07:47:55,496 - lava_callback - INFO - Starting async job submit for node 68d63b285d233c363a761f9c 2025-09-27 07:47:55,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:47:55,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63b285d233c363a761f9c HTTP/1.1" 200 None 2025-09-27 07:47:55,549 - lava_callback - DEBUG - Processing node 68d63b285d233c363a761f9c: baseline-arm64 INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:47:55,842 - lava_callback - ERROR - Error processing callback for node 68d63b285d233c363a761f9c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:48:23,577 - lava_callback - INFO - Received callback for node 68d63b445d233c363a761fcf INFO: 172.21.0.1:34210 - "POST /node/68d63b445d233c363a761fcf HTTP/1.0" 202 Accepted 2025-09-27 07:48:23,582 - lava_callback - INFO - Starting async job submit for node 68d63b445d233c363a761fcf 2025-09-27 07:48:23,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:48:23,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63b445d233c363a761fcf HTTP/1.1" 200 None 2025-09-27 07:48:23,617 - lava_callback - DEBUG - Processing node 68d63b445d233c363a761fcf: baseline-arm64 2025-09-27 07:48:23,914 - lava_callback - ERROR - Error processing callback for node 68d63b445d233c363a761fcf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:48:31,213 - lava_callback - INFO - Received callback for node 68d63b445d233c363a761fd2 INFO: 172.21.0.1:32952 - "POST /node/68d63b445d233c363a761fd2 HTTP/1.0" 202 Accepted 2025-09-27 07:48:31,219 - lava_callback - INFO - Starting async job submit for node 68d63b445d233c363a761fd2 2025-09-27 07:48:31,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:48:31,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63b445d233c363a761fd2 HTTP/1.1" 200 None 2025-09-27 07:48:31,411 - lava_callback - DEBUG - Processing node 68d63b445d233c363a761fd2: baseline-arm64 2025-09-27 07:48:31,728 - lava_callback - ERROR - Error processing callback for node 68d63b445d233c363a761fd2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:49:30,417 - lava_callback - INFO - Received callback for node 68d66f042f83206171a90a65 INFO: 172.21.0.1:41674 - "POST /node/68d66f042f83206171a90a65 HTTP/1.0" 202 Accepted 2025-09-27 07:49:30,423 - lava_callback - INFO - Starting async job submit for node 68d66f042f83206171a90a65 2025-09-27 07:49:30,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:49:30,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f042f83206171a90a65 HTTP/1.1" 200 None 2025-09-27 07:49:30,457 - lava_callback - DEBUG - Processing node 68d66f042f83206171a90a65: baseline-arm 2025-09-27 07:49:30,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:49:30,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:49:30,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f042f83206171a90a65/log.txt.gz 2025-09-27 07:49:30,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:49:31,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:49:31,031 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f042f83206171a90a65/lava_callback.json.gz 2025-09-27 07:49:31,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:49:31,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f042f83206171a90a65 HTTP/1.1" 200 None 2025-09-27 07:49:31,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:49:31,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 07:49:31,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:49:31,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f042f83206171a90a65 HTTP/1.1" 200 None 2025-09-27 07:49:31,130 - lava_callback - INFO - Completed processing callback for node 68d66f042f83206171a90a65 INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:49:40,748 - lava_callback - INFO - Received callback for node 68d63ee55d233c363a7620e7 INFO: 172.21.0.1:52496 - "POST /node/68d63ee55d233c363a7620e7 HTTP/1.0" 202 Accepted 2025-09-27 07:49:40,754 - lava_callback - INFO - Starting async job submit for node 68d63ee55d233c363a7620e7 2025-09-27 07:49:40,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:49:40,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63ee55d233c363a7620e7 HTTP/1.1" 200 None 2025-09-27 07:49:40,787 - lava_callback - DEBUG - Processing node 68d63ee55d233c363a7620e7: baseline-arm64 2025-09-27 07:49:41,133 - lava_callback - ERROR - Error processing callback for node 68d63ee55d233c363a7620e7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:49:51,919 - lava_callback - INFO - Received callback for node 68d63ee65d233c363a7620ea INFO: 172.21.0.1:57016 - "POST /node/68d63ee65d233c363a7620ea HTTP/1.0" 202 Accepted 2025-09-27 07:49:51,925 - lava_callback - INFO - Starting async job submit for node 68d63ee65d233c363a7620ea 2025-09-27 07:49:51,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:49:51,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63ee65d233c363a7620ea HTTP/1.1" 200 None 2025-09-27 07:49:51,967 - lava_callback - DEBUG - Processing node 68d63ee65d233c363a7620ea: baseline-arm64 2025-09-27 07:49:52,315 - lava_callback - ERROR - Error processing callback for node 68d63ee65d233c363a7620ea: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:50:30,497 - lava_callback - INFO - Received callback for node 68d63f025d233c363a76211d INFO: 172.21.0.1:57044 - "POST /node/68d63f025d233c363a76211d HTTP/1.0" 202 Accepted 2025-09-27 07:50:30,503 - lava_callback - INFO - Starting async job submit for node 68d63f025d233c363a76211d 2025-09-27 07:50:30,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:50:30,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63f025d233c363a76211d HTTP/1.1" 200 None 2025-09-27 07:50:30,554 - lava_callback - DEBUG - Processing node 68d63f025d233c363a76211d: baseline-arm64 2025-09-27 07:50:30,888 - lava_callback - ERROR - Error processing callback for node 68d63f025d233c363a76211d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:50:51,752 - lava_callback - INFO - Received callback for node 68d63f025d233c363a762120 INFO: 172.21.0.1:51894 - "POST /node/68d63f025d233c363a762120 HTTP/1.0" 202 Accepted 2025-09-27 07:50:51,758 - lava_callback - INFO - Starting async job submit for node 68d63f025d233c363a762120 2025-09-27 07:50:51,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:50:51,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63f025d233c363a762120 HTTP/1.1" 200 None 2025-09-27 07:50:51,795 - lava_callback - DEBUG - Processing node 68d63f025d233c363a762120: baseline-arm64 2025-09-27 07:50:52,147 - lava_callback - ERROR - Error processing callback for node 68d63f025d233c363a762120: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:51:12,522 - lava_callback - INFO - Received callback for node 68d63ff55d233c363a762182 INFO: 172.21.0.1:57836 - "POST /node/68d63ff55d233c363a762182 HTTP/1.0" 202 Accepted 2025-09-27 07:51:12,528 - lava_callback - INFO - Starting async job submit for node 68d63ff55d233c363a762182 2025-09-27 07:51:12,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:51:12,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63ff55d233c363a762182 HTTP/1.1" 200 None 2025-09-27 07:51:12,562 - lava_callback - DEBUG - Processing node 68d63ff55d233c363a762182: baseline-arm64 2025-09-27 07:51:12,893 - lava_callback - ERROR - Error processing callback for node 68d63ff55d233c363a762182: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:51:55,837 - lava_callback - INFO - Received callback for node 68d66f052f83206171a90a68 INFO: 172.21.0.1:53870 - "POST /node/68d66f052f83206171a90a68 HTTP/1.0" 202 Accepted 2025-09-27 07:51:55,843 - lava_callback - INFO - Starting async job submit for node 68d66f052f83206171a90a68 2025-09-27 07:51:55,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:51:55,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f052f83206171a90a68 HTTP/1.1" 200 None 2025-09-27 07:51:55,876 - lava_callback - DEBUG - Processing node 68d66f052f83206171a90a68: baseline-arm 2025-09-27 07:51:56,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:51:56,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:51:56,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f052f83206171a90a68/log.txt.gz 2025-09-27 07:51:56,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:51:56,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:51:56,399 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f052f83206171a90a68/lava_callback.json.gz 2025-09-27 07:51:56,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:51:56,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f052f83206171a90a68 HTTP/1.1" 200 None 2025-09-27 07:51:56,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:51:56,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 07:51:56,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:51:56,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f052f83206171a90a68 HTTP/1.1" 200 None 2025-09-27 07:51:56,499 - lava_callback - INFO - Completed processing callback for node 68d66f052f83206171a90a68 INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:52:07,084 - lava_callback - INFO - Received callback for node 68d63ffa5d233c363a76219d INFO: 172.21.0.1:58944 - "POST /node/68d63ffa5d233c363a76219d HTTP/1.0" 202 Accepted 2025-09-27 07:52:07,090 - lava_callback - INFO - Starting async job submit for node 68d63ffa5d233c363a76219d 2025-09-27 07:52:07,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:52:07,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d63ffa5d233c363a76219d HTTP/1.1" 200 None 2025-09-27 07:52:07,123 - lava_callback - DEBUG - Processing node 68d63ffa5d233c363a76219d: baseline-arm64 2025-09-27 07:52:07,455 - lava_callback - ERROR - Error processing callback for node 68d63ffa5d233c363a76219d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:53:46,093 - lava_callback - INFO - Received callback for node 68d65290cca86fb17472aa81 INFO: 172.21.0.1:49768 - "POST /node/68d65290cca86fb17472aa81 HTTP/1.0" 202 Accepted 2025-09-27 07:53:46,099 - lava_callback - INFO - Starting async job submit for node 68d65290cca86fb17472aa81 2025-09-27 07:53:46,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:53:46,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65290cca86fb17472aa81 HTTP/1.1" 200 None 2025-09-27 07:53:46,144 - lava_callback - DEBUG - Processing node 68d65290cca86fb17472aa81: baseline-arm64 2025-09-27 07:53:46,473 - lava_callback - ERROR - Error processing callback for node 68d65290cca86fb17472aa81: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39564 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:54:01,015 - lava_callback - INFO - Received callback for node 68d65297cca86fb17472aa9c INFO: 172.21.0.1:46022 - "POST /node/68d65297cca86fb17472aa9c HTTP/1.0" 202 Accepted 2025-09-27 07:54:01,021 - lava_callback - INFO - Starting async job submit for node 68d65297cca86fb17472aa9c 2025-09-27 07:54:01,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:54:01,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65297cca86fb17472aa9c HTTP/1.1" 200 None 2025-09-27 07:54:01,054 - lava_callback - DEBUG - Processing node 68d65297cca86fb17472aa9c: baseline-arm64 2025-09-27 07:54:01,407 - lava_callback - ERROR - Error processing callback for node 68d65297cca86fb17472aa9c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46024 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:54:14,048 - lava_callback - INFO - Received callback for node 68d65374cca86fb17472ab22 INFO: 172.21.0.1:59558 - "POST /node/68d65374cca86fb17472ab22 HTTP/1.0" 202 Accepted 2025-09-27 07:54:14,054 - lava_callback - INFO - Starting async job submit for node 68d65374cca86fb17472ab22 2025-09-27 07:54:14,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:54:14,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65374cca86fb17472ab22 HTTP/1.1" 200 None 2025-09-27 07:54:14,107 - lava_callback - DEBUG - Processing node 68d65374cca86fb17472ab22: baseline-arm64 2025-09-27 07:54:14,407 - lava_callback - ERROR - Error processing callback for node 68d65374cca86fb17472ab22: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:54:16,902 - lava_callback - INFO - Received callback for node 68d66f092f83206171a90a6b INFO: 172.21.0.1:59592 - "POST /node/68d66f092f83206171a90a6b HTTP/1.0" 202 Accepted 2025-09-27 07:54:16,908 - lava_callback - INFO - Starting async job submit for node 68d66f092f83206171a90a6b 2025-09-27 07:54:16,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:54:16,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f092f83206171a90a6b HTTP/1.1" 200 None 2025-09-27 07:54:16,964 - lava_callback - DEBUG - Processing node 68d66f092f83206171a90a6b: baseline-arm 2025-09-27 07:54:17,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:54:17,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:54:17,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f092f83206171a90a6b/log.txt.gz 2025-09-27 07:54:17,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:54:17,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:54:17,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f092f83206171a90a6b/lava_callback.json.gz 2025-09-27 07:54:17,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:54:17,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f092f83206171a90a6b HTTP/1.1" 200 None 2025-09-27 07:54:17,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:54:17,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 07:54:17,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:54:17,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f092f83206171a90a6b HTTP/1.1" 200 None 2025-09-27 07:54:17,589 - lava_callback - INFO - Completed processing callback for node 68d66f092f83206171a90a6b 2025-09-27 07:54:22,112 - lava_callback - INFO - Received callback for node 68d4fcb6ef0c6c1c70206025 INFO: 172.21.0.1:56022 - "POST /node/68d4fcb6ef0c6c1c70206025 HTTP/1.0" 202 Accepted 2025-09-27 07:54:22,118 - lava_callback - INFO - Starting async job submit for node 68d4fcb6ef0c6c1c70206025 2025-09-27 07:54:22,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:54:22,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcb6ef0c6c1c70206025 HTTP/1.1" 200 None 2025-09-27 07:54:22,162 - lava_callback - DEBUG - Processing node 68d4fcb6ef0c6c1c70206025: baseline-arm 2025-09-27 07:54:22,431 - lava_callback - ERROR - Error processing callback for node 68d4fcb6ef0c6c1c70206025: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:55:11,335 - lava_callback - INFO - Received callback for node 68d65378cca86fb17472ab3f INFO: 172.21.0.1:48588 - "POST /node/68d65378cca86fb17472ab3f HTTP/1.0" 202 Accepted 2025-09-27 07:55:11,341 - lava_callback - INFO - Starting async job submit for node 68d65378cca86fb17472ab3f 2025-09-27 07:55:11,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:55:11,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65378cca86fb17472ab3f HTTP/1.1" 200 None 2025-09-27 07:55:11,374 - lava_callback - DEBUG - Processing node 68d65378cca86fb17472ab3f: baseline-arm64 2025-09-27 07:55:11,676 - lava_callback - ERROR - Error processing callback for node 68d65378cca86fb17472ab3f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 07:55:13,461 - lava_callback - INFO - Received callback for node 68d73e8ba6a7b6615d4c4b42 INFO: 172.21.0.1:48604 - "POST /node/68d73e8ba6a7b6615d4c4b42 HTTP/1.0" 202 Accepted 2025-09-27 07:55:13,466 - lava_callback - INFO - Starting async job submit for node 68d73e8ba6a7b6615d4c4b42 2025-09-27 07:55:13,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:55:13,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73e8ba6a7b6615d4c4b42 HTTP/1.1" 200 None 2025-09-27 07:55:13,528 - lava_callback - DEBUG - Processing node 68d73e8ba6a7b6615d4c4b42: baseline-x86-kcidebug-intel 2025-09-27 07:55:13,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:55:13,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:55:13,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d73e8ba6a7b6615d4c4b42/log.txt.gz 2025-09-27 07:55:13,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:55:14,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:55:14,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d73e8ba6a7b6615d4c4b42/lava_callback.json.gz DEBUG: Setup failed for 68d73e8ba6a7b6615d4c4b42. Transitting job node result: incomplete -> fail 2025-09-27 07:55:14,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:55:14,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73e8ba6a7b6615d4c4b42 HTTP/1.1" 200 None 2025-09-27 07:55:14,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:55:14,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a4d3c94e462c68828c2 HTTP/1.1" 200 None 2025-09-27 07:55:14,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:55:14,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73e8ba6a7b6615d4c4b42 HTTP/1.1" 200 None 2025-09-27 07:55:14,217 - lava_callback - INFO - Completed processing callback for node 68d73e8ba6a7b6615d4c4b42 INFO: 172.21.0.1:48618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:56:38,084 - lava_callback - INFO - Received callback for node 68d66f0b2f83206171a90a6e INFO: 172.21.0.1:44440 - "POST /node/68d66f0b2f83206171a90a6e HTTP/1.0" 202 Accepted 2025-09-27 07:56:38,090 - lava_callback - INFO - Starting async job submit for node 68d66f0b2f83206171a90a6e 2025-09-27 07:56:38,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:56:38,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f0b2f83206171a90a6e HTTP/1.1" 200 None 2025-09-27 07:56:38,144 - lava_callback - DEBUG - Processing node 68d66f0b2f83206171a90a6e: baseline-arm 2025-09-27 07:56:38,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:56:38,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:56:38,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f0b2f83206171a90a6e/log.txt.gz 2025-09-27 07:56:38,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:56:38,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:56:38,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f0b2f83206171a90a6e/lava_callback.json.gz 2025-09-27 07:56:38,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:56:38,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f0b2f83206171a90a6e HTTP/1.1" 200 None 2025-09-27 07:56:38,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:56:38,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 07:56:38,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:56:38,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f0b2f83206171a90a6e HTTP/1.1" 200 None 2025-09-27 07:56:38,822 - lava_callback - INFO - Completed processing callback for node 68d66f0b2f83206171a90a6e INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:58:57,458 - lava_callback - INFO - Received callback for node 68d66f0e2f83206171a90a7c INFO: 172.21.0.1:41124 - "POST /node/68d66f0e2f83206171a90a7c HTTP/1.0" 202 Accepted 2025-09-27 07:58:57,464 - lava_callback - INFO - Starting async job submit for node 68d66f0e2f83206171a90a7c 2025-09-27 07:58:57,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:58:57,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f0e2f83206171a90a7c HTTP/1.1" 200 None 2025-09-27 07:58:57,517 - lava_callback - DEBUG - Processing node 68d66f0e2f83206171a90a7c: baseline-arm 2025-09-27 07:58:57,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:58:57,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:58:57,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f0e2f83206171a90a7c/log.txt.gz 2025-09-27 07:58:57,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:58:58,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:58:58,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f0e2f83206171a90a7c/lava_callback.json.gz 2025-09-27 07:58:58,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:58:58,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f0e2f83206171a90a7c HTTP/1.1" 200 None 2025-09-27 07:58:58,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:58:58,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 07:58:58,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:58:58,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f0e2f83206171a90a7c HTTP/1.1" 200 None 2025-09-27 07:58:58,179 - lava_callback - INFO - Completed processing callback for node 68d66f0e2f83206171a90a7c INFO: 172.21.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK 2025-09-27 07:59:11,339 - lava_callback - INFO - Received callback for node 68d665d22f83206171a90293 INFO: 172.21.0.1:49066 - "POST /node/68d665d22f83206171a90293 HTTP/1.0" 202 Accepted 2025-09-27 07:59:11,345 - lava_callback - INFO - Starting async job submit for node 68d665d22f83206171a90293 2025-09-27 07:59:11,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:59:11,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d22f83206171a90293 HTTP/1.1" 200 None 2025-09-27 07:59:11,379 - lava_callback - DEBUG - Processing node 68d665d22f83206171a90293: baseline-arm64 2025-09-27 07:59:11,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:59:11,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:59:11,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d22f83206171a90293/log.txt.gz 2025-09-27 07:59:11,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 07:59:11,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 07:59:11,951 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d22f83206171a90293/lava_callback.json.gz 2025-09-27 07:59:11,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:59:11,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d22f83206171a90293 HTTP/1.1" 200 None 2025-09-27 07:59:11,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:59:12,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 07:59:12,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 07:59:12,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d22f83206171a90293 HTTP/1.1" 200 None 2025-09-27 07:59:12,044 - lava_callback - INFO - Completed processing callback for node 68d665d22f83206171a90293 INFO: 172.21.0.1:49070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:00:31,179 - lava_callback - INFO - Received callback for node 68d665da2f83206171a902ae INFO: 172.21.0.1:34496 - "POST /node/68d665da2f83206171a902ae HTTP/1.0" 202 Accepted 2025-09-27 08:00:31,185 - lava_callback - INFO - Starting async job submit for node 68d665da2f83206171a902ae 2025-09-27 08:00:31,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:00:31,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665da2f83206171a902ae HTTP/1.1" 200 None 2025-09-27 08:00:31,218 - lava_callback - DEBUG - Processing node 68d665da2f83206171a902ae: baseline-arm64 2025-09-27 08:00:31,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:00:31,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:00:31,680 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665da2f83206171a902ae/log.txt.gz 2025-09-27 08:00:31,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:00:31,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:00:31,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665da2f83206171a902ae/lava_callback.json.gz 2025-09-27 08:00:31,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:00:31,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665da2f83206171a902ae HTTP/1.1" 200 None 2025-09-27 08:00:31,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:00:32,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 08:00:32,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:00:32,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665da2f83206171a902ae HTTP/1.1" 200 None 2025-09-27 08:00:32,030 - lava_callback - INFO - Completed processing callback for node 68d665da2f83206171a902ae INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:01:17,280 - lava_callback - INFO - Received callback for node 68d66f0f2f83206171a90a7f INFO: 172.21.0.1:41068 - "POST /node/68d66f0f2f83206171a90a7f HTTP/1.0" 202 Accepted 2025-09-27 08:01:17,286 - lava_callback - INFO - Starting async job submit for node 68d66f0f2f83206171a90a7f 2025-09-27 08:01:17,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:01:17,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f0f2f83206171a90a7f HTTP/1.1" 200 None 2025-09-27 08:01:17,341 - lava_callback - DEBUG - Processing node 68d66f0f2f83206171a90a7f: baseline-arm 2025-09-27 08:01:17,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:01:17,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:01:17,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f0f2f83206171a90a7f/log.txt.gz 2025-09-27 08:01:17,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:01:17,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:01:17,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f0f2f83206171a90a7f/lava_callback.json.gz 2025-09-27 08:01:17,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:01:17,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f0f2f83206171a90a7f HTTP/1.1" 200 None 2025-09-27 08:01:17,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:01:17,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 08:01:17,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:01:17,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f0f2f83206171a90a7f HTTP/1.1" 200 None 2025-09-27 08:01:17,978 - lava_callback - INFO - Completed processing callback for node 68d66f0f2f83206171a90a7f INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:01:51,814 - lava_callback - INFO - Received callback for node 68d66d422f83206171a90681 INFO: 172.21.0.1:51224 - "POST /node/68d66d422f83206171a90681 HTTP/1.0" 202 Accepted 2025-09-27 08:01:51,820 - lava_callback - INFO - Starting async job submit for node 68d66d422f83206171a90681 2025-09-27 08:01:51,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:01:51,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d422f83206171a90681 HTTP/1.1" 200 None 2025-09-27 08:01:51,868 - lava_callback - DEBUG - Processing node 68d66d422f83206171a90681: baseline-arm64 2025-09-27 08:01:52,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:01:52,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:01:52,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d422f83206171a90681/log.txt.gz 2025-09-27 08:01:52,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:01:52,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:01:52,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d422f83206171a90681/lava_callback.json.gz 2025-09-27 08:01:52,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:01:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d422f83206171a90681 HTTP/1.1" 200 None 2025-09-27 08:01:52,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:01:52,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:01:52,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:01:52,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d422f83206171a90681 HTTP/1.1" 200 None 2025-09-27 08:01:52,618 - lava_callback - INFO - Completed processing callback for node 68d66d422f83206171a90681 INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:03:36,666 - lava_callback - INFO - Received callback for node 68d66f102f83206171a90a82 INFO: 172.21.0.1:58466 - "POST /node/68d66f102f83206171a90a82 HTTP/1.0" 202 Accepted 2025-09-27 08:03:36,672 - lava_callback - INFO - Starting async job submit for node 68d66f102f83206171a90a82 2025-09-27 08:03:36,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:03:36,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f102f83206171a90a82 HTTP/1.1" 200 None 2025-09-27 08:03:36,707 - lava_callback - DEBUG - Processing node 68d66f102f83206171a90a82: baseline-arm 2025-09-27 08:03:36,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:03:37,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:03:37,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f102f83206171a90a82/log.txt.gz 2025-09-27 08:03:37,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:03:37,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:03:37,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f102f83206171a90a82/lava_callback.json.gz 2025-09-27 08:03:37,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:03:37,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f102f83206171a90a82 HTTP/1.1" 200 None 2025-09-27 08:03:37,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:03:37,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 08:03:37,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:03:37,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f102f83206171a90a82 HTTP/1.1" 200 None 2025-09-27 08:03:37,314 - lava_callback - INFO - Completed processing callback for node 68d66f102f83206171a90a82 2025-09-27 08:03:43,827 - lava_callback - INFO - Received callback for node 68d66d452f83206171a90688 INFO: 172.21.0.1:53858 - "POST /node/68d66d452f83206171a90688 HTTP/1.0" 202 Accepted 2025-09-27 08:03:43,833 - lava_callback - INFO - Starting async job submit for node 68d66d452f83206171a90688 2025-09-27 08:03:43,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:03:43,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d452f83206171a90688 HTTP/1.1" 200 None 2025-09-27 08:03:43,873 - lava_callback - DEBUG - Processing node 68d66d452f83206171a90688: baseline-arm64 2025-09-27 08:03:44,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:03:44,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:03:44,372 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d452f83206171a90688/log.txt.gz 2025-09-27 08:03:44,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:03:44,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:03:44,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d452f83206171a90688/lava_callback.json.gz 2025-09-27 08:03:44,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:03:44,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d452f83206171a90688 HTTP/1.1" 200 None 2025-09-27 08:03:44,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:03:44,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:03:44,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:03:44,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d452f83206171a90688 HTTP/1.1" 200 None 2025-09-27 08:03:44,604 - lava_callback - INFO - Completed processing callback for node 68d66d452f83206171a90688 INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:05:11,538 - lava_callback - INFO - Received callback for node 68d66d492f83206171a9068b INFO: 172.21.0.1:33884 - "POST /node/68d66d492f83206171a9068b HTTP/1.0" 202 Accepted 2025-09-27 08:05:11,544 - lava_callback - INFO - Starting async job submit for node 68d66d492f83206171a9068b 2025-09-27 08:05:11,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:05:11,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d492f83206171a9068b HTTP/1.1" 200 None 2025-09-27 08:05:11,577 - lava_callback - DEBUG - Processing node 68d66d492f83206171a9068b: baseline-arm64 2025-09-27 08:05:11,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:05:12,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:05:12,075 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d492f83206171a9068b/log.txt.gz 2025-09-27 08:05:12,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:05:12,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:05:12,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d492f83206171a9068b/lava_callback.json.gz 2025-09-27 08:05:12,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:05:12,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d492f83206171a9068b HTTP/1.1" 200 None 2025-09-27 08:05:12,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:05:12,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:05:12,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:05:12,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d492f83206171a9068b HTTP/1.1" 200 None 2025-09-27 08:05:12,316 - lava_callback - INFO - Completed processing callback for node 68d66d492f83206171a9068b INFO: 172.21.0.1:33886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:05:57,558 - lava_callback - INFO - Received callback for node 68d66f112f83206171a90a85 INFO: 172.21.0.1:51018 - "POST /node/68d66f112f83206171a90a85 HTTP/1.0" 202 Accepted 2025-09-27 08:05:57,569 - lava_callback - INFO - Starting async job submit for node 68d66f112f83206171a90a85 2025-09-27 08:05:57,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:05:57,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f112f83206171a90a85 HTTP/1.1" 200 None 2025-09-27 08:05:57,717 - lava_callback - DEBUG - Processing node 68d66f112f83206171a90a85: baseline-arm 2025-09-27 08:05:58,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:05:58,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:05:58,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f112f83206171a90a85/log.txt.gz 2025-09-27 08:05:58,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:05:58,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:05:58,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f112f83206171a90a85/lava_callback.json.gz 2025-09-27 08:05:58,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:05:58,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f112f83206171a90a85 HTTP/1.1" 200 None 2025-09-27 08:05:58,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:05:58,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 08:05:58,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:05:58,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f112f83206171a90a85 HTTP/1.1" 200 None 2025-09-27 08:05:58,564 - lava_callback - INFO - Completed processing callback for node 68d66f112f83206171a90a85 INFO: 172.21.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:07:00,242 - lava_callback - INFO - Received callback for node 68d66d4c2f83206171a9068e INFO: 172.21.0.1:55712 - "POST /node/68d66d4c2f83206171a9068e HTTP/1.0" 202 Accepted 2025-09-27 08:07:00,248 - lava_callback - INFO - Starting async job submit for node 68d66d4c2f83206171a9068e 2025-09-27 08:07:00,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:07:00,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d4c2f83206171a9068e HTTP/1.1" 200 None 2025-09-27 08:07:00,289 - lava_callback - DEBUG - Processing node 68d66d4c2f83206171a9068e: baseline-arm64 INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:07:00,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:07:00,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:07:00,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d4c2f83206171a9068e/log.txt.gz 2025-09-27 08:07:00,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:07:00,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:07:00,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d4c2f83206171a9068e/lava_callback.json.gz 2025-09-27 08:07:00,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:07:01,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d4c2f83206171a9068e HTTP/1.1" 200 None 2025-09-27 08:07:01,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:07:01,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:07:01,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:07:01,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d4c2f83206171a9068e HTTP/1.1" 200 None 2025-09-27 08:07:01,078 - lava_callback - INFO - Completed processing callback for node 68d66d4c2f83206171a9068e INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:07:24,765 - lava_callback - INFO - Received callback for node 68d4fe71ef0c6c1c702061b3 INFO: 172.21.0.1:43056 - "POST /node/68d4fe71ef0c6c1c702061b3 HTTP/1.0" 202 Accepted 2025-09-27 08:07:24,771 - lava_callback - INFO - Starting async job submit for node 68d4fe71ef0c6c1c702061b3 2025-09-27 08:07:24,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:07:24,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fe71ef0c6c1c702061b3 HTTP/1.1" 200 None 2025-09-27 08:07:24,808 - lava_callback - DEBUG - Processing node 68d4fe71ef0c6c1c702061b3: baseline-arm-broonie 2025-09-27 08:07:24,994 - lava_callback - ERROR - Error processing callback for node 68d4fe71ef0c6c1c702061b3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:08:18,000 - lava_callback - INFO - Received callback for node 68d66d4f2f83206171a90695 INFO: 172.21.0.1:49592 - "POST /node/68d66d4f2f83206171a90695 HTTP/1.0" 202 Accepted 2025-09-27 08:08:18,006 - lava_callback - INFO - Starting async job submit for node 68d66d4f2f83206171a90695 2025-09-27 08:08:18,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:08:18,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d4f2f83206171a90695 HTTP/1.1" 200 None 2025-09-27 08:08:18,045 - lava_callback - DEBUG - Processing node 68d66d4f2f83206171a90695: baseline-arm64 2025-09-27 08:08:18,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:08:18,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:08:18,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d4f2f83206171a90695/log.txt.gz 2025-09-27 08:08:18,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:08:18,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:08:18,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d4f2f83206171a90695/lava_callback.json.gz 2025-09-27 08:08:18,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:08:18,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d4f2f83206171a90695 HTTP/1.1" 200 None 2025-09-27 08:08:18,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:08:18,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:08:18,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:08:18,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d4f2f83206171a90695 HTTP/1.1" 200 None 2025-09-27 08:08:18,771 - lava_callback - INFO - Completed processing callback for node 68d66d4f2f83206171a90695 2025-09-27 08:08:19,483 - lava_callback - INFO - Received callback for node 68d66f3c2f83206171a90af0 INFO: 172.21.0.1:54486 - "POST /node/68d66f3c2f83206171a90af0 HTTP/1.0" 202 Accepted 2025-09-27 08:08:19,489 - lava_callback - INFO - Starting async job submit for node 68d66f3c2f83206171a90af0 2025-09-27 08:08:19,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:08:19,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f3c2f83206171a90af0 HTTP/1.1" 200 None 2025-09-27 08:08:19,524 - lava_callback - DEBUG - Processing node 68d66f3c2f83206171a90af0: baseline-arm 2025-09-27 08:08:19,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:08:19,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:08:19,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f3c2f83206171a90af0/log.txt.gz 2025-09-27 08:08:19,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:08:20,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:08:20,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f3c2f83206171a90af0/lava_callback.json.gz 2025-09-27 08:08:20,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:08:20,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f3c2f83206171a90af0 HTTP/1.1" 200 None 2025-09-27 08:08:20,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:08:20,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 08:08:20,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:08:20,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f3c2f83206171a90af0 HTTP/1.1" 200 None 2025-09-27 08:08:20,096 - lava_callback - INFO - Completed processing callback for node 68d66f3c2f83206171a90af0 INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:09:31,441 - lava_callback - INFO - Received callback for node 68d66d522f83206171a906ab INFO: 172.21.0.1:49130 - "POST /node/68d66d522f83206171a906ab HTTP/1.0" 202 Accepted 2025-09-27 08:09:31,447 - lava_callback - INFO - Starting async job submit for node 68d66d522f83206171a906ab 2025-09-27 08:09:31,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:09:31,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d522f83206171a906ab HTTP/1.1" 200 None 2025-09-27 08:09:31,480 - lava_callback - DEBUG - Processing node 68d66d522f83206171a906ab: baseline-arm64 2025-09-27 08:09:31,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:09:31,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:09:31,972 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d522f83206171a906ab/log.txt.gz 2025-09-27 08:09:31,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:09:32,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:09:32,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d522f83206171a906ab/lava_callback.json.gz 2025-09-27 08:09:32,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:09:32,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d522f83206171a906ab HTTP/1.1" 200 None 2025-09-27 08:09:32,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:09:32,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:09:32,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:09:32,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d522f83206171a906ab HTTP/1.1" 200 None 2025-09-27 08:09:32,234 - lava_callback - INFO - Completed processing callback for node 68d66d522f83206171a906ab INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56330 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:10:37,351 - lava_callback - INFO - Received callback for node 68d66f3c2f83206171a90af3 INFO: 172.21.0.1:56344 - "POST /node/68d66f3c2f83206171a90af3 HTTP/1.0" 202 Accepted 2025-09-27 08:10:37,357 - lava_callback - INFO - Starting async job submit for node 68d66f3c2f83206171a90af3 2025-09-27 08:10:37,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:10:37,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f3c2f83206171a90af3 HTTP/1.1" 200 None 2025-09-27 08:10:37,410 - lava_callback - DEBUG - Processing node 68d66f3c2f83206171a90af3: baseline-arm 2025-09-27 08:10:37,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:10:37,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:10:37,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f3c2f83206171a90af3/log.txt.gz 2025-09-27 08:10:37,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:10:37,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:10:37,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f3c2f83206171a90af3/lava_callback.json.gz 2025-09-27 08:10:37,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:10:37,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f3c2f83206171a90af3 HTTP/1.1" 200 None 2025-09-27 08:10:37,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:10:38,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 08:10:38,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:10:38,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f3c2f83206171a90af3 HTTP/1.1" 200 None 2025-09-27 08:10:38,049 - lava_callback - INFO - Completed processing callback for node 68d66f3c2f83206171a90af3 INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:10:52,602 - lava_callback - INFO - Received callback for node 68d66d592f83206171a906c6 INFO: 172.21.0.1:49226 - "POST /node/68d66d592f83206171a906c6 HTTP/1.0" 202 Accepted 2025-09-27 08:10:52,608 - lava_callback - INFO - Starting async job submit for node 68d66d592f83206171a906c6 2025-09-27 08:10:52,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:10:52,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d592f83206171a906c6 HTTP/1.1" 200 None 2025-09-27 08:10:52,646 - lava_callback - DEBUG - Processing node 68d66d592f83206171a906c6: baseline-arm64 2025-09-27 08:10:52,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:10:53,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:10:53,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d592f83206171a906c6/log.txt.gz 2025-09-27 08:10:53,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:10:53,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:10:53,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d592f83206171a906c6/lava_callback.json.gz 2025-09-27 08:10:53,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:10:53,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d592f83206171a906c6 HTTP/1.1" 200 None 2025-09-27 08:10:53,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:10:53,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:10:53,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:10:53,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d592f83206171a906c6 HTTP/1.1" 200 None 2025-09-27 08:10:53,310 - lava_callback - INFO - Completed processing callback for node 68d66d592f83206171a906c6 INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:11:45,162 - lava_callback - INFO - Received callback for node 68d4fe84ef0c6c1c702061ce INFO: 172.21.0.1:41434 - "POST /node/68d4fe84ef0c6c1c702061ce HTTP/1.0" 202 Accepted 2025-09-27 08:11:45,168 - lava_callback - INFO - Starting async job submit for node 68d4fe84ef0c6c1c702061ce 2025-09-27 08:11:45,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:11:45,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fe84ef0c6c1c702061ce HTTP/1.1" 200 None 2025-09-27 08:11:45,235 - lava_callback - DEBUG - Processing node 68d4fe84ef0c6c1c702061ce: ltp-cap-bounds 2025-09-27 08:11:45,593 - lava_callback - ERROR - Error processing callback for node 68d4fe84ef0c6c1c702061ce: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:12:15,027 - lava_callback - INFO - Received callback for node 68d66d5a2f83206171a906cd INFO: 172.21.0.1:58726 - "POST /node/68d66d5a2f83206171a906cd HTTP/1.0" 202 Accepted 2025-09-27 08:12:15,033 - lava_callback - INFO - Starting async job submit for node 68d66d5a2f83206171a906cd 2025-09-27 08:12:15,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:12:15,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d5a2f83206171a906cd HTTP/1.1" 200 None 2025-09-27 08:12:15,067 - lava_callback - DEBUG - Processing node 68d66d5a2f83206171a906cd: baseline-arm64 INFO: 172.21.0.1:58742 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 08:12:15,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:12:15,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:12:15,554 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d5a2f83206171a906cd/log.txt.gz 2025-09-27 08:12:15,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:12:15,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:12:15,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d5a2f83206171a906cd/lava_callback.json.gz 2025-09-27 08:12:15,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:12:15,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d5a2f83206171a906cd HTTP/1.1" 200 None 2025-09-27 08:12:15,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:12:15,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:12:15,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:12:15,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d5a2f83206171a906cd HTTP/1.1" 200 None 2025-09-27 08:12:15,777 - lava_callback - INFO - Completed processing callback for node 68d66d5a2f83206171a906cd INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55912 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:12:57,631 - lava_callback - INFO - Received callback for node 68d66f3e2f83206171a90af6 INFO: 172.21.0.1:55928 - "POST /node/68d66f3e2f83206171a90af6 HTTP/1.0" 202 Accepted 2025-09-27 08:12:57,637 - lava_callback - INFO - Starting async job submit for node 68d66f3e2f83206171a90af6 2025-09-27 08:12:57,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:12:57,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f3e2f83206171a90af6 HTTP/1.1" 200 None 2025-09-27 08:12:57,687 - lava_callback - DEBUG - Processing node 68d66f3e2f83206171a90af6: baseline-arm 2025-09-27 08:12:57,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:12:58,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:12:58,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f3e2f83206171a90af6/log.txt.gz 2025-09-27 08:12:58,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:12:58,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:12:58,196 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f3e2f83206171a90af6/lava_callback.json.gz 2025-09-27 08:12:58,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:12:58,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f3e2f83206171a90af6 HTTP/1.1" 200 None 2025-09-27 08:12:58,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:12:58,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 08:12:58,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:12:58,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f3e2f83206171a90af6 HTTP/1.1" 200 None 2025-09-27 08:12:58,311 - lava_callback - INFO - Completed processing callback for node 68d66f3e2f83206171a90af6 INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33542 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:13:32,335 - lava_callback - INFO - Received callback for node 68d66e162f83206171a90865 INFO: 172.21.0.1:42696 - "POST /node/68d66e162f83206171a90865 HTTP/1.0" 202 Accepted 2025-09-27 08:13:32,341 - lava_callback - INFO - Starting async job submit for node 68d66e162f83206171a90865 2025-09-27 08:13:32,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:13:32,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e162f83206171a90865 HTTP/1.1" 200 None 2025-09-27 08:13:32,375 - lava_callback - DEBUG - Processing node 68d66e162f83206171a90865: baseline-arm64 2025-09-27 08:13:32,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:13:32,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:13:32,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e162f83206171a90865/log.txt.gz 2025-09-27 08:13:32,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:13:33,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:13:33,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e162f83206171a90865/lava_callback.json.gz 2025-09-27 08:13:33,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:13:33,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e162f83206171a90865 HTTP/1.1" 200 None 2025-09-27 08:13:33,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:13:33,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:13:33,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:13:33,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e162f83206171a90865 HTTP/1.1" 200 None 2025-09-27 08:13:33,152 - lava_callback - INFO - Completed processing callback for node 68d66e162f83206171a90865 INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:13:42,449 - lava_callback - INFO - Received callback for node 68d5921d2be2da466069a0ce INFO: 172.21.0.1:39388 - "POST /node/68d5921d2be2da466069a0ce HTTP/1.0" 202 Accepted 2025-09-27 08:13:42,455 - lava_callback - INFO - Starting async job submit for node 68d5921d2be2da466069a0ce 2025-09-27 08:13:42,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:13:42,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5921d2be2da466069a0ce HTTP/1.1" 200 None 2025-09-27 08:13:42,485 - lava_callback - DEBUG - Processing node 68d5921d2be2da466069a0ce: baseline-arm64-broonie 2025-09-27 08:13:42,784 - lava_callback - ERROR - Error processing callback for node 68d5921d2be2da466069a0ce: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:14:00,349 - lava_callback - INFO - Received callback for node 68d4fcb8ef0c6c1c70206034 INFO: 172.21.0.1:60208 - "POST /node/68d4fcb8ef0c6c1c70206034 HTTP/1.0" 202 Accepted 2025-09-27 08:14:00,355 - lava_callback - INFO - Starting async job submit for node 68d4fcb8ef0c6c1c70206034 2025-09-27 08:14:00,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:14:00,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fcb8ef0c6c1c70206034 HTTP/1.1" 200 None 2025-09-27 08:14:00,419 - lava_callback - DEBUG - Processing node 68d4fcb8ef0c6c1c70206034: baseline-arm 2025-09-27 08:14:00,698 - lava_callback - ERROR - Error processing callback for node 68d4fcb8ef0c6c1c70206034: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:14:35,929 - lava_callback - INFO - Received callback for node 68d6594a5d85f2a87334b215 INFO: 172.21.0.1:36056 - "POST /node/68d6594a5d85f2a87334b215 HTTP/1.0" 202 Accepted 2025-09-27 08:14:35,937 - lava_callback - INFO - Starting async job submit for node 68d6594a5d85f2a87334b215 2025-09-27 08:14:35,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:14:35,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6594a5d85f2a87334b215 HTTP/1.1" 200 None 2025-09-27 08:14:35,990 - lava_callback - DEBUG - Processing node 68d6594a5d85f2a87334b215: baseline-arm64 INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:14:36,878 - lava_callback - ERROR - Error processing callback for node 68d6594a5d85f2a87334b215: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:14:46,922 - lava_callback - INFO - Received callback for node 68d6594f5d85f2a87334b230 INFO: 172.21.0.1:57566 - "POST /node/68d6594f5d85f2a87334b230 HTTP/1.0" 202 Accepted 2025-09-27 08:14:46,929 - lava_callback - INFO - Starting async job submit for node 68d6594f5d85f2a87334b230 2025-09-27 08:14:46,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:14:46,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6594f5d85f2a87334b230 HTTP/1.1" 200 None 2025-09-27 08:14:46,982 - lava_callback - DEBUG - Processing node 68d6594f5d85f2a87334b230: baseline-arm64 2025-09-27 08:14:47,901 - lava_callback - ERROR - Error processing callback for node 68d6594f5d85f2a87334b230: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:14:58,044 - lava_callback - INFO - Received callback for node 68d66e192f83206171a90868 INFO: 172.21.0.1:57346 - "POST /node/68d66e192f83206171a90868 HTTP/1.0" 202 Accepted 2025-09-27 08:14:58,050 - lava_callback - INFO - Starting async job submit for node 68d66e192f83206171a90868 2025-09-27 08:14:58,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:14:58,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e192f83206171a90868 HTTP/1.1" 200 None 2025-09-27 08:14:58,085 - lava_callback - DEBUG - Processing node 68d66e192f83206171a90868: baseline-arm64 2025-09-27 08:14:58,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:14:58,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:14:58,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e192f83206171a90868/log.txt.gz 2025-09-27 08:14:58,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:14:58,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:14:58,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e192f83206171a90868/lava_callback.json.gz 2025-09-27 08:14:58,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:14:58,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e192f83206171a90868 HTTP/1.1" 200 None 2025-09-27 08:14:58,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:14:58,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:14:58,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:14:58,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e192f83206171a90868 HTTP/1.1" 200 None 2025-09-27 08:14:58,847 - lava_callback - INFO - Completed processing callback for node 68d66e192f83206171a90868 INFO: 172.21.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:15:19,075 - lava_callback - INFO - Received callback for node 68d66f402f83206171a90af9 INFO: 172.21.0.1:40626 - "POST /node/68d66f402f83206171a90af9 HTTP/1.0" 202 Accepted 2025-09-27 08:15:19,081 - lava_callback - INFO - Starting async job submit for node 68d66f402f83206171a90af9 2025-09-27 08:15:19,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:15:19,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f402f83206171a90af9 HTTP/1.1" 200 None 2025-09-27 08:15:19,122 - lava_callback - DEBUG - Processing node 68d66f402f83206171a90af9: baseline-arm 2025-09-27 08:15:19,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:15:19,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:15:19,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f402f83206171a90af9/log.txt.gz 2025-09-27 08:15:19,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:15:19,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:15:19,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f402f83206171a90af9/lava_callback.json.gz 2025-09-27 08:15:19,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:15:19,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f402f83206171a90af9 HTTP/1.1" 200 None 2025-09-27 08:15:19,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:15:19,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 08:15:19,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:15:19,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f402f83206171a90af9 HTTP/1.1" 200 None 2025-09-27 08:15:19,749 - lava_callback - INFO - Completed processing callback for node 68d66f402f83206171a90af9 INFO: 172.21.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:16:08,114 - lava_callback - INFO - Received callback for node 68d66e1b2f83206171a9086b INFO: 172.21.0.1:56408 - "POST /node/68d66e1b2f83206171a9086b HTTP/1.0" 202 Accepted 2025-09-27 08:16:08,120 - lava_callback - INFO - Starting async job submit for node 68d66e1b2f83206171a9086b 2025-09-27 08:16:08,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:08,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e1b2f83206171a9086b HTTP/1.1" 200 None 2025-09-27 08:16:08,155 - lava_callback - DEBUG - Processing node 68d66e1b2f83206171a9086b: baseline-arm64 2025-09-27 08:16:08,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:16:08,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:16:08,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e1b2f83206171a9086b/log.txt.gz 2025-09-27 08:16:08,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:16:08,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:16:08,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e1b2f83206171a9086b/lava_callback.json.gz 2025-09-27 08:16:08,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:08,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e1b2f83206171a9086b HTTP/1.1" 200 None 2025-09-27 08:16:08,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:08,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:16:08,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:08,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e1b2f83206171a9086b HTTP/1.1" 200 None 2025-09-27 08:16:08,851 - lava_callback - INFO - Completed processing callback for node 68d66e1b2f83206171a9086b INFO: 172.21.0.1:45548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:16:16,791 - lava_callback - INFO - Received callback for node 68d66e232f83206171a90875 INFO: 172.21.0.1:45560 - "POST /node/68d66e232f83206171a90875 HTTP/1.0" 202 Accepted 2025-09-27 08:16:16,798 - lava_callback - INFO - Starting async job submit for node 68d66e232f83206171a90875 2025-09-27 08:16:16,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:16,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e232f83206171a90875 HTTP/1.1" 200 None 2025-09-27 08:16:16,841 - lava_callback - DEBUG - Processing node 68d66e232f83206171a90875: baseline-arm64 2025-09-27 08:16:17,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:16:17,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:16:17,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e232f83206171a90875/log.txt.gz 2025-09-27 08:16:17,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:16:17,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:16:17,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e232f83206171a90875/lava_callback.json.gz 2025-09-27 08:16:17,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:17,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e232f83206171a90875 HTTP/1.1" 200 None 2025-09-27 08:16:17,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:17,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:16:17,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:17,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e232f83206171a90875 HTTP/1.1" 200 None 2025-09-27 08:16:17,537 - lava_callback - INFO - Completed processing callback for node 68d66e232f83206171a90875 INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:16:45,455 - lava_callback - INFO - Received callback for node 68d4fe87ef0c6c1c702061d2 INFO: 172.21.0.1:44774 - "POST /node/68d4fe87ef0c6c1c702061d2 HTTP/1.0" 202 Accepted 2025-09-27 08:16:45,463 - lava_callback - INFO - Starting async job submit for node 68d4fe87ef0c6c1c702061d2 2025-09-27 08:16:45,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:45,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4fe87ef0c6c1c702061d2 HTTP/1.1" 200 None 2025-09-27 08:16:45,588 - lava_callback - DEBUG - Processing node 68d4fe87ef0c6c1c702061d2: ltp-containers INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:16:46,374 - lava_callback - ERROR - Error processing callback for node 68d4fe87ef0c6c1c702061d2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 08:16:46,447 - lava_callback - INFO - Received callback for node 68d66e1e2f83206171a9086e INFO: 172.21.0.1:44784 - "POST /node/68d66e1e2f83206171a9086e HTTP/1.0" 202 Accepted 2025-09-27 08:16:46,453 - lava_callback - INFO - Starting async job submit for node 68d66e1e2f83206171a9086e 2025-09-27 08:16:46,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:46,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e1e2f83206171a9086e HTTP/1.1" 200 None 2025-09-27 08:16:46,508 - lava_callback - DEBUG - Processing node 68d66e1e2f83206171a9086e: baseline-arm64 INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:16:46,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:16:46,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:16:46,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e1e2f83206171a9086e/log.txt.gz 2025-09-27 08:16:46,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:16:47,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:16:47,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e1e2f83206171a9086e/lava_callback.json.gz 2025-09-27 08:16:47,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:47,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e1e2f83206171a9086e HTTP/1.1" 200 None 2025-09-27 08:16:47,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:47,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:16:47,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:16:47,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e1e2f83206171a9086e HTTP/1.1" 200 None 2025-09-27 08:16:47,204 - lava_callback - INFO - Completed processing callback for node 68d66e1e2f83206171a9086e INFO: 172.21.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:17:32,745 - lava_callback - INFO - Received callback for node 68d66f432f83206171a90b00 INFO: 172.21.0.1:52774 - "POST /node/68d66f432f83206171a90b00 HTTP/1.0" 202 Accepted 2025-09-27 08:17:32,753 - lava_callback - INFO - Starting async job submit for node 68d66f432f83206171a90b00 2025-09-27 08:17:32,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:32,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f432f83206171a90b00 HTTP/1.1" 200 None 2025-09-27 08:17:32,790 - lava_callback - DEBUG - Processing node 68d66f432f83206171a90b00: baseline-arm 2025-09-27 08:17:33,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:17:33,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:17:33,218 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f432f83206171a90b00/log.txt.gz 2025-09-27 08:17:33,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:17:33,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:17:33,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f432f83206171a90b00/lava_callback.json.gz 2025-09-27 08:17:33,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:33,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f432f83206171a90b00 HTTP/1.1" 200 None 2025-09-27 08:17:33,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:33,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-27 08:17:33,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:33,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f432f83206171a90b00 HTTP/1.1" 200 None 2025-09-27 08:17:33,479 - lava_callback - INFO - Completed processing callback for node 68d66f432f83206171a90b00 2025-09-27 08:17:35,817 - lava_callback - INFO - Received callback for node 68d66e2a2f83206171a9087f INFO: 172.21.0.1:52786 - "POST /node/68d66e2a2f83206171a9087f HTTP/1.0" 202 Accepted 2025-09-27 08:17:35,825 - lava_callback - INFO - Starting async job submit for node 68d66e2a2f83206171a9087f 2025-09-27 08:17:35,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:35,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e2a2f83206171a9087f HTTP/1.1" 200 None 2025-09-27 08:17:35,864 - lava_callback - DEBUG - Processing node 68d66e2a2f83206171a9087f: baseline-arm64 2025-09-27 08:17:36,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:17:36,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:17:36,369 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e2a2f83206171a9087f/log.txt.gz 2025-09-27 08:17:36,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK 2025-09-27 08:17:36,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:17:36,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e2a2f83206171a9087f/lava_callback.json.gz 2025-09-27 08:17:36,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:36,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e2a2f83206171a9087f HTTP/1.1" 200 None 2025-09-27 08:17:36,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:36,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:17:36,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:36,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e2a2f83206171a9087f HTTP/1.1" 200 None 2025-09-27 08:17:36,606 - lava_callback - INFO - Completed processing callback for node 68d66e2a2f83206171a9087f 2025-09-27 08:17:42,451 - lava_callback - INFO - Received callback for node 68d66e252f83206171a90878 INFO: 172.21.0.1:53866 - "POST /node/68d66e252f83206171a90878 HTTP/1.0" 202 Accepted 2025-09-27 08:17:42,459 - lava_callback - INFO - Starting async job submit for node 68d66e252f83206171a90878 2025-09-27 08:17:42,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:42,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e252f83206171a90878 HTTP/1.1" 200 None 2025-09-27 08:17:42,507 - lava_callback - DEBUG - Processing node 68d66e252f83206171a90878: baseline-arm64 2025-09-27 08:17:43,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:17:43,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:17:43,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e252f83206171a90878/log.txt.gz 2025-09-27 08:17:43,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 08:17:43,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 08:17:43,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e252f83206171a90878/lava_callback.json.gz 2025-09-27 08:17:43,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:43,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e252f83206171a90878 HTTP/1.1" 200 None 2025-09-27 08:17:43,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:43,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-27 08:17:43,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 08:17:43,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e252f83206171a90878 HTTP/1.1" 200 None 2025-09-27 08:17:43,483 - lava_callback - INFO - Completed processing callback for node 68d66e252f83206171a90878 INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]