Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kvm-unit-tests/20250624.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bullseye/20240129.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-h26forge/20250117.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-fault-injection/20250520.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:19:13,335 - lava_callback - INFO - Received callback for node 68d74a5da6a7b6615d4c4c60 2025-09-27 16:19:13,341 - lava_callback - INFO - Starting async job submit for node 68d74a5da6a7b6615d4c4c60 INFO: 172.21.0.1:54614 - "POST /node/68d74a5da6a7b6615d4c4c60 HTTP/1.0" 202 Accepted 2025-09-27 16:19:13,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:19:13,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a5da6a7b6615d4c4c60 HTTP/1.1" 200 None 2025-09-27 16:19:13,380 - lava_callback - DEBUG - Processing node 68d74a5da6a7b6615d4c4c60: baseline-arm 2025-09-27 16:19:13,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:19:13,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:19:13,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a5da6a7b6615d4c4c60/log.txt.gz 2025-09-27 16:19:13,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:19:13,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:19:13,927 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a5da6a7b6615d4c4c60/lava_callback.json.gz 2025-09-27 16:19:13,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:19:13,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a5da6a7b6615d4c4c60 HTTP/1.1" 200 None 2025-09-27 16:19:13,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:19:13,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-27 16:19:13,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:19:14,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74a5da6a7b6615d4c4c60 HTTP/1.1" 200 None 2025-09-27 16:19:14,011 - lava_callback - INFO - Completed processing callback for node 68d74a5da6a7b6615d4c4c60 INFO: 172.21.0.1:54620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60642 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:21:24,050 - lava_callback - INFO - Received callback for node 68d56e2a2be2da4660699354 INFO: 172.21.0.1:41626 - "POST /node/68d56e2a2be2da4660699354 HTTP/1.0" 202 Accepted 2025-09-27 16:21:24,056 - lava_callback - INFO - Starting async job submit for node 68d56e2a2be2da4660699354 2025-09-27 16:21:24,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:21:24,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e2a2be2da4660699354 HTTP/1.1" 200 None 2025-09-27 16:21:24,109 - lava_callback - DEBUG - Processing node 68d56e2a2be2da4660699354: baseline-arm-broonie 2025-09-27 16:21:24,325 - lava_callback - ERROR - Error processing callback for node 68d56e2a2be2da4660699354: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:21:32,942 - lava_callback - INFO - Received callback for node 68d74a5fa6a7b6615d4c4c63 INFO: 172.21.0.1:45788 - "POST /node/68d74a5fa6a7b6615d4c4c63 HTTP/1.0" 202 Accepted 2025-09-27 16:21:32,948 - lava_callback - INFO - Starting async job submit for node 68d74a5fa6a7b6615d4c4c63 2025-09-27 16:21:32,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:21:32,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a5fa6a7b6615d4c4c63 HTTP/1.1" 200 None 2025-09-27 16:21:32,994 - lava_callback - DEBUG - Processing node 68d74a5fa6a7b6615d4c4c63: baseline-arm 2025-09-27 16:21:33,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:21:33,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:21:33,406 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a5fa6a7b6615d4c4c63/log.txt.gz 2025-09-27 16:21:33,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:21:33,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:21:33,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a5fa6a7b6615d4c4c63/lava_callback.json.gz 2025-09-27 16:21:33,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:21:33,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a5fa6a7b6615d4c4c63 HTTP/1.1" 200 None 2025-09-27 16:21:33,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:21:33,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-27 16:21:33,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:21:33,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74a5fa6a7b6615d4c4c63 HTTP/1.1" 200 None 2025-09-27 16:21:33,663 - lava_callback - INFO - Completed processing callback for node 68d74a5fa6a7b6615d4c4c63 INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:23:51,594 - lava_callback - INFO - Received callback for node 68d74a5fa6a7b6615d4c4c66 INFO: 172.21.0.1:56286 - "POST /node/68d74a5fa6a7b6615d4c4c66 HTTP/1.0" 202 Accepted 2025-09-27 16:23:51,603 - lava_callback - INFO - Starting async job submit for node 68d74a5fa6a7b6615d4c4c66 2025-09-27 16:23:51,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:23:51,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a5fa6a7b6615d4c4c66 HTTP/1.1" 200 None 2025-09-27 16:23:51,671 - lava_callback - DEBUG - Processing node 68d74a5fa6a7b6615d4c4c66: baseline-arm 2025-09-27 16:23:52,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:23:52,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:23:52,422 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a5fa6a7b6615d4c4c66/log.txt.gz 2025-09-27 16:23:52,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:23:52,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:23:52,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a5fa6a7b6615d4c4c66/lava_callback.json.gz 2025-09-27 16:23:52,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:23:52,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a5fa6a7b6615d4c4c66 HTTP/1.1" 200 None 2025-09-27 16:23:52,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:23:52,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-27 16:23:52,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:23:52,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74a5fa6a7b6615d4c4c66 HTTP/1.1" 200 None 2025-09-27 16:23:52,961 - lava_callback - INFO - Completed processing callback for node 68d74a5fa6a7b6615d4c4c66 INFO: 172.21.0.1:56294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49656 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:24:55,558 - lava_callback - INFO - Received callback for node 68d80f9b1fd44e101337efda INFO: 172.21.0.1:49660 - "POST /node/68d80f9b1fd44e101337efda HTTP/1.0" 202 Accepted 2025-09-27 16:24:55,564 - lava_callback - INFO - Starting async job submit for node 68d80f9b1fd44e101337efda 2025-09-27 16:24:55,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:24:55,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9b1fd44e101337efda HTTP/1.1" 200 None 2025-09-27 16:24:55,617 - lava_callback - DEBUG - Processing node 68d80f9b1fd44e101337efda: baseline-arm 2025-09-27 16:24:55,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:24:56,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:24:56,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9b1fd44e101337efda/log.txt.gz 2025-09-27 16:24:56,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:24:56,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:24:56,179 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9b1fd44e101337efda/lava_callback.json.gz 2025-09-27 16:24:56,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:24:56,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9b1fd44e101337efda HTTP/1.1" 200 None 2025-09-27 16:24:56,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:24:56,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:24:56,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:24:56,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9b1fd44e101337efda HTTP/1.1" 200 None 2025-09-27 16:24:56,264 - lava_callback - INFO - Completed processing callback for node 68d80f9b1fd44e101337efda INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:25:03,753 - lava_callback - INFO - Received callback for node 68d80f9d1fd44e101337efe6 INFO: 172.21.0.1:37042 - "POST /node/68d80f9d1fd44e101337efe6 HTTP/1.0" 202 Accepted 2025-09-27 16:25:03,759 - lava_callback - INFO - Starting async job submit for node 68d80f9d1fd44e101337efe6 2025-09-27 16:25:03,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:03,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9d1fd44e101337efe6 HTTP/1.1" 200 None 2025-09-27 16:25:03,791 - lava_callback - DEBUG - Processing node 68d80f9d1fd44e101337efe6: baseline-arm 2025-09-27 16:25:04,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:04,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:04,254 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9d1fd44e101337efe6/log.txt.gz 2025-09-27 16:25:04,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:04,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:04,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9d1fd44e101337efe6/lava_callback.json.gz 2025-09-27 16:25:04,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:04,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9d1fd44e101337efe6 HTTP/1.1" 200 None 2025-09-27 16:25:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:04,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:04,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:04,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9d1fd44e101337efe6 HTTP/1.1" 200 None 2025-09-27 16:25:04,473 - lava_callback - INFO - Completed processing callback for node 68d80f9d1fd44e101337efe6 INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:25:12,790 - lava_callback - INFO - Received callback for node 68d80fa41fd44e101337f00a INFO: 172.21.0.1:45612 - "POST /node/68d80fa41fd44e101337f00a HTTP/1.0" 202 Accepted 2025-09-27 16:25:12,840 - lava_callback - INFO - Starting async job submit for node 68d80fa41fd44e101337f00a 2025-09-27 16:25:12,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:12,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa41fd44e101337f00a HTTP/1.1" 200 None 2025-09-27 16:25:12,892 - lava_callback - DEBUG - Processing node 68d80fa41fd44e101337f00a: baseline-arm-pengutronix 2025-09-27 16:25:12,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:13,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:13,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d80fa41fd44e101337f00a/log.txt.gz 2025-09-27 16:25:13,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:13,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:13,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d80fa41fd44e101337f00a/lava_callback.json.gz 2025-09-27 16:25:13,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:13,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa41fd44e101337f00a HTTP/1.1" 200 None 2025-09-27 16:25:13,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:13,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:13,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:13,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80fa41fd44e101337f00a HTTP/1.1" 200 None 2025-09-27 16:25:13,348 - lava_callback - INFO - Completed processing callback for node 68d80fa41fd44e101337f00a INFO: 172.21.0.1:45616 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 16:25:16,062 - lava_callback - INFO - Received callback for node 68d80fa21fd44e101337f004 INFO: 172.21.0.1:45622 - "POST /node/68d80fa21fd44e101337f004 HTTP/1.0" 202 Accepted 2025-09-27 16:25:16,072 - lava_callback - INFO - Starting async job submit for node 68d80fa21fd44e101337f004 2025-09-27 16:25:16,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:16,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa21fd44e101337f004 HTTP/1.1" 200 None 2025-09-27 16:25:16,122 - lava_callback - DEBUG - Processing node 68d80fa21fd44e101337f004: baseline-arm-pengutronix 2025-09-27 16:25:16,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:25:16,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:16,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d80fa21fd44e101337f004/log.txt.gz 2025-09-27 16:25:16,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:16,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:16,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d80fa21fd44e101337f004/lava_callback.json.gz 2025-09-27 16:25:16,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:16,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa21fd44e101337f004 HTTP/1.1" 200 None 2025-09-27 16:25:16,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:16,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:16,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:16,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80fa21fd44e101337f004 HTTP/1.1" 200 None 2025-09-27 16:25:16,820 - lava_callback - INFO - Completed processing callback for node 68d80fa21fd44e101337f004 2025-09-27 16:25:17,305 - lava_callback - INFO - Received callback for node 68d80fa31fd44e101337f007 INFO: 172.21.0.1:45640 - "POST /node/68d80fa31fd44e101337f007 HTTP/1.0" 202 Accepted 2025-09-27 16:25:17,311 - lava_callback - INFO - Starting async job submit for node 68d80fa31fd44e101337f007 2025-09-27 16:25:17,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:17,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa31fd44e101337f007 HTTP/1.1" 200 None 2025-09-27 16:25:17,351 - lava_callback - DEBUG - Processing node 68d80fa31fd44e101337f007: baseline-arm-pengutronix 2025-09-27 16:25:17,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:17,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:17,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d80fa31fd44e101337f007/log.txt.gz 2025-09-27 16:25:17,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:17,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:17,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d80fa31fd44e101337f007/lava_callback.json.gz 2025-09-27 16:25:17,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:17,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa31fd44e101337f007 HTTP/1.1" 200 None 2025-09-27 16:25:17,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:17,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:17,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:17,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80fa31fd44e101337f007 HTTP/1.1" 200 None 2025-09-27 16:25:17,825 - lava_callback - INFO - Completed processing callback for node 68d80fa31fd44e101337f007 2025-09-27 16:25:26,418 - lava_callback - INFO - Received callback for node 68d80f9c1fd44e101337efdd INFO: 172.21.0.1:36204 - "POST /node/68d80f9c1fd44e101337efdd HTTP/1.0" 202 Accepted 2025-09-27 16:25:26,424 - lava_callback - INFO - Starting async job submit for node 68d80f9c1fd44e101337efdd 2025-09-27 16:25:26,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:26,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9c1fd44e101337efdd HTTP/1.1" 200 None 2025-09-27 16:25:26,457 - lava_callback - DEBUG - Processing node 68d80f9c1fd44e101337efdd: baseline-arm INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:25:26,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:26,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:26,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9c1fd44e101337efdd/log.txt.gz 2025-09-27 16:25:26,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:26,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:26,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9c1fd44e101337efdd/lava_callback.json.gz 2025-09-27 16:25:26,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:26,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9c1fd44e101337efdd HTTP/1.1" 200 None 2025-09-27 16:25:26,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:27,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:27,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:27,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9c1fd44e101337efdd HTTP/1.1" 200 None 2025-09-27 16:25:27,034 - lava_callback - INFO - Completed processing callback for node 68d80f9c1fd44e101337efdd 2025-09-27 16:25:32,724 - lava_callback - INFO - Received callback for node 68d80f9a1fd44e101337efd1 INFO: 172.21.0.1:34982 - "POST /node/68d80f9a1fd44e101337efd1 HTTP/1.0" 202 Accepted 2025-09-27 16:25:32,730 - lava_callback - INFO - Starting async job submit for node 68d80f9a1fd44e101337efd1 2025-09-27 16:25:32,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:32,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9a1fd44e101337efd1 HTTP/1.1" 200 None 2025-09-27 16:25:32,766 - lava_callback - DEBUG - Processing node 68d80f9a1fd44e101337efd1: baseline-arm 2025-09-27 16:25:32,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:33,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:33,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9a1fd44e101337efd1/log.txt.gz 2025-09-27 16:25:33,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:33,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:33,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9a1fd44e101337efd1/lava_callback.json.gz 2025-09-27 16:25:33,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:33,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9a1fd44e101337efd1 HTTP/1.1" 200 None 2025-09-27 16:25:33,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:33,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:33,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:33,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9a1fd44e101337efd1 HTTP/1.1" 200 None 2025-09-27 16:25:33,310 - lava_callback - INFO - Completed processing callback for node 68d80f9a1fd44e101337efd1 INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:25:41,253 - lava_callback - INFO - Received callback for node 68d80f9e1fd44e101337efef INFO: 172.21.0.1:57620 - "POST /node/68d80f9e1fd44e101337efef HTTP/1.0" 202 Accepted 2025-09-27 16:25:41,260 - lava_callback - INFO - Starting async job submit for node 68d80f9e1fd44e101337efef 2025-09-27 16:25:41,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:41,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9e1fd44e101337efef HTTP/1.1" 200 None 2025-09-27 16:25:41,293 - lava_callback - DEBUG - Processing node 68d80f9e1fd44e101337efef: baseline-arm-broonie 2025-09-27 16:25:41,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:41,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:41,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d80f9e1fd44e101337efef/log.txt.gz 2025-09-27 16:25:41,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:41,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:41,723 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d80f9e1fd44e101337efef/lava_callback.json.gz 2025-09-27 16:25:41,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:41,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9e1fd44e101337efef HTTP/1.1" 200 None 2025-09-27 16:25:41,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:41,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:41,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:41,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9e1fd44e101337efef HTTP/1.1" 200 None 2025-09-27 16:25:41,801 - lava_callback - INFO - Completed processing callback for node 68d80f9e1fd44e101337efef 2025-09-27 16:25:44,337 - lava_callback - INFO - Received callback for node 68d56e312be2da466069937d INFO: 172.21.0.1:57630 - "POST /node/68d56e312be2da466069937d HTTP/1.0" 202 Accepted 2025-09-27 16:25:44,344 - lava_callback - INFO - Starting async job submit for node 68d56e312be2da466069937d 2025-09-27 16:25:44,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:44,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e312be2da466069937d HTTP/1.1" 200 None 2025-09-27 16:25:44,387 - lava_callback - DEBUG - Processing node 68d56e312be2da466069937d: ltp-cap-bounds 2025-09-27 16:25:44,741 - lava_callback - ERROR - Error processing callback for node 68d56e312be2da466069937d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:25:51,958 - lava_callback - INFO - Received callback for node 68d80fa01fd44e101337effe INFO: 172.21.0.1:38540 - "POST /node/68d80fa01fd44e101337effe HTTP/1.0" 202 Accepted 2025-09-27 16:25:51,964 - lava_callback - INFO - Starting async job submit for node 68d80fa01fd44e101337effe 2025-09-27 16:25:51,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:51,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa01fd44e101337effe HTTP/1.1" 200 None 2025-09-27 16:25:51,998 - lava_callback - DEBUG - Processing node 68d80fa01fd44e101337effe: baseline-arm-kontron 2025-09-27 16:25:52,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:52,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:52,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d80fa01fd44e101337effe/log.txt.gz 2025-09-27 16:25:52,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:52,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:52,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d80fa01fd44e101337effe/lava_callback.json.gz 2025-09-27 16:25:52,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:52,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa01fd44e101337effe HTTP/1.1" 200 None 2025-09-27 16:25:52,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:52,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:52,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:52,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80fa01fd44e101337effe HTTP/1.1" 200 None 2025-09-27 16:25:52,488 - lava_callback - INFO - Completed processing callback for node 68d80fa01fd44e101337effe 2025-09-27 16:25:53,206 - lava_callback - INFO - Received callback for node 68d80fa11fd44e101337f001 INFO: 172.21.0.1:38550 - "POST /node/68d80fa11fd44e101337f001 HTTP/1.0" 202 Accepted 2025-09-27 16:25:53,212 - lava_callback - INFO - Starting async job submit for node 68d80fa11fd44e101337f001 2025-09-27 16:25:53,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:53,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa11fd44e101337f001 HTTP/1.1" 200 None 2025-09-27 16:25:53,246 - lava_callback - DEBUG - Processing node 68d80fa11fd44e101337f001: baseline-arm-kontron 2025-09-27 16:25:53,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:53,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:53,523 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d80fa11fd44e101337f001/log.txt.gz 2025-09-27 16:25:53,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:53,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:53,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d80fa11fd44e101337f001/lava_callback.json.gz 2025-09-27 16:25:53,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:53,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa11fd44e101337f001 HTTP/1.1" 200 None 2025-09-27 16:25:53,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:53,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:53,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:53,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80fa11fd44e101337f001 HTTP/1.1" 200 None 2025-09-27 16:25:53,721 - lava_callback - INFO - Completed processing callback for node 68d80fa11fd44e101337f001 INFO: 172.21.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:25:56,557 - lava_callback - INFO - Received callback for node 68d80fb51fd44e101337f049 INFO: 172.21.0.1:38592 - "POST /node/68d80fb51fd44e101337f049 HTTP/1.0" 202 Accepted 2025-09-27 16:25:56,563 - lava_callback - INFO - Starting async job submit for node 68d80fb51fd44e101337f049 2025-09-27 16:25:56,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:56,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fb51fd44e101337f049 HTTP/1.1" 200 None 2025-09-27 16:25:56,597 - lava_callback - DEBUG - Processing node 68d80fb51fd44e101337f049: baseline-riscv-collabora 2025-09-27 16:25:56,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:56,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:56,883 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d80fb51fd44e101337f049/log.txt.gz 2025-09-27 16:25:56,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:57,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:57,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d80fb51fd44e101337f049/lava_callback.json.gz 2025-09-27 16:25:57,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:57,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fb51fd44e101337f049 HTTP/1.1" 200 None 2025-09-27 16:25:57,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:57,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b6f8dd6b39fd1aeb98d HTTP/1.1" 200 None 2025-09-27 16:25:57,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:57,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80fb51fd44e101337f049 HTTP/1.1" 200 None 2025-09-27 16:25:57,103 - lava_callback - INFO - Completed processing callback for node 68d80fb51fd44e101337f049 2025-09-27 16:25:58,456 - lava_callback - INFO - Received callback for node 68d80f9f1fd44e101337eff2 INFO: 172.21.0.1:38604 - "POST /node/68d80f9f1fd44e101337eff2 HTTP/1.0" 202 Accepted 2025-09-27 16:25:58,462 - lava_callback - INFO - Starting async job submit for node 68d80f9f1fd44e101337eff2 2025-09-27 16:25:58,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:58,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9f1fd44e101337eff2 HTTP/1.1" 200 None 2025-09-27 16:25:58,495 - lava_callback - DEBUG - Processing node 68d80f9f1fd44e101337eff2: baseline-arm-broonie 2025-09-27 16:25:58,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:58,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:58,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d80f9f1fd44e101337eff2/log.txt.gz 2025-09-27 16:25:58,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:25:58,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:25:58,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d80f9f1fd44e101337eff2/lava_callback.json.gz 2025-09-27 16:25:58,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:59,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9f1fd44e101337eff2 HTTP/1.1" 200 None 2025-09-27 16:25:59,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:59,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:25:59,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:25:59,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9f1fd44e101337eff2 HTTP/1.1" 200 None 2025-09-27 16:25:59,054 - lava_callback - INFO - Completed processing callback for node 68d80f9f1fd44e101337eff2 INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:26:13,851 - lava_callback - INFO - Received callback for node 68d74a61a6a7b6615d4c4c69 INFO: 172.21.0.1:46108 - "POST /node/68d74a61a6a7b6615d4c4c69 HTTP/1.0" 202 Accepted 2025-09-27 16:26:13,863 - lava_callback - INFO - Starting async job submit for node 68d74a61a6a7b6615d4c4c69 2025-09-27 16:26:13,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:13,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a61a6a7b6615d4c4c69 HTTP/1.1" 200 None 2025-09-27 16:26:13,918 - lava_callback - DEBUG - Processing node 68d74a61a6a7b6615d4c4c69: baseline-arm 2025-09-27 16:26:14,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:26:14,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:26:14,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a61a6a7b6615d4c4c69/log.txt.gz 2025-09-27 16:26:14,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:26:14,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:26:14,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a61a6a7b6615d4c4c69/lava_callback.json.gz 2025-09-27 16:26:14,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:14,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a61a6a7b6615d4c4c69 HTTP/1.1" 200 None 2025-09-27 16:26:14,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:14,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-27 16:26:14,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:14,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74a61a6a7b6615d4c4c69 HTTP/1.1" 200 None 2025-09-27 16:26:14,863 - lava_callback - INFO - Completed processing callback for node 68d74a61a6a7b6615d4c4c69 INFO: 172.21.0.1:46120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:26:19,178 - lava_callback - INFO - Received callback for node 68d80fb51fd44e101337f046 INFO: 172.21.0.1:46142 - "POST /node/68d80fb51fd44e101337f046 HTTP/1.0" 202 Accepted 2025-09-27 16:26:19,184 - lava_callback - INFO - Starting async job submit for node 68d80fb51fd44e101337f046 2025-09-27 16:26:19,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:19,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fb51fd44e101337f046 HTTP/1.1" 200 None 2025-09-27 16:26:19,220 - lava_callback - DEBUG - Processing node 68d80fb51fd44e101337f046: baseline-riscv-broonie 2025-09-27 16:26:19,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:26:19,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:26:19,558 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d80fb51fd44e101337f046/log.txt.gz 2025-09-27 16:26:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:26:19,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:26:19,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d80fb51fd44e101337f046/lava_callback.json.gz 2025-09-27 16:26:19,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:19,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fb51fd44e101337f046 HTTP/1.1" 200 None 2025-09-27 16:26:19,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:19,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b6f8dd6b39fd1aeb98d HTTP/1.1" 200 None 2025-09-27 16:26:19,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:19,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80fb51fd44e101337f046 HTTP/1.1" 200 None 2025-09-27 16:26:19,750 - lava_callback - INFO - Completed processing callback for node 68d80fb51fd44e101337f046 INFO: 172.21.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:26:44,098 - lava_callback - INFO - Received callback for node 68d80fa81fd44e101337f01b INFO: 172.21.0.1:51444 - "POST /node/68d80fa81fd44e101337f01b HTTP/1.0" 202 Accepted 2025-09-27 16:26:44,105 - lava_callback - INFO - Starting async job submit for node 68d80fa81fd44e101337f01b 2025-09-27 16:26:44,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:44,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa81fd44e101337f01b HTTP/1.1" 200 None 2025-09-27 16:26:44,153 - lava_callback - DEBUG - Processing node 68d80fa81fd44e101337f01b: ltp-dio 2025-09-27 16:26:44,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:26:44,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:26:44,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d80fa81fd44e101337f01b/log.txt.gz 2025-09-27 16:26:44,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:26:44,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:26:44,829 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d80fa81fd44e101337f01b/lava_callback.json.gz 2025-09-27 16:26:44,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:44,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80fa81fd44e101337f01b HTTP/1.1" 200 None 2025-09-27 16:26:44,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:44,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:26:44,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:26:44,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80fa81fd44e101337f01b HTTP/1.1" 200 None 2025-09-27 16:26:44,997 - lava_callback - INFO - Completed processing callback for node 68d80fa81fd44e101337f01b INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34596 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:28:10,078 - lava_callback - INFO - Received callback for node 68d810711fd44e101337f09e INFO: 172.21.0.1:38768 - "POST /node/68d810711fd44e101337f09e HTTP/1.0" 202 Accepted 2025-09-27 16:28:10,084 - lava_callback - INFO - Starting async job submit for node 68d810711fd44e101337f09e 2025-09-27 16:28:10,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:10,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810711fd44e101337f09e HTTP/1.1" 200 None 2025-09-27 16:28:10,160 - lava_callback - DEBUG - Processing node 68d810711fd44e101337f09e: baseline-x86 2025-09-27 16:28:10,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:28:10,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:28:10,512 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d810711fd44e101337f09e/log.txt.gz 2025-09-27 16:28:10,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:28:10,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:28:10,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d810711fd44e101337f09e/lava_callback.json.gz 2025-09-27 16:28:10,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:10,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810711fd44e101337f09e HTTP/1.1" 200 None 2025-09-27 16:28:10,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:10,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b728dd6b39fd1aeb990 HTTP/1.1" 200 None 2025-09-27 16:28:10,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:10,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d810711fd44e101337f09e HTTP/1.1" 200 None 2025-09-27 16:28:10,802 - lava_callback - INFO - Completed processing callback for node 68d810711fd44e101337f09e INFO: 172.21.0.1:38772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:28:33,150 - lava_callback - INFO - Received callback for node 68d74a61a6a7b6615d4c4c6c INFO: 172.21.0.1:56632 - "POST /node/68d74a61a6a7b6615d4c4c6c HTTP/1.0" 202 Accepted 2025-09-27 16:28:33,156 - lava_callback - INFO - Starting async job submit for node 68d74a61a6a7b6615d4c4c6c 2025-09-27 16:28:33,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:33,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a61a6a7b6615d4c4c6c HTTP/1.1" 200 None 2025-09-27 16:28:33,208 - lava_callback - DEBUG - Processing node 68d74a61a6a7b6615d4c4c6c: baseline-arm 2025-09-27 16:28:33,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:28:33,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:28:33,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a61a6a7b6615d4c4c6c/log.txt.gz 2025-09-27 16:28:33,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:28:33,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:28:33,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d74a61a6a7b6615d4c4c6c/lava_callback.json.gz 2025-09-27 16:28:33,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:33,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74a61a6a7b6615d4c4c6c HTTP/1.1" 200 None 2025-09-27 16:28:33,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:33,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-27 16:28:33,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:33,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74a61a6a7b6615d4c4c6c HTTP/1.1" 200 None 2025-09-27 16:28:33,786 - lava_callback - INFO - Completed processing callback for node 68d74a61a6a7b6615d4c4c6c INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:28:40,859 - lava_callback - INFO - Received callback for node 68d56e322be2da4660699381 INFO: 172.21.0.1:41082 - "POST /node/68d56e322be2da4660699381 HTTP/1.0" 202 Accepted 2025-09-27 16:28:40,867 - lava_callback - INFO - Starting async job submit for node 68d56e322be2da4660699381 2025-09-27 16:28:40,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:28:41,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e322be2da4660699381 HTTP/1.1" 200 None 2025-09-27 16:28:41,004 - lava_callback - DEBUG - Processing node 68d56e322be2da4660699381: ltp-containers 2025-09-27 16:28:41,818 - lava_callback - ERROR - Error processing callback for node 68d56e322be2da4660699381: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:29:00,620 - lava_callback - INFO - Received callback for node 68d810721fd44e101337f0a1 INFO: 172.21.0.1:36040 - "POST /node/68d810721fd44e101337f0a1 HTTP/1.0" 202 Accepted 2025-09-27 16:29:00,626 - lava_callback - INFO - Starting async job submit for node 68d810721fd44e101337f0a1 2025-09-27 16:29:00,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:29:00,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810721fd44e101337f0a1 HTTP/1.1" 200 None 2025-09-27 16:29:00,656 - lava_callback - DEBUG - Processing node 68d810721fd44e101337f0a1: baseline-x86 2025-09-27 16:29:00,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:29:01,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:29:01,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d810721fd44e101337f0a1/log.txt.gz 2025-09-27 16:29:01,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:29:01,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:29:01,153 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d810721fd44e101337f0a1/lava_callback.json.gz 2025-09-27 16:29:01,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:29:01,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810721fd44e101337f0a1 HTTP/1.1" 200 None 2025-09-27 16:29:01,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:29:01,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b728dd6b39fd1aeb990 HTTP/1.1" 200 None 2025-09-27 16:29:01,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:29:01,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d810721fd44e101337f0a1 HTTP/1.1" 200 None 2025-09-27 16:29:01,233 - lava_callback - INFO - Completed processing callback for node 68d810721fd44e101337f0a1 INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:30:22,103 - lava_callback - INFO - Received callback for node 68d810521fd44e101337f095 INFO: 172.21.0.1:52686 - "POST /node/68d810521fd44e101337f095 HTTP/1.0" 202 Accepted 2025-09-27 16:30:22,109 - lava_callback - INFO - Starting async job submit for node 68d810521fd44e101337f095 2025-09-27 16:30:22,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:22,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810521fd44e101337f095 HTTP/1.1" 200 None 2025-09-27 16:30:22,161 - lava_callback - DEBUG - Processing node 68d810521fd44e101337f095: baseline-x86 2025-09-27 16:30:22,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:30:22,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:30:22,555 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d810521fd44e101337f095/log.txt.gz 2025-09-27 16:30:22,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:30:22,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:30:22,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d810521fd44e101337f095/lava_callback.json.gz 2025-09-27 16:30:22,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:22,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810521fd44e101337f095 HTTP/1.1" 200 None 2025-09-27 16:30:22,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:22,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b728dd6b39fd1aeb990 HTTP/1.1" 200 None 2025-09-27 16:30:22,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:22,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d810521fd44e101337f095 HTTP/1.1" 200 None 2025-09-27 16:30:22,789 - lava_callback - INFO - Completed processing callback for node 68d810521fd44e101337f095 INFO: 172.21.0.1:52696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:30:37,307 - lava_callback - INFO - Received callback for node 68d56e2c2be2da466069935d INFO: 172.21.0.1:36082 - "POST /node/68d56e2c2be2da466069935d HTTP/1.0" 202 Accepted 2025-09-27 16:30:37,313 - lava_callback - INFO - Starting async job submit for node 68d56e2c2be2da466069935d 2025-09-27 16:30:37,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:37,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e2c2be2da466069935d HTTP/1.1" 200 None 2025-09-27 16:30:37,327 - lava_callback - DEBUG - Processing node 68d56e2c2be2da466069935d: baseline-arm-broonie 2025-09-27 16:30:37,327 - lava_callback - ERROR - Error processing callback for node 68d56e2c2be2da466069935d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:30:44,249 - lava_callback - INFO - Received callback for node 68d56e262be2da466069933f INFO: 172.21.0.1:42040 - "POST /node/68d56e262be2da466069933f HTTP/1.0" 202 Accepted 2025-09-27 16:30:44,255 - lava_callback - INFO - Starting async job submit for node 68d56e262be2da466069933f 2025-09-27 16:30:44,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:44,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e262be2da466069933f HTTP/1.1" 200 None 2025-09-27 16:30:44,275 - lava_callback - DEBUG - Processing node 68d56e262be2da466069933f: baseline-arm 2025-09-27 16:30:44,275 - lava_callback - ERROR - Error processing callback for node 68d56e262be2da466069933f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:30:44,908 - lava_callback - INFO - Received callback for node 68d56e292be2da466069934e INFO: 172.21.0.1:42046 - "POST /node/68d56e292be2da466069934e HTTP/1.0" 202 Accepted 2025-09-27 16:30:44,916 - lava_callback - INFO - Starting async job submit for node 68d56e292be2da466069934e 2025-09-27 16:30:44,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:44,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e292be2da466069934e HTTP/1.1" 200 None 2025-09-27 16:30:44,935 - lava_callback - DEBUG - Processing node 68d56e292be2da466069934e: baseline-arm 2025-09-27 16:30:44,935 - lava_callback - ERROR - Error processing callback for node 68d56e292be2da466069934e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:30:57,472 - lava_callback - INFO - Received callback for node 68d56e352be2da4660699393 INFO: 172.21.0.1:57398 - "POST /node/68d56e352be2da4660699393 HTTP/1.0" 202 Accepted 2025-09-27 16:30:57,478 - lava_callback - INFO - Starting async job submit for node 68d56e352be2da4660699393 2025-09-27 16:30:57,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:57,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e352be2da4660699393 HTTP/1.1" 200 None 2025-09-27 16:30:57,503 - lava_callback - DEBUG - Processing node 68d56e352be2da4660699393: ltp-fsx 2025-09-27 16:30:57,503 - lava_callback - ERROR - Error processing callback for node 68d56e352be2da4660699393: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:30:58,047 - lava_callback - INFO - Received callback for node 68d810721fd44e101337f0a4 INFO: 172.21.0.1:57402 - "POST /node/68d810721fd44e101337f0a4 HTTP/1.0" 202 Accepted 2025-09-27 16:30:58,058 - lava_callback - INFO - Starting async job submit for node 68d810721fd44e101337f0a4 2025-09-27 16:30:58,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:58,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810721fd44e101337f0a4 HTTP/1.1" 200 None 2025-09-27 16:30:58,094 - lava_callback - DEBUG - Processing node 68d810721fd44e101337f0a4: blktests-ddp-x86 2025-09-27 16:30:58,248 - lava_callback - INFO - Received callback for node 68d56e352be2da4660699396 2025-09-27 16:30:58,265 - lava_callback - INFO - Starting async job submit for node 68d56e352be2da4660699396 INFO: 172.21.0.1:57414 - "POST /node/68d56e352be2da4660699396 HTTP/1.0" 202 Accepted 2025-09-27 16:30:58,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:58,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e352be2da4660699396 HTTP/1.1" 200 None 2025-09-27 16:30:58,382 - lava_callback - DEBUG - Processing node 68d56e352be2da4660699396: ltp-input 2025-09-27 16:30:58,387 - lava_callback - ERROR - Error processing callback for node 68d56e352be2da4660699396: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:30:58,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:30:59,016 - lava_callback - INFO - Received callback for node 68d56e362be2da4660699399 INFO: 172.21.0.1:57428 - "POST /node/68d56e362be2da4660699399 HTTP/1.0" 202 Accepted 2025-09-27 16:30:59,025 - lava_callback - INFO - Starting async job submit for node 68d56e362be2da4660699399 2025-09-27 16:30:59,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:59,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:30:59,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d810721fd44e101337f0a4/log.txt.gz 2025-09-27 16:30:59,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e362be2da4660699399 HTTP/1.1" 200 None 2025-09-27 16:30:59,046 - lava_callback - DEBUG - Processing node 68d56e362be2da4660699399: ltp-ipc 2025-09-27 16:30:59,046 - lava_callback - ERROR - Error processing callback for node 68d56e362be2da4660699399: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:30:59,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:30:59,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:30:59,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d810721fd44e101337f0a4/lava_callback.json.gz 2025-09-27 16:30:59,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:59,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810721fd44e101337f0a4 HTTP/1.1" 200 None 2025-09-27 16:30:59,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:59,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b728dd6b39fd1aeb990 HTTP/1.1" 200 None 2025-09-27 16:30:59,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:59,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d810721fd44e101337f0a4 HTTP/1.1" 200 None 2025-09-27 16:30:59,344 - lava_callback - INFO - Completed processing callback for node 68d810721fd44e101337f0a4 2025-09-27 16:30:59,808 - lava_callback - INFO - Received callback for node 68d56e362be2da466069939e INFO: 172.21.0.1:39326 - "POST /node/68d56e362be2da466069939e HTTP/1.0" 202 Accepted 2025-09-27 16:30:59,814 - lava_callback - INFO - Starting async job submit for node 68d56e362be2da466069939e 2025-09-27 16:30:59,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:30:59,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e362be2da466069939e HTTP/1.1" 200 None 2025-09-27 16:30:59,828 - lava_callback - DEBUG - Processing node 68d56e362be2da466069939e: ltp-pty 2025-09-27 16:30:59,828 - lava_callback - ERROR - Error processing callback for node 68d56e362be2da466069939e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:31:00,583 - lava_callback - INFO - Received callback for node 68d56e372be2da46606993a2 INFO: 172.21.0.1:39342 - "POST /node/68d56e372be2da46606993a2 HTTP/1.0" 202 Accepted 2025-09-27 16:31:00,589 - lava_callback - INFO - Starting async job submit for node 68d56e372be2da46606993a2 2025-09-27 16:31:00,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:31:00,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e372be2da46606993a2 HTTP/1.1" 200 None 2025-09-27 16:31:00,603 - lava_callback - DEBUG - Processing node 68d56e372be2da46606993a2: ltp-sched 2025-09-27 16:31:00,603 - lava_callback - ERROR - Error processing callback for node 68d56e372be2da46606993a2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:31:01,351 - lava_callback - INFO - Received callback for node 68d56e372be2da46606993a5 INFO: 172.21.0.1:39354 - "POST /node/68d56e372be2da46606993a5 HTTP/1.0" 202 Accepted 2025-09-27 16:31:01,357 - lava_callback - INFO - Starting async job submit for node 68d56e372be2da46606993a5 2025-09-27 16:31:01,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:31:01,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e372be2da46606993a5 HTTP/1.1" 200 None 2025-09-27 16:31:01,373 - lava_callback - DEBUG - Processing node 68d56e372be2da46606993a5: ltp-smoketest 2025-09-27 16:31:01,373 - lava_callback - ERROR - Error processing callback for node 68d56e372be2da46606993a5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:31:02,186 - lava_callback - INFO - Received callback for node 68d56e382be2da46606993a8 INFO: 172.21.0.1:39362 - "POST /node/68d56e382be2da46606993a8 HTTP/1.0" 202 Accepted 2025-09-27 16:31:02,197 - lava_callback - INFO - Starting async job submit for node 68d56e382be2da46606993a8 2025-09-27 16:31:02,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:31:02,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e382be2da46606993a8 HTTP/1.1" 200 None 2025-09-27 16:31:02,214 - lava_callback - DEBUG - Processing node 68d56e382be2da46606993a8: ltp-syscalls 2025-09-27 16:31:02,214 - lava_callback - ERROR - Error processing callback for node 68d56e382be2da46606993a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:31:02,928 - lava_callback - INFO - Received callback for node 68d56e382be2da46606993ad INFO: 172.21.0.1:39372 - "POST /node/68d56e382be2da46606993ad HTTP/1.0" 202 Accepted 2025-09-27 16:31:02,935 - lava_callback - INFO - Starting async job submit for node 68d56e382be2da46606993ad 2025-09-27 16:31:02,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:31:02,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e382be2da46606993ad HTTP/1.1" 200 None 2025-09-27 16:31:02,951 - lava_callback - DEBUG - Processing node 68d56e382be2da46606993ad: ltp-syscalls-ipc 2025-09-27 16:31:02,951 - lava_callback - ERROR - Error processing callback for node 68d56e382be2da46606993ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:31:03,710 - lava_callback - INFO - Received callback for node 68d56e392be2da46606993b0 INFO: 172.21.0.1:39378 - "POST /node/68d56e392be2da46606993b0 HTTP/1.0" 202 Accepted 2025-09-27 16:31:03,718 - lava_callback - INFO - Starting async job submit for node 68d56e392be2da46606993b0 2025-09-27 16:31:03,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:31:03,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e392be2da46606993b0 HTTP/1.1" 200 None 2025-09-27 16:31:03,734 - lava_callback - DEBUG - Processing node 68d56e392be2da46606993b0: ltp-timers 2025-09-27 16:31:03,734 - lava_callback - ERROR - Error processing callback for node 68d56e392be2da46606993b0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:31:04,444 - lava_callback - INFO - Received callback for node 68d56e392be2da46606993b4 INFO: 172.21.0.1:39394 - "POST /node/68d56e392be2da46606993b4 HTTP/1.0" 202 Accepted 2025-09-27 16:31:04,454 - lava_callback - INFO - Starting async job submit for node 68d56e392be2da46606993b4 2025-09-27 16:31:04,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:31:04,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e392be2da46606993b4 HTTP/1.1" 200 None 2025-09-27 16:31:04,471 - lava_callback - DEBUG - Processing node 68d56e392be2da46606993b4: ltp-watchqueue 2025-09-27 16:31:04,471 - lava_callback - ERROR - Error processing callback for node 68d56e392be2da46606993b4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:35:10,409 - lava_callback - INFO - Received callback for node 68d811ff1fd44e101337f17b INFO: 172.21.0.1:41398 - "POST /node/68d811ff1fd44e101337f17b HTTP/1.0" 202 Accepted 2025-09-27 16:35:10,416 - lava_callback - INFO - Starting async job submit for node 68d811ff1fd44e101337f17b 2025-09-27 16:35:10,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:10,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ff1fd44e101337f17b HTTP/1.1" 200 None 2025-09-27 16:35:10,457 - lava_callback - DEBUG - Processing node 68d811ff1fd44e101337f17b: baseline-arm64-foundriesio 2025-09-27 16:35:10,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:10,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:10,979 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d811ff1fd44e101337f17b/log.txt.gz 2025-09-27 16:35:10,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:11,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:11,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d811ff1fd44e101337f17b/lava_callback.json.gz 2025-09-27 16:35:11,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:11,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ff1fd44e101337f17b HTTP/1.1" 200 None 2025-09-27 16:35:11,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:11,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:11,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:11,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811ff1fd44e101337f17b HTTP/1.1" 200 None 2025-09-27 16:35:11,245 - lava_callback - INFO - Completed processing callback for node 68d811ff1fd44e101337f17b 2025-09-27 16:35:13,358 - lava_callback - INFO - Received callback for node 68d811fe1fd44e101337f178 INFO: 172.21.0.1:41404 - "POST /node/68d811fe1fd44e101337f178 HTTP/1.0" 202 Accepted 2025-09-27 16:35:13,364 - lava_callback - INFO - Starting async job submit for node 68d811fe1fd44e101337f178 2025-09-27 16:35:13,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:13,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811fe1fd44e101337f178 HTTP/1.1" 200 None 2025-09-27 16:35:13,398 - lava_callback - DEBUG - Processing node 68d811fe1fd44e101337f178: baseline-arm64-foundriesio 2025-09-27 16:35:13,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:13,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:13,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d811fe1fd44e101337f178/log.txt.gz 2025-09-27 16:35:13,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:13,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:13,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d811fe1fd44e101337f178/lava_callback.json.gz 2025-09-27 16:35:13,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:13,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811fe1fd44e101337f178 HTTP/1.1" 200 None 2025-09-27 16:35:13,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:13,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:13,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:13,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811fe1fd44e101337f178 HTTP/1.1" 200 None 2025-09-27 16:35:14,000 - lava_callback - INFO - Completed processing callback for node 68d811fe1fd44e101337f178 2025-09-27 16:35:15,120 - lava_callback - INFO - Received callback for node 68d811ea1fd44e101337f131 INFO: 172.21.0.1:41408 - "POST /node/68d811ea1fd44e101337f131 HTTP/1.0" 202 Accepted 2025-09-27 16:35:15,126 - lava_callback - INFO - Starting async job submit for node 68d811ea1fd44e101337f131 2025-09-27 16:35:15,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:15,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ea1fd44e101337f131 HTTP/1.1" 200 None INFO: 172.21.0.1:41422 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 16:35:15,161 - lava_callback - DEBUG - Processing node 68d811ea1fd44e101337f131: baseline-arm64 2025-09-27 16:35:15,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:15,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:15,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811ea1fd44e101337f131/log.txt.gz 2025-09-27 16:35:15,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:15,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:15,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811ea1fd44e101337f131/lava_callback.json.gz 2025-09-27 16:35:15,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:15,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ea1fd44e101337f131 HTTP/1.1" 200 None 2025-09-27 16:35:15,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:15,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:15,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:15,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811ea1fd44e101337f131 HTTP/1.1" 200 None 2025-09-27 16:35:15,740 - lava_callback - INFO - Completed processing callback for node 68d811ea1fd44e101337f131 INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:35:20,154 - lava_callback - INFO - Received callback for node 68d811fb1fd44e101337f16f INFO: 172.21.0.1:35740 - "POST /node/68d811fb1fd44e101337f16f HTTP/1.0" 202 Accepted 2025-09-27 16:35:20,160 - lava_callback - INFO - Starting async job submit for node 68d811fb1fd44e101337f16f 2025-09-27 16:35:20,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:20,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811fb1fd44e101337f16f HTTP/1.1" 200 None 2025-09-27 16:35:20,192 - lava_callback - DEBUG - Processing node 68d811fb1fd44e101337f16f: baseline-arm64-pengutronix 2025-09-27 16:35:20,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:20,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:20,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d811fb1fd44e101337f16f/log.txt.gz 2025-09-27 16:35:20,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:20,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:20,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d811fb1fd44e101337f16f/lava_callback.json.gz 2025-09-27 16:35:20,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:20,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811fb1fd44e101337f16f HTTP/1.1" 200 None 2025-09-27 16:35:20,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:20,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:20,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:20,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811fb1fd44e101337f16f HTTP/1.1" 200 None 2025-09-27 16:35:20,707 - lava_callback - INFO - Completed processing callback for node 68d811fb1fd44e101337f16f 2025-09-27 16:35:23,725 - lava_callback - INFO - Received callback for node 68d811e61fd44e101337f11f INFO: 172.21.0.1:35750 - "POST /node/68d811e61fd44e101337f11f HTTP/1.0" 202 Accepted 2025-09-27 16:35:23,731 - lava_callback - INFO - Starting async job submit for node 68d811e61fd44e101337f11f 2025-09-27 16:35:23,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:23,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e61fd44e101337f11f HTTP/1.1" 200 None 2025-09-27 16:35:23,765 - lava_callback - DEBUG - Processing node 68d811e61fd44e101337f11f: baseline-arm64 2025-09-27 16:35:24,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:24,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:24,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e61fd44e101337f11f/log.txt.gz 2025-09-27 16:35:24,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:24,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:24,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e61fd44e101337f11f/lava_callback.json.gz 2025-09-27 16:35:24,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:24,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e61fd44e101337f11f HTTP/1.1" 200 None 2025-09-27 16:35:24,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:24,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:24,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:24,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e61fd44e101337f11f HTTP/1.1" 200 None 2025-09-27 16:35:24,457 - lava_callback - INFO - Completed processing callback for node 68d811e61fd44e101337f11f INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:35:28,283 - lava_callback - INFO - Received callback for node 68d811fd1fd44e101337f175 INFO: 172.21.0.1:35780 - "POST /node/68d811fd1fd44e101337f175 HTTP/1.0" 202 Accepted 2025-09-27 16:35:28,289 - lava_callback - INFO - Starting async job submit for node 68d811fd1fd44e101337f175 2025-09-27 16:35:28,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:28,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811fd1fd44e101337f175 HTTP/1.1" 200 None 2025-09-27 16:35:28,326 - lava_callback - DEBUG - Processing node 68d811fd1fd44e101337f175: baseline-arm64-pengutronix 2025-09-27 16:35:28,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:28,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:28,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d811fd1fd44e101337f175/log.txt.gz 2025-09-27 16:35:28,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:28,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:28,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d811fd1fd44e101337f175/lava_callback.json.gz 2025-09-27 16:35:28,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:28,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811fd1fd44e101337f175 HTTP/1.1" 200 None 2025-09-27 16:35:28,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:28,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:28,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:28,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811fd1fd44e101337f175 HTTP/1.1" 200 None 2025-09-27 16:35:28,839 - lava_callback - INFO - Completed processing callback for node 68d811fd1fd44e101337f175 2025-09-27 16:35:30,268 - lava_callback - INFO - Received callback for node 68d811e71fd44e101337f125 INFO: 172.21.0.1:41176 - "POST /node/68d811e71fd44e101337f125 HTTP/1.0" 202 Accepted 2025-09-27 16:35:30,275 - lava_callback - INFO - Starting async job submit for node 68d811e71fd44e101337f125 2025-09-27 16:35:30,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:30,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e71fd44e101337f125 HTTP/1.1" 200 None 2025-09-27 16:35:30,312 - lava_callback - DEBUG - Processing node 68d811e71fd44e101337f125: baseline-arm64 2025-09-27 16:35:30,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:30,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:30,850 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e71fd44e101337f125/log.txt.gz 2025-09-27 16:35:30,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:30,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:30,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e71fd44e101337f125/lava_callback.json.gz 2025-09-27 16:35:30,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:31,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e71fd44e101337f125 HTTP/1.1" 200 None 2025-09-27 16:35:31,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:31,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:31,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:31,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e71fd44e101337f125 HTTP/1.1" 200 None 2025-09-27 16:35:31,051 - lava_callback - INFO - Completed processing callback for node 68d811e71fd44e101337f125 2025-09-27 16:35:31,429 - lava_callback - INFO - Received callback for node 68d811e51fd44e101337f11c INFO: 172.21.0.1:41184 - "POST /node/68d811e51fd44e101337f11c HTTP/1.0" 202 Accepted 2025-09-27 16:35:31,435 - lava_callback - INFO - Starting async job submit for node 68d811e51fd44e101337f11c 2025-09-27 16:35:31,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:31,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e51fd44e101337f11c HTTP/1.1" 200 None 2025-09-27 16:35:31,471 - lava_callback - DEBUG - Processing node 68d811e51fd44e101337f11c: baseline-arm64 2025-09-27 16:35:31,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:31,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:31,843 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e51fd44e101337f11c/log.txt.gz 2025-09-27 16:35:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:31,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:31,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e51fd44e101337f11c/lava_callback.json.gz 2025-09-27 16:35:31,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:32,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e51fd44e101337f11c HTTP/1.1" 200 None 2025-09-27 16:35:32,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:32,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:32,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:32,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e51fd44e101337f11c HTTP/1.1" 200 None 2025-09-27 16:35:32,039 - lava_callback - INFO - Completed processing callback for node 68d811e51fd44e101337f11c 2025-09-27 16:35:32,193 - lava_callback - INFO - Received callback for node 68d811f91fd44e101337f166 INFO: 172.21.0.1:41200 - "POST /node/68d811f91fd44e101337f166 HTTP/1.0" 202 Accepted 2025-09-27 16:35:32,200 - lava_callback - INFO - Starting async job submit for node 68d811f91fd44e101337f166 2025-09-27 16:35:32,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:32,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f91fd44e101337f166 HTTP/1.1" 200 None 2025-09-27 16:35:32,236 - lava_callback - DEBUG - Processing node 68d811f91fd44e101337f166: baseline-arm64-kontron 2025-09-27 16:35:32,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:32,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:32,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d811f91fd44e101337f166/log.txt.gz 2025-09-27 16:35:32,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:32,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:32,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d811f91fd44e101337f166/lava_callback.json.gz 2025-09-27 16:35:32,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:32,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f91fd44e101337f166 HTTP/1.1" 200 None 2025-09-27 16:35:32,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:32,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:32,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:32,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f91fd44e101337f166 HTTP/1.1" 200 None 2025-09-27 16:35:32,848 - lava_callback - INFO - Completed processing callback for node 68d811f91fd44e101337f166 2025-09-27 16:35:34,968 - lava_callback - INFO - Received callback for node 68d811e41fd44e101337f116 INFO: 172.21.0.1:41214 - "POST /node/68d811e41fd44e101337f116 HTTP/1.0" 202 Accepted 2025-09-27 16:35:34,974 - lava_callback - INFO - Starting async job submit for node 68d811e41fd44e101337f116 2025-09-27 16:35:34,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:35,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e41fd44e101337f116 HTTP/1.1" 200 None 2025-09-27 16:35:35,008 - lava_callback - DEBUG - Processing node 68d811e41fd44e101337f116: baseline-arm64 2025-09-27 16:35:35,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:35,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:35,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e41fd44e101337f116/log.txt.gz 2025-09-27 16:35:35,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:35,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:35,508 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e41fd44e101337f116/lava_callback.json.gz 2025-09-27 16:35:35,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:35,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e41fd44e101337f116 HTTP/1.1" 200 None 2025-09-27 16:35:35,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:35,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:35,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:35,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e41fd44e101337f116 HTTP/1.1" 200 None 2025-09-27 16:35:35,588 - lava_callback - INFO - Completed processing callback for node 68d811e41fd44e101337f116 INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:35:40,955 - lava_callback - INFO - Received callback for node 68d811e21fd44e101337f110 INFO: 172.21.0.1:38316 - "POST /node/68d811e21fd44e101337f110 HTTP/1.0" 202 Accepted 2025-09-27 16:35:40,962 - lava_callback - INFO - Starting async job submit for node 68d811e21fd44e101337f110 2025-09-27 16:35:40,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:40,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e21fd44e101337f110 HTTP/1.1" 200 None 2025-09-27 16:35:40,996 - lava_callback - DEBUG - Processing node 68d811e21fd44e101337f110: baseline-arm64 2025-09-27 16:35:41,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:41,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:41,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e21fd44e101337f110/log.txt.gz 2025-09-27 16:35:41,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:41,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:41,510 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e21fd44e101337f110/lava_callback.json.gz 2025-09-27 16:35:41,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:41,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e21fd44e101337f110 HTTP/1.1" 200 None 2025-09-27 16:35:41,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:41,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:41,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:41,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e21fd44e101337f110 HTTP/1.1" 200 None 2025-09-27 16:35:41,604 - lava_callback - INFO - Completed processing callback for node 68d811e21fd44e101337f110 2025-09-27 16:35:41,809 - lava_callback - INFO - Received callback for node 68d811ea1fd44e101337f12e INFO: 172.21.0.1:38322 - "POST /node/68d811ea1fd44e101337f12e HTTP/1.0" 202 Accepted 2025-09-27 16:35:41,816 - lava_callback - INFO - Starting async job submit for node 68d811ea1fd44e101337f12e 2025-09-27 16:35:41,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:41,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ea1fd44e101337f12e HTTP/1.1" 200 None 2025-09-27 16:35:41,861 - lava_callback - DEBUG - Processing node 68d811ea1fd44e101337f12e: baseline-arm64 2025-09-27 16:35:42,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:42,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:42,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811ea1fd44e101337f12e/log.txt.gz 2025-09-27 16:35:42,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:42,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:42,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811ea1fd44e101337f12e/lava_callback.json.gz 2025-09-27 16:35:42,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:42,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ea1fd44e101337f12e HTTP/1.1" 200 None 2025-09-27 16:35:42,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:42,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:42,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:42,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811ea1fd44e101337f12e HTTP/1.1" 200 None 2025-09-27 16:35:42,532 - lava_callback - INFO - Completed processing callback for node 68d811ea1fd44e101337f12e 2025-09-27 16:35:42,815 - lava_callback - INFO - Received callback for node 68d811ec1fd44e101337f134 INFO: 172.21.0.1:38330 - "POST /node/68d811ec1fd44e101337f134 HTTP/1.0" 202 Accepted 2025-09-27 16:35:42,821 - lava_callback - INFO - Starting async job submit for node 68d811ec1fd44e101337f134 2025-09-27 16:35:42,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:42,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ec1fd44e101337f134 HTTP/1.1" 200 None 2025-09-27 16:35:42,879 - lava_callback - DEBUG - Processing node 68d811ec1fd44e101337f134: baseline-arm64-broonie 2025-09-27 16:35:43,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:43,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:43,253 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811ec1fd44e101337f134/log.txt.gz 2025-09-27 16:35:43,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:43,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:43,373 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811ec1fd44e101337f134/lava_callback.json.gz 2025-09-27 16:35:43,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:43,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ec1fd44e101337f134 HTTP/1.1" 200 None 2025-09-27 16:35:43,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:43,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:43,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:43,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811ec1fd44e101337f134 HTTP/1.1" 200 None 2025-09-27 16:35:43,456 - lava_callback - INFO - Completed processing callback for node 68d811ec1fd44e101337f134 2025-09-27 16:35:44,352 - lava_callback - INFO - Received callback for node 68d811de1fd44e101337f0ff INFO: 172.21.0.1:38344 - "POST /node/68d811de1fd44e101337f0ff HTTP/1.0" 202 Accepted 2025-09-27 16:35:44,358 - lava_callback - INFO - Starting async job submit for node 68d811de1fd44e101337f0ff 2025-09-27 16:35:44,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:44,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811de1fd44e101337f0ff HTTP/1.1" 200 None 2025-09-27 16:35:44,391 - lava_callback - DEBUG - Processing node 68d811de1fd44e101337f0ff: baseline-arm64 2025-09-27 16:35:44,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:44,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:44,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811de1fd44e101337f0ff/log.txt.gz 2025-09-27 16:35:44,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:44,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:44,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811de1fd44e101337f0ff/lava_callback.json.gz 2025-09-27 16:35:44,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:44,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811de1fd44e101337f0ff HTTP/1.1" 200 None 2025-09-27 16:35:44,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:44,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:44,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:44,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811de1fd44e101337f0ff HTTP/1.1" 200 None 2025-09-27 16:35:44,985 - lava_callback - INFO - Completed processing callback for node 68d811de1fd44e101337f0ff 2025-09-27 16:35:45,052 - lava_callback - INFO - Received callback for node 68d811ee1fd44e101337f13d INFO: 172.21.0.1:38358 - "POST /node/68d811ee1fd44e101337f13d HTTP/1.0" 202 Accepted 2025-09-27 16:35:45,061 - lava_callback - INFO - Starting async job submit for node 68d811ee1fd44e101337f13d 2025-09-27 16:35:45,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:45,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ee1fd44e101337f13d HTTP/1.1" 200 None 2025-09-27 16:35:45,100 - lava_callback - DEBUG - Processing node 68d811ee1fd44e101337f13d: baseline-arm64-broonie 2025-09-27 16:35:45,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:45,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:45,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811ee1fd44e101337f13d/log.txt.gz 2025-09-27 16:35:45,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:45,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:45,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811ee1fd44e101337f13d/lava_callback.json.gz 2025-09-27 16:35:45,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:45,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ee1fd44e101337f13d HTTP/1.1" 200 None 2025-09-27 16:35:45,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:45,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:45,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:45,711 - lava_callback - INFO - Received callback for node 68d811f11fd44e101337f146 INFO: 172.21.0.1:38370 - "POST /node/68d811f11fd44e101337f146 HTTP/1.0" 202 Accepted 2025-09-27 16:35:45,725 - lava_callback - INFO - Starting async job submit for node 68d811f11fd44e101337f146 2025-09-27 16:35:45,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811ee1fd44e101337f13d HTTP/1.1" 200 None 2025-09-27 16:35:45,743 - lava_callback - INFO - Completed processing callback for node 68d811ee1fd44e101337f13d 2025-09-27 16:35:45,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:45,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f11fd44e101337f146 HTTP/1.1" 200 None 2025-09-27 16:35:45,789 - lava_callback - DEBUG - Processing node 68d811f11fd44e101337f146: baseline-arm64-broonie 2025-09-27 16:35:45,917 - lava_callback - INFO - Received callback for node 68d811e91fd44e101337f12b INFO: 172.21.0.1:38382 - "POST /node/68d811e91fd44e101337f12b HTTP/1.0" 202 Accepted 2025-09-27 16:35:45,940 - lava_callback - INFO - Starting async job submit for node 68d811e91fd44e101337f12b 2025-09-27 16:35:45,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:46,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e91fd44e101337f12b HTTP/1.1" 200 None 2025-09-27 16:35:46,060 - lava_callback - DEBUG - Processing node 68d811e91fd44e101337f12b: baseline-arm64 2025-09-27 16:35:46,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:46,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:46,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f11fd44e101337f146/log.txt.gz 2025-09-27 16:35:46,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:46,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:46,501 - lava_callback - INFO - Received callback for node 68d811f01fd44e101337f140 2025-09-27 16:35:46,511 - lava_callback - INFO - Starting async job submit for node 68d811f01fd44e101337f140 INFO: 172.21.0.1:38384 - "POST /node/68d811f01fd44e101337f140 HTTP/1.0" 202 Accepted INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:35:46,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:46,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f01fd44e101337f140 HTTP/1.1" 200 None 2025-09-27 16:35:46,562 - lava_callback - DEBUG - Processing node 68d811f01fd44e101337f140: baseline-arm64-broonie 2025-09-27 16:35:46,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:46,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:46,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f11fd44e101337f146/lava_callback.json.gz 2025-09-27 16:35:46,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e91fd44e101337f12b/log.txt.gz 2025-09-27 16:35:46,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:46,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f11fd44e101337f146 HTTP/1.1" 200 None 2025-09-27 16:35:46,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:46,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:46,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:46,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:46,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:46,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f11fd44e101337f146 HTTP/1.1" 200 None 2025-09-27 16:35:46,911 - lava_callback - INFO - Completed processing callback for node 68d811f11fd44e101337f146 2025-09-27 16:35:47,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:47,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e91fd44e101337f12b/lava_callback.json.gz 2025-09-27 16:35:47,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:47,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:47,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f01fd44e101337f140/log.txt.gz 2025-09-27 16:35:47,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e91fd44e101337f12b HTTP/1.1" 200 None 2025-09-27 16:35:47,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:47,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:47,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:47,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:47,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e91fd44e101337f12b HTTP/1.1" 200 None 2025-09-27 16:35:47,112 - lava_callback - INFO - Completed processing callback for node 68d811e91fd44e101337f12b 2025-09-27 16:35:47,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:47,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f01fd44e101337f140/lava_callback.json.gz 2025-09-27 16:35:47,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:47,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f01fd44e101337f140 HTTP/1.1" 200 None 2025-09-27 16:35:47,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:47,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:47,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:47,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f01fd44e101337f140 HTTP/1.1" 200 None 2025-09-27 16:35:47,320 - lava_callback - INFO - Completed processing callback for node 68d811f01fd44e101337f140 2025-09-27 16:35:47,889 - lava_callback - INFO - Received callback for node 68d811f31fd44e101337f14c INFO: 172.21.0.1:38392 - "POST /node/68d811f31fd44e101337f14c HTTP/1.0" 202 Accepted 2025-09-27 16:35:47,896 - lava_callback - INFO - Starting async job submit for node 68d811f31fd44e101337f14c 2025-09-27 16:35:47,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:47,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f31fd44e101337f14c HTTP/1.1" 200 None 2025-09-27 16:35:47,935 - lava_callback - DEBUG - Processing node 68d811f31fd44e101337f14c: baseline-arm64-broonie 2025-09-27 16:35:48,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:48,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:48,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f31fd44e101337f14c/log.txt.gz 2025-09-27 16:35:48,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:48,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:48,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f31fd44e101337f14c/lava_callback.json.gz 2025-09-27 16:35:48,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:48,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f31fd44e101337f14c HTTP/1.1" 200 None 2025-09-27 16:35:48,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:48,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:48,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:48,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f31fd44e101337f14c HTTP/1.1" 200 None 2025-09-27 16:35:48,521 - lava_callback - INFO - Completed processing callback for node 68d811f31fd44e101337f14c 2025-09-27 16:35:49,296 - lava_callback - INFO - Received callback for node 68d811f61fd44e101337f15d INFO: 172.21.0.1:38394 - "POST /node/68d811f61fd44e101337f15d HTTP/1.0" 202 Accepted 2025-09-27 16:35:49,303 - lava_callback - INFO - Starting async job submit for node 68d811f61fd44e101337f15d 2025-09-27 16:35:49,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:49,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f61fd44e101337f15d HTTP/1.1" 200 None 2025-09-27 16:35:49,337 - lava_callback - DEBUG - Processing node 68d811f61fd44e101337f15d: baseline-arm64-broonie 2025-09-27 16:35:49,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:49,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:49,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f61fd44e101337f15d/log.txt.gz 2025-09-27 16:35:49,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:49,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:49,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f61fd44e101337f15d/lava_callback.json.gz 2025-09-27 16:35:49,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:49,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f61fd44e101337f15d HTTP/1.1" 200 None 2025-09-27 16:35:49,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:49,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:49,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:49,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f61fd44e101337f15d HTTP/1.1" 200 None 2025-09-27 16:35:49,890 - lava_callback - INFO - Completed processing callback for node 68d811f61fd44e101337f15d 2025-09-27 16:35:49,954 - lava_callback - INFO - Received callback for node 68d811f41fd44e101337f153 INFO: 172.21.0.1:43154 - "POST /node/68d811f41fd44e101337f153 HTTP/1.0" 202 Accepted 2025-09-27 16:35:49,960 - lava_callback - INFO - Starting async job submit for node 68d811f41fd44e101337f153 2025-09-27 16:35:49,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:49,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f41fd44e101337f153 HTTP/1.1" 200 None 2025-09-27 16:35:49,995 - lava_callback - DEBUG - Processing node 68d811f41fd44e101337f153: baseline-arm64-broonie 2025-09-27 16:35:50,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:50,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:50,451 - lava_callback - INFO - Received callback for node 68d811dc1fd44e101337f0fc INFO: 172.21.0.1:43162 - "POST /node/68d811dc1fd44e101337f0fc HTTP/1.0" 202 Accepted 2025-09-27 16:35:50,458 - lava_callback - INFO - Starting async job submit for node 68d811dc1fd44e101337f0fc 2025-09-27 16:35:50,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:50,482 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f41fd44e101337f153/log.txt.gz 2025-09-27 16:35:50,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:50,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811dc1fd44e101337f0fc HTTP/1.1" 200 None 2025-09-27 16:35:50,499 - lava_callback - DEBUG - Processing node 68d811dc1fd44e101337f0fc: baseline-arm64 2025-09-27 16:35:50,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:50,701 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f41fd44e101337f153/lava_callback.json.gz 2025-09-27 16:35:50,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:50,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f41fd44e101337f153 HTTP/1.1" 200 None 2025-09-27 16:35:50,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:50,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:50,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:50,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:50,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f41fd44e101337f153 HTTP/1.1" 200 None 2025-09-27 16:35:50,892 - lava_callback - INFO - Completed processing callback for node 68d811f41fd44e101337f153 2025-09-27 16:35:50,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:50,999 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811dc1fd44e101337f0fc/log.txt.gz 2025-09-27 16:35:51,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:51,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:51,128 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811dc1fd44e101337f0fc/lava_callback.json.gz 2025-09-27 16:35:51,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:51,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811dc1fd44e101337f0fc HTTP/1.1" 200 None 2025-09-27 16:35:51,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:51,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:51,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:51,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811dc1fd44e101337f0fc HTTP/1.1" 200 None 2025-09-27 16:35:51,215 - lava_callback - INFO - Completed processing callback for node 68d811dc1fd44e101337f0fc 2025-09-27 16:35:52,223 - lava_callback - INFO - Received callback for node 68d811f81fd44e101337f163 INFO: 172.21.0.1:43172 - "POST /node/68d811f81fd44e101337f163 HTTP/1.0" 202 Accepted 2025-09-27 16:35:52,231 - lava_callback - INFO - Starting async job submit for node 68d811f81fd44e101337f163 2025-09-27 16:35:52,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:52,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f81fd44e101337f163 HTTP/1.1" 200 None 2025-09-27 16:35:52,288 - lava_callback - DEBUG - Processing node 68d811f81fd44e101337f163: baseline-arm64-kontron 2025-09-27 16:35:52,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:52,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:52,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d811f81fd44e101337f163/log.txt.gz 2025-09-27 16:35:52,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:52,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:52,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d811f81fd44e101337f163/lava_callback.json.gz 2025-09-27 16:35:52,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:52,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f81fd44e101337f163 HTTP/1.1" 200 None 2025-09-27 16:35:52,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:52,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:52,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:52,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f81fd44e101337f163 HTTP/1.1" 200 None 2025-09-27 16:35:52,865 - lava_callback - INFO - Completed processing callback for node 68d811f81fd44e101337f163 2025-09-27 16:35:53,182 - lava_callback - INFO - Received callback for node 68d811e11fd44e101337f10a INFO: 172.21.0.1:43176 - "POST /node/68d811e11fd44e101337f10a HTTP/1.0" 202 Accepted 2025-09-27 16:35:53,190 - lava_callback - INFO - Starting async job submit for node 68d811e11fd44e101337f10a 2025-09-27 16:35:53,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:53,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e11fd44e101337f10a HTTP/1.1" 200 None 2025-09-27 16:35:53,233 - lava_callback - DEBUG - Processing node 68d811e11fd44e101337f10a: baseline-arm64 2025-09-27 16:35:53,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:53,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:53,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e11fd44e101337f10a/log.txt.gz 2025-09-27 16:35:53,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:54,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:54,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e11fd44e101337f10a/lava_callback.json.gz 2025-09-27 16:35:54,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:54,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e11fd44e101337f10a HTTP/1.1" 200 None 2025-09-27 16:35:54,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:54,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:54,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:54,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e11fd44e101337f10a HTTP/1.1" 200 None 2025-09-27 16:35:54,175 - lava_callback - INFO - Completed processing callback for node 68d811e11fd44e101337f10a 2025-09-27 16:35:54,907 - lava_callback - INFO - Received callback for node 68d811df1fd44e101337f102 INFO: 172.21.0.1:43192 - "POST /node/68d811df1fd44e101337f102 HTTP/1.0" 202 Accepted 2025-09-27 16:35:54,914 - lava_callback - INFO - Starting async job submit for node 68d811df1fd44e101337f102 2025-09-27 16:35:54,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:54,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811df1fd44e101337f102 HTTP/1.1" 200 None 2025-09-27 16:35:54,954 - lava_callback - DEBUG - Processing node 68d811df1fd44e101337f102: baseline-arm64 INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:35:55,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:55,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:55,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811df1fd44e101337f102/log.txt.gz 2025-09-27 16:35:55,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:55,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:55,705 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811df1fd44e101337f102/lava_callback.json.gz 2025-09-27 16:35:55,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:55,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811df1fd44e101337f102 HTTP/1.1" 200 None 2025-09-27 16:35:55,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:55,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:55,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:55,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811df1fd44e101337f102 HTTP/1.1" 200 None 2025-09-27 16:35:55,802 - lava_callback - INFO - Completed processing callback for node 68d811df1fd44e101337f102 INFO: 172.21.0.1:43216 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:35:57,064 - lava_callback - INFO - Received callback for node 68d811e81fd44e101337f128 INFO: 172.21.0.1:43224 - "POST /node/68d811e81fd44e101337f128 HTTP/1.0" 202 Accepted 2025-09-27 16:35:57,071 - lava_callback - INFO - Starting async job submit for node 68d811e81fd44e101337f128 2025-09-27 16:35:57,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:57,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e81fd44e101337f128 HTTP/1.1" 200 None 2025-09-27 16:35:57,114 - lava_callback - DEBUG - Processing node 68d811e81fd44e101337f128: baseline-arm64 2025-09-27 16:35:57,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:57,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:57,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e81fd44e101337f128/log.txt.gz 2025-09-27 16:35:57,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:57,673 - lava_callback - INFO - Received callback for node 68d811e31fd44e101337f113 INFO: 172.21.0.1:43236 - "POST /node/68d811e31fd44e101337f113 HTTP/1.0" 202 Accepted 2025-09-27 16:35:57,680 - lava_callback - INFO - Starting async job submit for node 68d811e31fd44e101337f113 2025-09-27 16:35:57,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:57,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e31fd44e101337f113 HTTP/1.1" 200 None 2025-09-27 16:35:57,715 - lava_callback - DEBUG - Processing node 68d811e31fd44e101337f113: baseline-arm64 2025-09-27 16:35:57,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:57,827 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e81fd44e101337f128/lava_callback.json.gz 2025-09-27 16:35:57,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:57,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e81fd44e101337f128 HTTP/1.1" 200 None 2025-09-27 16:35:57,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:58,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:58,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:58,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:58,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e81fd44e101337f128 HTTP/1.1" 200 None 2025-09-27 16:35:58,114 - lava_callback - INFO - Completed processing callback for node 68d811e81fd44e101337f128 2025-09-27 16:35:58,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:58,252 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e31fd44e101337f113/log.txt.gz 2025-09-27 16:35:58,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:35:58,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:35:58,408 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e31fd44e101337f113/lava_callback.json.gz 2025-09-27 16:35:58,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:58,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e31fd44e101337f113 HTTP/1.1" 200 None 2025-09-27 16:35:58,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:58,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:35:58,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:35:58,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e31fd44e101337f113 HTTP/1.1" 200 None 2025-09-27 16:35:58,491 - lava_callback - INFO - Completed processing callback for node 68d811e31fd44e101337f113 2025-09-27 16:36:02,689 - lava_callback - INFO - Received callback for node 68d56e342be2da466069938f INFO: 172.21.0.1:40792 - "POST /node/68d56e342be2da466069938f HTTP/1.0" 202 Accepted 2025-09-27 16:36:02,697 - lava_callback - INFO - Starting async job submit for node 68d56e342be2da466069938f 2025-09-27 16:36:02,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:02,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e342be2da466069938f HTTP/1.1" 200 None 2025-09-27 16:36:02,828 - lava_callback - DEBUG - Processing node 68d56e342be2da466069938f: ltp-fs-bind 2025-09-27 16:36:03,355 - lava_callback - ERROR - Error processing callback for node 68d56e342be2da466069938f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 16:36:04,591 - lava_callback - INFO - Received callback for node 68d811f71fd44e101337f160 INFO: 172.21.0.1:40802 - "POST /node/68d811f71fd44e101337f160 HTTP/1.0" 202 Accepted 2025-09-27 16:36:04,597 - lava_callback - INFO - Starting async job submit for node 68d811f71fd44e101337f160 2025-09-27 16:36:04,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f71fd44e101337f160 HTTP/1.1" 200 None 2025-09-27 16:36:04,636 - lava_callback - DEBUG - Processing node 68d811f71fd44e101337f160: baseline-arm64-broonie 2025-09-27 16:36:04,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:36:04,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:36:04,999 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f71fd44e101337f160/log.txt.gz 2025-09-27 16:36:05,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:36:05,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:36:05,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f71fd44e101337f160/lava_callback.json.gz 2025-09-27 16:36:05,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:05,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f71fd44e101337f160 HTTP/1.1" 200 None 2025-09-27 16:36:05,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:05,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:36:05,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:05,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f71fd44e101337f160 HTTP/1.1" 200 None 2025-09-27 16:36:05,191 - lava_callback - INFO - Completed processing callback for node 68d811f71fd44e101337f160 2025-09-27 16:36:05,698 - lava_callback - INFO - Received callback for node 68d811e21fd44e101337f10d INFO: 172.21.0.1:40804 - "POST /node/68d811e21fd44e101337f10d HTTP/1.0" 202 Accepted 2025-09-27 16:36:05,704 - lava_callback - INFO - Starting async job submit for node 68d811e21fd44e101337f10d 2025-09-27 16:36:05,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:05,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e21fd44e101337f10d HTTP/1.1" 200 None 2025-09-27 16:36:05,741 - lava_callback - DEBUG - Processing node 68d811e21fd44e101337f10d: baseline-arm64 INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:36:06,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:36:06,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:36:06,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e21fd44e101337f10d/log.txt.gz 2025-09-27 16:36:06,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:36:06,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:36:06,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e21fd44e101337f10d/lava_callback.json.gz 2025-09-27 16:36:06,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:06,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e21fd44e101337f10d HTTP/1.1" 200 None 2025-09-27 16:36:06,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:06,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:36:06,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:06,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e21fd44e101337f10d HTTP/1.1" 200 None 2025-09-27 16:36:06,504 - lava_callback - INFO - Completed processing callback for node 68d811e21fd44e101337f10d INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:36:22,310 - lava_callback - INFO - Received callback for node 68d811ed1fd44e101337f137 INFO: 172.21.0.1:41708 - "POST /node/68d811ed1fd44e101337f137 HTTP/1.0" 202 Accepted 2025-09-27 16:36:22,316 - lava_callback - INFO - Starting async job submit for node 68d811ed1fd44e101337f137 2025-09-27 16:36:22,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:22,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ed1fd44e101337f137 HTTP/1.1" 200 None 2025-09-27 16:36:22,392 - lava_callback - DEBUG - Processing node 68d811ed1fd44e101337f137: baseline-arm64-broonie 2025-09-27 16:36:22,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:36:22,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:36:22,742 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811ed1fd44e101337f137/log.txt.gz 2025-09-27 16:36:22,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:36:22,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:36:22,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811ed1fd44e101337f137/lava_callback.json.gz 2025-09-27 16:36:22,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:22,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ed1fd44e101337f137 HTTP/1.1" 200 None 2025-09-27 16:36:22,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:22,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:36:22,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:36:22,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811ed1fd44e101337f137 HTTP/1.1" 200 None 2025-09-27 16:36:22,982 - lava_callback - INFO - Completed processing callback for node 68d811ed1fd44e101337f137 INFO: 172.21.0.1:41718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:37:42,187 - lava_callback - INFO - Received callback for node 68d811f01fd44e101337f143 INFO: 172.21.0.1:53042 - "POST /node/68d811f01fd44e101337f143 HTTP/1.0" 202 Accepted 2025-09-27 16:37:42,196 - lava_callback - INFO - Starting async job submit for node 68d811f01fd44e101337f143 2025-09-27 16:37:42,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:37:42,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f01fd44e101337f143 HTTP/1.1" 200 None 2025-09-27 16:37:42,242 - lava_callback - DEBUG - Processing node 68d811f01fd44e101337f143: baseline-arm64-broonie 2025-09-27 16:37:42,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:37:42,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:37:42,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f01fd44e101337f143/log.txt.gz 2025-09-27 16:37:42,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:37:42,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:37:42,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f01fd44e101337f143/lava_callback.json.gz 2025-09-27 16:37:42,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:37:42,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f01fd44e101337f143 HTTP/1.1" 200 None 2025-09-27 16:37:42,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:37:42,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:37:42,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:37:42,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f01fd44e101337f143 HTTP/1.1" 200 None 2025-09-27 16:37:42,882 - lava_callback - INFO - Completed processing callback for node 68d811f01fd44e101337f143 INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:38:03,484 - lava_callback - INFO - Received callback for node 68d571142be2da46606994ea INFO: 172.21.0.1:60130 - "POST /node/68d571142be2da46606994ea HTTP/1.0" 202 Accepted 2025-09-27 16:38:03,490 - lava_callback - INFO - Starting async job submit for node 68d571142be2da46606994ea 2025-09-27 16:38:03,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:03,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571142be2da46606994ea HTTP/1.1" 200 None 2025-09-27 16:38:03,524 - lava_callback - DEBUG - Processing node 68d571142be2da46606994ea: baseline-arm-broonie 2025-09-27 16:38:03,725 - lava_callback - ERROR - Error processing callback for node 68d571142be2da46606994ea: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60148 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:38:14,478 - lava_callback - INFO - Received callback for node 68d759d1a6a7b6615d4c4de8 INFO: 172.21.0.1:58598 - "POST /node/68d759d1a6a7b6615d4c4de8 HTTP/1.0" 202 Accepted 2025-09-27 16:38:14,484 - lava_callback - INFO - Starting async job submit for node 68d759d1a6a7b6615d4c4de8 2025-09-27 16:38:14,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:14,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d1a6a7b6615d4c4de8 HTTP/1.1" 200 None 2025-09-27 16:38:14,537 - lava_callback - DEBUG - Processing node 68d759d1a6a7b6615d4c4de8: baseline-arm 2025-09-27 16:38:14,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:38:14,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:38:14,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d1a6a7b6615d4c4de8/log.txt.gz 2025-09-27 16:38:14,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:38:15,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:38:15,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d1a6a7b6615d4c4de8/lava_callback.json.gz 2025-09-27 16:38:15,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:15,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d1a6a7b6615d4c4de8 HTTP/1.1" 200 None 2025-09-27 16:38:15,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:15,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:38:15,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:15,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d759d1a6a7b6615d4c4de8 HTTP/1.1" 200 None 2025-09-27 16:38:15,139 - lava_callback - INFO - Completed processing callback for node 68d759d1a6a7b6615d4c4de8 INFO: 172.21.0.1:58602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:38:32,443 - lava_callback - INFO - Received callback for node 68d812691fd44e101337f1df INFO: 172.21.0.1:50662 - "POST /node/68d812691fd44e101337f1df HTTP/1.0" 202 Accepted 2025-09-27 16:38:32,454 - lava_callback - INFO - Starting async job submit for node 68d812691fd44e101337f1df 2025-09-27 16:38:32,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:32,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d812691fd44e101337f1df HTTP/1.1" 200 None 2025-09-27 16:38:32,518 - lava_callback - DEBUG - Processing node 68d812691fd44e101337f1df: baseline-arm64-kontron 2025-09-27 16:38:32,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:38:32,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:38:32,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d812691fd44e101337f1df/log.txt.gz 2025-09-27 16:38:32,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:38:33,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:38:33,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d812691fd44e101337f1df/lava_callback.json.gz 2025-09-27 16:38:33,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:33,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d812691fd44e101337f1df HTTP/1.1" 200 None 2025-09-27 16:38:33,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:33,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:38:33,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:38:33,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d812691fd44e101337f1df HTTP/1.1" 200 None 2025-09-27 16:38:33,182 - lava_callback - INFO - Completed processing callback for node 68d812691fd44e101337f1df INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:40:01,900 - lava_callback - INFO - Received callback for node 68d811f51fd44e101337f159 INFO: 172.21.0.1:40790 - "POST /node/68d811f51fd44e101337f159 HTTP/1.0" 202 Accepted 2025-09-27 16:40:01,906 - lava_callback - INFO - Starting async job submit for node 68d811f51fd44e101337f159 2025-09-27 16:40:01,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:01,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f51fd44e101337f159 HTTP/1.1" 200 None 2025-09-27 16:40:01,952 - lava_callback - DEBUG - Processing node 68d811f51fd44e101337f159: baseline-arm64-broonie 2025-09-27 16:40:02,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:40:02,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:40:02,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f51fd44e101337f159/log.txt.gz 2025-09-27 16:40:02,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:40:02,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:40:02,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f51fd44e101337f159/lava_callback.json.gz 2025-09-27 16:40:02,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:02,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f51fd44e101337f159 HTTP/1.1" 200 None 2025-09-27 16:40:02,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:02,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:40:02,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:02,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f51fd44e101337f159 HTTP/1.1" 200 None 2025-09-27 16:40:02,510 - lava_callback - INFO - Completed processing callback for node 68d811f51fd44e101337f159 INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:40:34,918 - lava_callback - INFO - Received callback for node 68d759d1a6a7b6615d4c4deb INFO: 172.21.0.1:58818 - "POST /node/68d759d1a6a7b6615d4c4deb HTTP/1.0" 202 Accepted 2025-09-27 16:40:34,924 - lava_callback - INFO - Starting async job submit for node 68d759d1a6a7b6615d4c4deb 2025-09-27 16:40:34,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d1a6a7b6615d4c4deb HTTP/1.1" 200 None 2025-09-27 16:40:34,958 - lava_callback - DEBUG - Processing node 68d759d1a6a7b6615d4c4deb: baseline-arm 2025-09-27 16:40:35,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:40:35,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:40:35,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d1a6a7b6615d4c4deb/log.txt.gz 2025-09-27 16:40:35,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:40:35,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:40:35,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d1a6a7b6615d4c4deb/lava_callback.json.gz 2025-09-27 16:40:35,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:35,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d1a6a7b6615d4c4deb HTTP/1.1" 200 None 2025-09-27 16:40:35,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:35,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:40:35,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:35,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d759d1a6a7b6615d4c4deb HTTP/1.1" 200 None 2025-09-27 16:40:35,491 - lava_callback - INFO - Completed processing callback for node 68d759d1a6a7b6615d4c4deb INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:40:52,365 - lava_callback - INFO - Received callback for node 68d8130a1fd44e101337f20a INFO: 172.21.0.1:55336 - "POST /node/68d8130a1fd44e101337f20a HTTP/1.0" 202 Accepted 2025-09-27 16:40:52,375 - lava_callback - INFO - Starting async job submit for node 68d8130a1fd44e101337f20a 2025-09-27 16:40:52,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:52,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8130a1fd44e101337f20a HTTP/1.1" 200 None 2025-09-27 16:40:52,464 - lava_callback - DEBUG - Processing node 68d8130a1fd44e101337f20a: baseline-arm64-kontron 2025-09-27 16:40:52,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:40:53,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:40:53,764 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d8130a1fd44e101337f20a/log.txt.gz 2025-09-27 16:40:53,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:40:54,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:40:54,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d8130a1fd44e101337f20a/lava_callback.json.gz 2025-09-27 16:40:54,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:54,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8130a1fd44e101337f20a HTTP/1.1" 200 None 2025-09-27 16:40:54,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:54,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:40:54,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:40:54,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8130a1fd44e101337f20a HTTP/1.1" 200 None 2025-09-27 16:40:54,404 - lava_callback - INFO - Completed processing callback for node 68d8130a1fd44e101337f20a INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:41:03,783 - lava_callback - INFO - Received callback for node 68d811f21fd44e101337f149 INFO: 172.21.0.1:59504 - "POST /node/68d811f21fd44e101337f149 HTTP/1.0" 202 Accepted 2025-09-27 16:41:03,793 - lava_callback - INFO - Starting async job submit for node 68d811f21fd44e101337f149 2025-09-27 16:41:03,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:41:03,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f21fd44e101337f149 HTTP/1.1" 200 None 2025-09-27 16:41:03,883 - lava_callback - DEBUG - Processing node 68d811f21fd44e101337f149: baseline-arm64-broonie 2025-09-27 16:41:04,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:41:05,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:41:05,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f21fd44e101337f149/log.txt.gz 2025-09-27 16:41:05,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:41:05,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:41:05,831 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811f21fd44e101337f149/lava_callback.json.gz 2025-09-27 16:41:05,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:41:05,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811f21fd44e101337f149 HTTP/1.1" 200 None 2025-09-27 16:41:05,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:41:05,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:41:05,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:41:05,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811f21fd44e101337f149 HTTP/1.1" 200 None 2025-09-27 16:41:05,988 - lava_callback - INFO - Completed processing callback for node 68d811f21fd44e101337f149 INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:41:25,662 - lava_callback - INFO - Received callback for node 68d56e322be2da4660699384 INFO: 172.21.0.1:53322 - "POST /node/68d56e322be2da4660699384 HTTP/1.0" 202 Accepted 2025-09-27 16:41:25,683 - lava_callback - INFO - Starting async job submit for node 68d56e322be2da4660699384 2025-09-27 16:41:26,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:41:26,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e322be2da4660699384 HTTP/1.1" 200 None 2025-09-27 16:41:26,333 - lava_callback - DEBUG - Processing node 68d56e322be2da4660699384: ltp-controllers INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:41:31,183 - lava_callback - ERROR - Error processing callback for node 68d56e322be2da4660699384: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:41:55,170 - lava_callback - INFO - Received callback for node 68d732d2a6a7b6615d4c459f INFO: 172.21.0.1:33036 - "POST /node/68d732d2a6a7b6615d4c459f HTTP/1.0" 202 Accepted 2025-09-27 16:41:55,177 - lava_callback - INFO - Starting async job submit for node 68d732d2a6a7b6615d4c459f 2025-09-27 16:41:55,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:41:55,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732d2a6a7b6615d4c459f HTTP/1.1" 200 None 2025-09-27 16:41:55,363 - lava_callback - DEBUG - Processing node 68d732d2a6a7b6615d4c459f: baseline-arm64 2025-09-27 16:41:56,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:41:56,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:41:56,389 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732d2a6a7b6615d4c459f/log.txt.gz 2025-09-27 16:41:56,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33046 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:41:56,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:41:56,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732d2a6a7b6615d4c459f/lava_callback.json.gz DEBUG: Setup failed for 68d732d2a6a7b6615d4c459f. Transitting job node result: incomplete -> fail 2025-09-27 16:41:56,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:41:56,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732d2a6a7b6615d4c459f HTTP/1.1" 200 None 2025-09-27 16:41:56,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:41:56,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 16:41:56,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:41:56,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732d2a6a7b6615d4c459f HTTP/1.1" 200 None 2025-09-27 16:41:56,979 - lava_callback - INFO - Completed processing callback for node 68d732d2a6a7b6615d4c459f 2025-09-27 16:42:04,506 - lava_callback - INFO - Received callback for node 68d732d4a6a7b6615d4c45a5 INFO: 172.21.0.1:50286 - "POST /node/68d732d4a6a7b6615d4c45a5 HTTP/1.0" 202 Accepted 2025-09-27 16:42:04,513 - lava_callback - INFO - Starting async job submit for node 68d732d4a6a7b6615d4c45a5 2025-09-27 16:42:04,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:04,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732d4a6a7b6615d4c45a5 HTTP/1.1" 200 None 2025-09-27 16:42:04,566 - lava_callback - DEBUG - Processing node 68d732d4a6a7b6615d4c45a5: baseline-arm64 2025-09-27 16:42:05,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:05,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:05,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732d4a6a7b6615d4c45a5/log.txt.gz 2025-09-27 16:42:05,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:05,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:05,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732d4a6a7b6615d4c45a5/lava_callback.json.gz DEBUG: Setup failed for 68d732d4a6a7b6615d4c45a5. Transitting job node result: incomplete -> fail 2025-09-27 16:42:05,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:05,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732d4a6a7b6615d4c45a5 HTTP/1.1" 200 None 2025-09-27 16:42:05,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:05,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 16:42:05,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:05,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732d4a6a7b6615d4c45a5 HTTP/1.1" 200 None 2025-09-27 16:42:05,962 - lava_callback - INFO - Completed processing callback for node 68d732d4a6a7b6615d4c45a5 INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:42:21,676 - lava_callback - INFO - Received callback for node 68d571212be2da4660699541 INFO: 172.21.0.1:48468 - "POST /node/68d571212be2da4660699541 HTTP/1.0" 202 Accepted 2025-09-27 16:42:21,685 - lava_callback - INFO - Starting async job submit for node 68d571212be2da4660699541 2025-09-27 16:42:21,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:21,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571212be2da4660699541 HTTP/1.1" 200 None 2025-09-27 16:42:21,726 - lava_callback - DEBUG - Processing node 68d571212be2da4660699541: ltp-cap-bounds 2025-09-27 16:42:22,085 - lava_callback - ERROR - Error processing callback for node 68d571212be2da4660699541: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 16:42:24,596 - lava_callback - INFO - Received callback for node 68d732d7a6a7b6615d4c45a8 INFO: 172.21.0.1:48472 - "POST /node/68d732d7a6a7b6615d4c45a8 HTTP/1.0" 202 Accepted 2025-09-27 16:42:24,603 - lava_callback - INFO - Starting async job submit for node 68d732d7a6a7b6615d4c45a8 2025-09-27 16:42:24,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:24,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732d7a6a7b6615d4c45a8 HTTP/1.1" 200 None 2025-09-27 16:42:24,660 - lava_callback - DEBUG - Processing node 68d732d7a6a7b6615d4c45a8: baseline-arm64 2025-09-27 16:42:25,592 - lava_callback - INFO - Received callback for node 68d811e41fd44e101337f119 INFO: 172.21.0.1:48480 - "POST /node/68d811e41fd44e101337f119 HTTP/1.0" 202 Accepted 2025-09-27 16:42:25,601 - lava_callback - INFO - Starting async job submit for node 68d811e41fd44e101337f119 2025-09-27 16:42:25,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:25,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:25,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e41fd44e101337f119 HTTP/1.1" 200 None 2025-09-27 16:42:25,659 - lava_callback - DEBUG - Processing node 68d811e41fd44e101337f119: baseline-arm64 2025-09-27 16:42:25,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:25,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732d7a6a7b6615d4c45a8/log.txt.gz 2025-09-27 16:42:25,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:25,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:26,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:26,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e41fd44e101337f119/log.txt.gz 2025-09-27 16:42:26,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:26,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:26,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732d7a6a7b6615d4c45a8/lava_callback.json.gz DEBUG: Setup failed for 68d732d7a6a7b6615d4c45a8. Transitting job node result: incomplete -> fail 2025-09-27 16:42:26,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:26,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732d7a6a7b6615d4c45a8 HTTP/1.1" 200 None 2025-09-27 16:42:26,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:26,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 16:42:26,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:26,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732d7a6a7b6615d4c45a8 HTTP/1.1" 200 None 2025-09-27 16:42:26,287 - lava_callback - INFO - Completed processing callback for node 68d732d7a6a7b6615d4c45a8 2025-09-27 16:42:26,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:26,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d811e41fd44e101337f119/lava_callback.json.gz 2025-09-27 16:42:26,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:26,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811e41fd44e101337f119 HTTP/1.1" 200 None 2025-09-27 16:42:26,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:26,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:42:26,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:26,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811e41fd44e101337f119 HTTP/1.1" 200 None 2025-09-27 16:42:26,410 - lava_callback - INFO - Completed processing callback for node 68d811e41fd44e101337f119 INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:42:29,451 - lava_callback - INFO - Received callback for node 68d80f9d1fd44e101337efe9 INFO: 172.21.0.1:59368 - "POST /node/68d80f9d1fd44e101337efe9 HTTP/1.0" 202 Accepted 2025-09-27 16:42:29,458 - lava_callback - INFO - Starting async job submit for node 68d80f9d1fd44e101337efe9 2025-09-27 16:42:29,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:29,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9d1fd44e101337efe9 HTTP/1.1" 200 None 2025-09-27 16:42:29,501 - lava_callback - DEBUG - Processing node 68d80f9d1fd44e101337efe9: baseline-arm 2025-09-27 16:42:29,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:29,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:29,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9d1fd44e101337efe9/log.txt.gz 2025-09-27 16:42:29,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:30,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:30,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9d1fd44e101337efe9/lava_callback.json.gz DEBUG: Setup failed for 68d80f9d1fd44e101337efe9. Transitting job node result: incomplete -> fail 2025-09-27 16:42:30,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:30,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9d1fd44e101337efe9 HTTP/1.1" 200 None 2025-09-27 16:42:30,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:30,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 16:42:30,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:30,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9d1fd44e101337efe9 HTTP/1.1" 200 None 2025-09-27 16:42:30,241 - lava_callback - INFO - Completed processing callback for node 68d80f9d1fd44e101337efe9 INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54324 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:42:54,335 - lava_callback - INFO - Received callback for node 68d759d3a6a7b6615d4c4dee INFO: 172.21.0.1:44788 - "POST /node/68d759d3a6a7b6615d4c4dee HTTP/1.0" 202 Accepted 2025-09-27 16:42:54,341 - lava_callback - INFO - Starting async job submit for node 68d759d3a6a7b6615d4c4dee 2025-09-27 16:42:54,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:54,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d3a6a7b6615d4c4dee HTTP/1.1" 200 None 2025-09-27 16:42:54,374 - lava_callback - DEBUG - Processing node 68d759d3a6a7b6615d4c4dee: baseline-arm 2025-09-27 16:42:54,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:54,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:54,870 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d3a6a7b6615d4c4dee/log.txt.gz 2025-09-27 16:42:54,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:42:55,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:42:55,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d3a6a7b6615d4c4dee/lava_callback.json.gz 2025-09-27 16:42:55,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:55,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d3a6a7b6615d4c4dee HTTP/1.1" 200 None 2025-09-27 16:42:55,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:55,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:42:55,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:42:55,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d759d3a6a7b6615d4c4dee HTTP/1.1" 200 None 2025-09-27 16:42:55,152 - lava_callback - INFO - Completed processing callback for node 68d759d3a6a7b6615d4c4dee INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:43:05,686 - lava_callback - INFO - Received callback for node 68d571102be2da46606994bc INFO: 172.21.0.1:48826 - "POST /node/68d571102be2da46606994bc HTTP/1.0" 202 Accepted 2025-09-27 16:43:05,691 - lava_callback - INFO - Starting async job submit for node 68d571102be2da46606994bc 2025-09-27 16:43:05,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:05,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571102be2da46606994bc HTTP/1.1" 200 None 2025-09-27 16:43:05,706 - lava_callback - DEBUG - Processing node 68d571102be2da46606994bc: baseline-arm 2025-09-27 16:43:05,706 - lava_callback - ERROR - Error processing callback for node 68d571102be2da46606994bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:48834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48840 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:43:13,256 - lava_callback - INFO - Received callback for node 68d571172be2da4660699502 INFO: 172.21.0.1:43760 - "POST /node/68d571172be2da4660699502 HTTP/1.0" 202 Accepted 2025-09-27 16:43:13,261 - lava_callback - INFO - Starting async job submit for node 68d571172be2da4660699502 2025-09-27 16:43:13,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:13,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571172be2da4660699502 HTTP/1.1" 200 None 2025-09-27 16:43:13,281 - lava_callback - DEBUG - Processing node 68d571172be2da4660699502: baseline-arm-clabbe 2025-09-27 16:43:13,281 - lava_callback - ERROR - Error processing callback for node 68d571172be2da4660699502: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:13,915 - lava_callback - INFO - Received callback for node 68d571192be2da466069950b INFO: 172.21.0.1:43770 - "POST /node/68d571192be2da466069950b HTTP/1.0" 202 Accepted 2025-09-27 16:43:13,920 - lava_callback - INFO - Starting async job submit for node 68d571192be2da466069950b 2025-09-27 16:43:13,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:13,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571192be2da466069950b HTTP/1.1" 200 None 2025-09-27 16:43:13,933 - lava_callback - DEBUG - Processing node 68d571192be2da466069950b: baseline-arm-clabbe 2025-09-27 16:43:13,933 - lava_callback - ERROR - Error processing callback for node 68d571192be2da466069950b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:14,575 - lava_callback - INFO - Received callback for node 68d5711a2be2da4660699514 INFO: 172.21.0.1:43772 - "POST /node/68d5711a2be2da4660699514 HTTP/1.0" 202 Accepted 2025-09-27 16:43:14,584 - lava_callback - INFO - Starting async job submit for node 68d5711a2be2da4660699514 2025-09-27 16:43:14,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:14,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5711a2be2da4660699514 HTTP/1.1" 200 None 2025-09-27 16:43:14,601 - lava_callback - DEBUG - Processing node 68d5711a2be2da4660699514: baseline-arm-clabbe 2025-09-27 16:43:14,601 - lava_callback - ERROR - Error processing callback for node 68d5711a2be2da4660699514: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:43782 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 16:43:15,222 - lava_callback - INFO - Received callback for node 68d5711c2be2da4660699526 INFO: 172.21.0.1:43798 - "POST /node/68d5711c2be2da4660699526 HTTP/1.0" 202 Accepted 2025-09-27 16:43:15,227 - lava_callback - INFO - Starting async job submit for node 68d5711c2be2da4660699526 2025-09-27 16:43:15,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:15,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5711c2be2da4660699526 HTTP/1.1" 200 None 2025-09-27 16:43:15,241 - lava_callback - DEBUG - Processing node 68d5711c2be2da4660699526: baseline-arm-clabbe 2025-09-27 16:43:15,241 - lava_callback - ERROR - Error processing callback for node 68d5711c2be2da4660699526: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:15,883 - lava_callback - INFO - Received callback for node 68d5711a2be2da4660699517 INFO: 172.21.0.1:43808 - "POST /node/68d5711a2be2da4660699517 HTTP/1.0" 202 Accepted 2025-09-27 16:43:15,888 - lava_callback - INFO - Starting async job submit for node 68d5711a2be2da4660699517 2025-09-27 16:43:15,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:15,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5711a2be2da4660699517 HTTP/1.1" 200 None 2025-09-27 16:43:15,902 - lava_callback - DEBUG - Processing node 68d5711a2be2da4660699517: baseline-arm-clabbe 2025-09-27 16:43:15,902 - lava_callback - ERROR - Error processing callback for node 68d5711a2be2da4660699517: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:43:16,529 - lava_callback - INFO - Received callback for node 68d5711b2be2da466069951a INFO: 172.21.0.1:43818 - "POST /node/68d5711b2be2da466069951a HTTP/1.0" 202 Accepted 2025-09-27 16:43:16,535 - lava_callback - INFO - Starting async job submit for node 68d5711b2be2da466069951a 2025-09-27 16:43:16,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:16,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5711b2be2da466069951a HTTP/1.1" 200 None 2025-09-27 16:43:16,572 - lava_callback - DEBUG - Processing node 68d5711b2be2da466069951a: baseline-arm-clabbe 2025-09-27 16:43:16,572 - lava_callback - ERROR - Error processing callback for node 68d5711b2be2da466069951a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:17,663 - lava_callback - INFO - Received callback for node 68d571162be2da46606994f6 INFO: 172.21.0.1:43832 - "POST /node/68d571162be2da46606994f6 HTTP/1.0" 202 Accepted 2025-09-27 16:43:17,668 - lava_callback - INFO - Starting async job submit for node 68d571162be2da46606994f6 2025-09-27 16:43:17,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:17,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571162be2da46606994f6 HTTP/1.1" 200 None 2025-09-27 16:43:17,682 - lava_callback - DEBUG - Processing node 68d571162be2da46606994f6: baseline-arm-broonie 2025-09-27 16:43:17,682 - lava_callback - ERROR - Error processing callback for node 68d571162be2da46606994f6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:18,523 - lava_callback - INFO - Received callback for node 68d571222be2da466069954a INFO: 172.21.0.1:43844 - "POST /node/68d571222be2da466069954a HTTP/1.0" 202 Accepted 2025-09-27 16:43:18,529 - lava_callback - INFO - Starting async job submit for node 68d571222be2da466069954a 2025-09-27 16:43:18,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:18,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571222be2da466069954a HTTP/1.1" 200 None 2025-09-27 16:43:18,546 - lava_callback - DEBUG - Processing node 68d571222be2da466069954a: ltp-cve 2025-09-27 16:43:18,546 - lava_callback - ERROR - Error processing callback for node 68d571222be2da466069954a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:19,309 - lava_callback - INFO - Received callback for node 68d571232be2da4660699553 INFO: 172.21.0.1:39850 - "POST /node/68d571232be2da4660699553 HTTP/1.0" 202 Accepted 2025-09-27 16:43:19,315 - lava_callback - INFO - Starting async job submit for node 68d571232be2da4660699553 2025-09-27 16:43:19,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:19,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571232be2da4660699553 HTTP/1.1" 200 None 2025-09-27 16:43:19,334 - lava_callback - DEBUG - Processing node 68d571232be2da4660699553: ltp-fs-bind 2025-09-27 16:43:19,334 - lava_callback - ERROR - Error processing callback for node 68d571232be2da4660699553: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:20,169 - lava_callback - INFO - Received callback for node 68d571242be2da4660699556 INFO: 172.21.0.1:39858 - "POST /node/68d571242be2da4660699556 HTTP/1.0" 202 Accepted 2025-09-27 16:43:20,181 - lava_callback - INFO - Starting async job submit for node 68d571242be2da4660699556 2025-09-27 16:43:20,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:20,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571242be2da4660699556 HTTP/1.1" 200 None 2025-09-27 16:43:20,202 - lava_callback - DEBUG - Processing node 68d571242be2da4660699556: ltp-fsx 2025-09-27 16:43:20,202 - lava_callback - ERROR - Error processing callback for node 68d571242be2da4660699556: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:20,909 - lava_callback - INFO - Received callback for node 68d571242be2da4660699559 INFO: 172.21.0.1:39860 - "POST /node/68d571242be2da4660699559 HTTP/1.0" 202 Accepted 2025-09-27 16:43:20,915 - lava_callback - INFO - Starting async job submit for node 68d571242be2da4660699559 2025-09-27 16:43:20,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:20,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571242be2da4660699559 HTTP/1.1" 200 None 2025-09-27 16:43:20,930 - lava_callback - DEBUG - Processing node 68d571242be2da4660699559: ltp-input 2025-09-27 16:43:20,930 - lava_callback - ERROR - Error processing callback for node 68d571242be2da4660699559: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:21,691 - lava_callback - INFO - Received callback for node 68d571252be2da466069955e INFO: 172.21.0.1:39864 - "POST /node/68d571252be2da466069955e HTTP/1.0" 202 Accepted 2025-09-27 16:43:21,697 - lava_callback - INFO - Starting async job submit for node 68d571252be2da466069955e 2025-09-27 16:43:21,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:21,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571252be2da466069955e HTTP/1.1" 200 None 2025-09-27 16:43:21,731 - lava_callback - DEBUG - Processing node 68d571252be2da466069955e: ltp-ipc 2025-09-27 16:43:21,731 - lava_callback - ERROR - Error processing callback for node 68d571252be2da466069955e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:22,473 - lava_callback - INFO - Received callback for node 68d571262be2da4660699562 INFO: 172.21.0.1:39874 - "POST /node/68d571262be2da4660699562 HTTP/1.0" 202 Accepted 2025-09-27 16:43:22,479 - lava_callback - INFO - Starting async job submit for node 68d571262be2da4660699562 2025-09-27 16:43:22,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:22,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571262be2da4660699562 HTTP/1.1" 200 None 2025-09-27 16:43:22,494 - lava_callback - DEBUG - Processing node 68d571262be2da4660699562: ltp-pty 2025-09-27 16:43:22,494 - lava_callback - ERROR - Error processing callback for node 68d571262be2da4660699562: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:23,261 - lava_callback - INFO - Received callback for node 68d571262be2da4660699565 INFO: 172.21.0.1:39886 - "POST /node/68d571262be2da4660699565 HTTP/1.0" 202 Accepted 2025-09-27 16:43:23,267 - lava_callback - INFO - Starting async job submit for node 68d571262be2da4660699565 2025-09-27 16:43:23,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:23,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571262be2da4660699565 HTTP/1.1" 200 None 2025-09-27 16:43:23,281 - lava_callback - DEBUG - Processing node 68d571262be2da4660699565: ltp-sched 2025-09-27 16:43:23,281 - lava_callback - ERROR - Error processing callback for node 68d571262be2da4660699565: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:23,449 - lava_callback - INFO - Received callback for node 68d813a21fd44e101337f222 INFO: 172.21.0.1:39900 - "POST /node/68d813a21fd44e101337f222 HTTP/1.0" 202 Accepted 2025-09-27 16:43:23,458 - lava_callback - INFO - Starting async job submit for node 68d813a21fd44e101337f222 2025-09-27 16:43:23,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:23,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d813a21fd44e101337f222 HTTP/1.1" 200 None 2025-09-27 16:43:23,499 - lava_callback - DEBUG - Processing node 68d813a21fd44e101337f222: baseline-arm64-broonie 2025-09-27 16:43:23,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:43:24,003 - lava_callback - INFO - Received callback for node 68d571272be2da4660699568 INFO: 172.21.0.1:39914 - "POST /node/68d571272be2da4660699568 HTTP/1.0" 202 Accepted 2025-09-27 16:43:24,013 - lava_callback - INFO - Starting async job submit for node 68d571272be2da4660699568 2025-09-27 16:43:24,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:24,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571272be2da4660699568 HTTP/1.1" 200 None 2025-09-27 16:43:24,034 - lava_callback - DEBUG - Processing node 68d571272be2da4660699568: ltp-smoketest 2025-09-27 16:43:24,034 - lava_callback - ERROR - Error processing callback for node 68d571272be2da4660699568: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:24,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:43:24,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d813a21fd44e101337f222/log.txt.gz 2025-09-27 16:43:24,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:43:24,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:43:24,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d813a21fd44e101337f222/lava_callback.json.gz 2025-09-27 16:43:24,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:24,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d813a21fd44e101337f222 HTTP/1.1" 200 None 2025-09-27 16:43:24,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:24,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:43:24,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:24,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d813a21fd44e101337f222 HTTP/1.1" 200 None 2025-09-27 16:43:24,341 - lava_callback - INFO - Completed processing callback for node 68d813a21fd44e101337f222 2025-09-27 16:43:24,998 - lava_callback - INFO - Received callback for node 68d571282be2da466069956e INFO: 172.21.0.1:39928 - "POST /node/68d571282be2da466069956e HTTP/1.0" 202 Accepted 2025-09-27 16:43:25,005 - lava_callback - INFO - Starting async job submit for node 68d571282be2da466069956e 2025-09-27 16:43:25,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:25,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571282be2da466069956e HTTP/1.1" 200 None 2025-09-27 16:43:25,019 - lava_callback - DEBUG - Processing node 68d571282be2da466069956e: ltp-syscalls 2025-09-27 16:43:25,019 - lava_callback - ERROR - Error processing callback for node 68d571282be2da466069956e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:25,738 - lava_callback - INFO - Received callback for node 68d571282be2da4660699571 INFO: 172.21.0.1:39930 - "POST /node/68d571282be2da4660699571 HTTP/1.0" 202 Accepted 2025-09-27 16:43:25,744 - lava_callback - INFO - Starting async job submit for node 68d571282be2da4660699571 2025-09-27 16:43:25,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:25,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571282be2da4660699571 HTTP/1.1" 200 None 2025-09-27 16:43:25,758 - lava_callback - DEBUG - Processing node 68d571282be2da4660699571: ltp-syscalls-ipc 2025-09-27 16:43:25,758 - lava_callback - ERROR - Error processing callback for node 68d571282be2da4660699571: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:43:26,579 - lava_callback - INFO - Received callback for node 68d571292be2da4660699574 INFO: 172.21.0.1:39940 - "POST /node/68d571292be2da4660699574 HTTP/1.0" 202 Accepted 2025-09-27 16:43:26,585 - lava_callback - INFO - Starting async job submit for node 68d571292be2da4660699574 2025-09-27 16:43:26,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:26,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571292be2da4660699574 HTTP/1.1" 200 None 2025-09-27 16:43:26,598 - lava_callback - DEBUG - Processing node 68d571292be2da4660699574: ltp-timers 2025-09-27 16:43:26,598 - lava_callback - ERROR - Error processing callback for node 68d571292be2da4660699574: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:27,338 - lava_callback - INFO - Received callback for node 68d571292be2da4660699577 INFO: 172.21.0.1:39950 - "POST /node/68d571292be2da4660699577 HTTP/1.0" 202 Accepted 2025-09-27 16:43:27,344 - lava_callback - INFO - Starting async job submit for node 68d571292be2da4660699577 2025-09-27 16:43:27,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:27,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571292be2da4660699577 HTTP/1.1" 200 None 2025-09-27 16:43:27,358 - lava_callback - DEBUG - Processing node 68d571292be2da4660699577: ltp-watchqueue 2025-09-27 16:43:27,358 - lava_callback - ERROR - Error processing callback for node 68d571292be2da4660699577: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:43:32,454 - lava_callback - INFO - Received callback for node 68d813971fd44e101337f21a INFO: 172.21.0.1:36634 - "POST /node/68d813971fd44e101337f21a HTTP/1.0" 202 Accepted 2025-09-27 16:43:32,459 - lava_callback - INFO - Starting async job submit for node 68d813971fd44e101337f21a 2025-09-27 16:43:32,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:32,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d813971fd44e101337f21a HTTP/1.1" 200 None 2025-09-27 16:43:32,507 - lava_callback - DEBUG - Processing node 68d813971fd44e101337f21a: baseline-arm64-kontron 2025-09-27 16:43:32,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:43:32,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:43:32,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d813971fd44e101337f21a/log.txt.gz 2025-09-27 16:43:32,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:43:32,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:43:32,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d813971fd44e101337f21a/lava_callback.json.gz 2025-09-27 16:43:33,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:33,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d813971fd44e101337f21a HTTP/1.1" 200 None 2025-09-27 16:43:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:33,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:43:33,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:43:33,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d813971fd44e101337f21a HTTP/1.1" 200 None 2025-09-27 16:43:33,064 - lava_callback - INFO - Completed processing callback for node 68d813971fd44e101337f21a INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:44:38,580 - lava_callback - INFO - Received callback for node 68d80faf1fd44e101337f041 INFO: 172.21.0.1:43196 - "POST /node/68d80faf1fd44e101337f041 HTTP/1.0" 202 Accepted 2025-09-27 16:44:38,585 - lava_callback - INFO - Starting async job submit for node 68d80faf1fd44e101337f041 2025-09-27 16:44:38,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:44:38,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80faf1fd44e101337f041 HTTP/1.1" 200 None 2025-09-27 16:44:38,628 - lava_callback - DEBUG - Processing node 68d80faf1fd44e101337f041: baseline-x86-kcidebug-intel 2025-09-27 16:44:38,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:44:39,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:44:39,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d80faf1fd44e101337f041/log.txt.gz 2025-09-27 16:44:39,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:44:39,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:44:39,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d80faf1fd44e101337f041/lava_callback.json.gz DEBUG: Setup failed for 68d80faf1fd44e101337f041. Transitting job node result: incomplete -> fail 2025-09-27 16:44:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:44:39,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80faf1fd44e101337f041 HTTP/1.1" 200 None 2025-09-27 16:44:39,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:44:39,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b758dd6b39fd1aeb993 HTTP/1.1" 200 None 2025-09-27 16:44:39,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:44:39,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80faf1fd44e101337f041 HTTP/1.1" 200 None 2025-09-27 16:44:39,293 - lava_callback - INFO - Completed processing callback for node 68d80faf1fd44e101337f041 2025-09-27 16:44:40,976 - lava_callback - INFO - Received callback for node 68d810791fd44e101337f0aa INFO: 172.21.0.1:59302 - "POST /node/68d810791fd44e101337f0aa HTTP/1.0" 202 Accepted 2025-09-27 16:44:40,982 - lava_callback - INFO - Starting async job submit for node 68d810791fd44e101337f0aa 2025-09-27 16:44:41,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:44:41,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810791fd44e101337f0aa HTTP/1.1" 200 None 2025-09-27 16:44:41,038 - lava_callback - DEBUG - Processing node 68d810791fd44e101337f0aa: baseline-x86 2025-09-27 16:44:41,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:44:41,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:44:41,819 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d810791fd44e101337f0aa/log.txt.gz 2025-09-27 16:44:41,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:44:42,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:44:42,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d810791fd44e101337f0aa/lava_callback.json.gz DEBUG: Setup failed for 68d810791fd44e101337f0aa. Transitting job node result: incomplete -> fail 2025-09-27 16:44:42,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:44:42,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d810791fd44e101337f0aa HTTP/1.1" 200 None 2025-09-27 16:44:42,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:44:42,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b728dd6b39fd1aeb990 HTTP/1.1" 200 None 2025-09-27 16:44:42,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:44:42,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d810791fd44e101337f0aa HTTP/1.1" 200 None 2025-09-27 16:44:42,150 - lava_callback - INFO - Completed processing callback for node 68d810791fd44e101337f0aa INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 16:45:15,876 - lava_callback - INFO - Received callback for node 68d759d3a6a7b6615d4c4df1 INFO: 172.21.0.1:45638 - "POST /node/68d759d3a6a7b6615d4c4df1 HTTP/1.0" 202 Accepted 2025-09-27 16:45:15,886 - lava_callback - INFO - Starting async job submit for node 68d759d3a6a7b6615d4c4df1 2025-09-27 16:45:15,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:45:15,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d3a6a7b6615d4c4df1 HTTP/1.1" 200 None 2025-09-27 16:45:15,925 - lava_callback - DEBUG - Processing node 68d759d3a6a7b6615d4c4df1: baseline-arm 2025-09-27 16:45:16,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:45:16,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:45:16,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d3a6a7b6615d4c4df1/log.txt.gz 2025-09-27 16:45:16,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:45:16,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:45:16,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d3a6a7b6615d4c4df1/lava_callback.json.gz 2025-09-27 16:45:16,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:45:16,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d3a6a7b6615d4c4df1 HTTP/1.1" 200 None 2025-09-27 16:45:16,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:45:16,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:45:16,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:45:16,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d759d3a6a7b6615d4c4df1 HTTP/1.1" 200 None 2025-09-27 16:45:16,476 - lava_callback - INFO - Completed processing callback for node 68d759d3a6a7b6615d4c4df1 INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:45:26,444 - lava_callback - INFO - Received callback for node 68d813631fd44e101337f211 INFO: 172.21.0.1:55176 - "POST /node/68d813631fd44e101337f211 HTTP/1.0" 202 Accepted 2025-09-27 16:45:26,452 - lava_callback - INFO - Starting async job submit for node 68d813631fd44e101337f211 2025-09-27 16:45:26,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:45:26,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d813631fd44e101337f211 HTTP/1.1" 200 None 2025-09-27 16:45:26,510 - lava_callback - DEBUG - Processing node 68d813631fd44e101337f211: baseline-arm64-broonie INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:45:26,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:45:26,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:45:26,879 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d813631fd44e101337f211/log.txt.gz 2025-09-27 16:45:26,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:45:27,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:45:27,024 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d813631fd44e101337f211/lava_callback.json.gz 2025-09-27 16:45:27,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:45:27,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d813631fd44e101337f211 HTTP/1.1" 200 None 2025-09-27 16:45:27,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:45:27,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:45:27,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:45:27,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d813631fd44e101337f211 HTTP/1.1" 200 None 2025-09-27 16:45:27,127 - lava_callback - INFO - Completed processing callback for node 68d813631fd44e101337f211 INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:47:33,942 - lava_callback - INFO - Received callback for node 68d759d5a6a7b6615d4c4df4 INFO: 172.21.0.1:40686 - "POST /node/68d759d5a6a7b6615d4c4df4 HTTP/1.0" 202 Accepted 2025-09-27 16:47:33,949 - lava_callback - INFO - Starting async job submit for node 68d759d5a6a7b6615d4c4df4 2025-09-27 16:47:33,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:47:34,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d5a6a7b6615d4c4df4 HTTP/1.1" 200 None 2025-09-27 16:47:34,010 - lava_callback - DEBUG - Processing node 68d759d5a6a7b6615d4c4df4: baseline-arm 2025-09-27 16:47:34,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:47:34,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:47:34,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d5a6a7b6615d4c4df4/log.txt.gz 2025-09-27 16:47:34,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:47:34,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:47:34,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d5a6a7b6615d4c4df4/lava_callback.json.gz 2025-09-27 16:47:34,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:47:34,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d5a6a7b6615d4c4df4 HTTP/1.1" 200 None 2025-09-27 16:47:34,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:47:34,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:47:34,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:47:34,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d759d5a6a7b6615d4c4df4 HTTP/1.1" 200 None 2025-09-27 16:47:34,750 - lava_callback - INFO - Completed processing callback for node 68d759d5a6a7b6615d4c4df4 INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:47:45,472 - lava_callback - INFO - Received callback for node 68d56e332be2da4660699387 INFO: 172.21.0.1:36298 - "POST /node/68d56e332be2da4660699387 HTTP/1.0" 202 Accepted 2025-09-27 16:47:45,480 - lava_callback - INFO - Starting async job submit for node 68d56e332be2da4660699387 2025-09-27 16:47:45,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:47:45,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56e332be2da4660699387 HTTP/1.1" 200 None 2025-09-27 16:47:45,614 - lava_callback - DEBUG - Processing node 68d56e332be2da4660699387: ltp-cve 2025-09-27 16:47:46,524 - lava_callback - ERROR - Error processing callback for node 68d56e332be2da4660699387: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:49:03,537 - lava_callback - INFO - Received callback for node 68d8105a1fd44e101337f098 INFO: 172.21.0.1:44274 - "POST /node/68d8105a1fd44e101337f098 HTTP/1.0" 202 Accepted 2025-09-27 16:49:03,543 - lava_callback - INFO - Starting async job submit for node 68d8105a1fd44e101337f098 2025-09-27 16:49:03,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:03,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8105a1fd44e101337f098 HTTP/1.1" 200 None 2025-09-27 16:49:03,605 - lava_callback - DEBUG - Processing node 68d8105a1fd44e101337f098: baseline-x86 2025-09-27 16:49:04,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:49:04,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:49:04,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d8105a1fd44e101337f098/log.txt.gz 2025-09-27 16:49:04,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:49:04,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:49:04,514 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d8105a1fd44e101337f098/lava_callback.json.gz DEBUG: Setup failed for 68d8105a1fd44e101337f098. Transitting job node result: incomplete -> fail 2025-09-27 16:49:04,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:04,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8105a1fd44e101337f098 HTTP/1.1" 200 None 2025-09-27 16:49:04,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:04,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b728dd6b39fd1aeb990 HTTP/1.1" 200 None 2025-09-27 16:49:04,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:04,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8105a1fd44e101337f098 HTTP/1.1" 200 None 2025-09-27 16:49:04,669 - lava_callback - INFO - Completed processing callback for node 68d8105a1fd44e101337f098 INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:49:45,202 - lava_callback - INFO - Received callback for node 68d573fa2be2da46606996ba INFO: 172.21.0.1:56916 - "POST /node/68d573fa2be2da46606996ba HTTP/1.0" 202 Accepted 2025-09-27 16:49:45,212 - lava_callback - INFO - Starting async job submit for node 68d573fa2be2da46606996ba 2025-09-27 16:49:45,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:45,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573fa2be2da46606996ba HTTP/1.1" 200 None 2025-09-27 16:49:45,280 - lava_callback - DEBUG - Processing node 68d573fa2be2da46606996ba: baseline-arm-broonie 2025-09-27 16:49:45,684 - lava_callback - ERROR - Error processing callback for node 68d573fa2be2da46606996ba: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:49:50,448 - lava_callback - INFO - Received callback for node 68d759d5a6a7b6615d4c4df7 INFO: 172.21.0.1:34840 - "POST /node/68d759d5a6a7b6615d4c4df7 HTTP/1.0" 202 Accepted 2025-09-27 16:49:50,458 - lava_callback - INFO - Starting async job submit for node 68d759d5a6a7b6615d4c4df7 2025-09-27 16:49:50,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:50,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d5a6a7b6615d4c4df7 HTTP/1.1" 200 None 2025-09-27 16:49:50,530 - lava_callback - DEBUG - Processing node 68d759d5a6a7b6615d4c4df7: baseline-arm 2025-09-27 16:49:50,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:49:51,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:49:51,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d5a6a7b6615d4c4df7/log.txt.gz 2025-09-27 16:49:51,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:49:52,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:49:52,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d5a6a7b6615d4c4df7/lava_callback.json.gz 2025-09-27 16:49:52,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:52,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d5a6a7b6615d4c4df7 HTTP/1.1" 200 None 2025-09-27 16:49:52,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:52,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:49:52,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:49:52,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d759d5a6a7b6615d4c4df7 HTTP/1.1" 200 None 2025-09-27 16:49:52,650 - lava_callback - INFO - Completed processing callback for node 68d759d5a6a7b6615d4c4df7 INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40590 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:51:03,968 - lava_callback - INFO - Received callback for node 68d814a71fd44e101337f599 INFO: 172.21.0.1:48246 - "POST /node/68d814a71fd44e101337f599 HTTP/1.0" 202 Accepted 2025-09-27 16:51:03,977 - lava_callback - INFO - Starting async job submit for node 68d814a71fd44e101337f599 2025-09-27 16:51:04,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:51:04,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d814a71fd44e101337f599 HTTP/1.1" 200 None 2025-09-27 16:51:04,076 - lava_callback - DEBUG - Processing node 68d814a71fd44e101337f599: baseline-arm64-broonie 2025-09-27 16:51:04,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:51:04,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:51:04,873 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d814a71fd44e101337f599/log.txt.gz 2025-09-27 16:51:04,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:51:05,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:51:05,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d814a71fd44e101337f599/lava_callback.json.gz 2025-09-27 16:51:05,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:51:05,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d814a71fd44e101337f599 HTTP/1.1" 200 None 2025-09-27 16:51:05,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:51:05,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:51:05,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:51:05,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d814a71fd44e101337f599 HTTP/1.1" 200 None 2025-09-27 16:51:05,320 - lava_callback - INFO - Completed processing callback for node 68d814a71fd44e101337f599 INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:52:16,746 - lava_callback - INFO - Received callback for node 68d759d7a6a7b6615d4c4dfa INFO: 172.21.0.1:44646 - "POST /node/68d759d7a6a7b6615d4c4dfa HTTP/1.0" 202 Accepted 2025-09-27 16:52:16,753 - lava_callback - INFO - Starting async job submit for node 68d759d7a6a7b6615d4c4dfa 2025-09-27 16:52:16,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:52:16,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d7a6a7b6615d4c4dfa HTTP/1.1" 200 None 2025-09-27 16:52:16,792 - lava_callback - DEBUG - Processing node 68d759d7a6a7b6615d4c4dfa: baseline-arm 2025-09-27 16:52:17,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:52:17,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:52:17,347 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d7a6a7b6615d4c4dfa/log.txt.gz 2025-09-27 16:52:17,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:52:17,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:52:17,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d7a6a7b6615d4c4dfa/lava_callback.json.gz 2025-09-27 16:52:17,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:52:17,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d7a6a7b6615d4c4dfa HTTP/1.1" 200 None 2025-09-27 16:52:17,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:52:17,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:52:17,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:52:17,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d759d7a6a7b6615d4c4dfa HTTP/1.1" 200 None 2025-09-27 16:52:17,735 - lava_callback - INFO - Completed processing callback for node 68d759d7a6a7b6615d4c4dfa INFO: 172.21.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:53:02,093 - lava_callback - INFO - Received callback for node 68d815fa1fd44e101337f5b7 INFO: 172.21.0.1:46554 - "POST /node/68d815fa1fd44e101337f5b7 HTTP/1.0" 202 Accepted 2025-09-27 16:53:02,106 - lava_callback - INFO - Starting async job submit for node 68d815fa1fd44e101337f5b7 2025-09-27 16:53:02,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:53:02,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d815fa1fd44e101337f5b7 HTTP/1.1" 200 None 2025-09-27 16:53:02,164 - lava_callback - DEBUG - Processing node 68d815fa1fd44e101337f5b7: baseline-arm64-broonie 2025-09-27 16:53:02,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:53:03,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:53:03,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d815fa1fd44e101337f5b7/log.txt.gz 2025-09-27 16:53:03,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:53:03,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:53:03,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d815fa1fd44e101337f5b7/lava_callback.json.gz 2025-09-27 16:53:03,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:53:03,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d815fa1fd44e101337f5b7 HTTP/1.1" 200 None 2025-09-27 16:53:03,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:53:03,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 16:53:03,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:53:03,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d815fa1fd44e101337f5b7 HTTP/1.1" 200 None 2025-09-27 16:53:03,859 - lava_callback - INFO - Completed processing callback for node 68d815fa1fd44e101337f5b7 INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:54:05,560 - lava_callback - INFO - Received callback for node 68d5741b2be2da46606996f1 INFO: 172.21.0.1:37780 - "POST /node/68d5741b2be2da46606996f1 HTTP/1.0" 202 Accepted 2025-09-27 16:54:05,574 - lava_callback - INFO - Starting async job submit for node 68d5741b2be2da46606996f1 2025-09-27 16:54:05,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:05,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5741b2be2da46606996f1 HTTP/1.1" 200 None 2025-09-27 16:54:05,649 - lava_callback - DEBUG - Processing node 68d5741b2be2da46606996f1: ltp-cap-bounds 2025-09-27 16:54:06,203 - lava_callback - ERROR - Error processing callback for node 68d5741b2be2da46606996f1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:54:24,520 - lava_callback - INFO - Received callback for node 68d573b62be2da466069965c INFO: 172.21.0.1:47120 - "POST /node/68d573b62be2da466069965c HTTP/1.0" 202 Accepted 2025-09-27 16:54:24,526 - lava_callback - INFO - Starting async job submit for node 68d573b62be2da466069965c 2025-09-27 16:54:24,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:24,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573b62be2da466069965c HTTP/1.1" 200 None 2025-09-27 16:54:24,543 - lava_callback - DEBUG - Processing node 68d573b62be2da466069965c: baseline-arm 2025-09-27 16:54:24,543 - lava_callback - ERROR - Error processing callback for node 68d573b62be2da466069965c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:54:25,163 - lava_callback - INFO - Received callback for node 68d573b72be2da466069965f INFO: 172.21.0.1:47128 - "POST /node/68d573b72be2da466069965f HTTP/1.0" 202 Accepted 2025-09-27 16:54:25,172 - lava_callback - INFO - Starting async job submit for node 68d573b72be2da466069965f 2025-09-27 16:54:25,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:25,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573b72be2da466069965f HTTP/1.1" 200 None 2025-09-27 16:54:25,191 - lava_callback - DEBUG - Processing node 68d573b72be2da466069965f: baseline-arm 2025-09-27 16:54:25,192 - lava_callback - ERROR - Error processing callback for node 68d573b72be2da466069965f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:54:25,832 - lava_callback - INFO - Received callback for node 68d573bf2be2da4660699674 INFO: 172.21.0.1:47142 - "POST /node/68d573bf2be2da4660699674 HTTP/1.0" 202 Accepted 2025-09-27 16:54:25,838 - lava_callback - INFO - Starting async job submit for node 68d573bf2be2da4660699674 2025-09-27 16:54:25,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:25,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573bf2be2da4660699674 HTTP/1.1" 200 None 2025-09-27 16:54:25,853 - lava_callback - DEBUG - Processing node 68d573bf2be2da4660699674: baseline-arm 2025-09-27 16:54:25,853 - lava_callback - ERROR - Error processing callback for node 68d573bf2be2da4660699674: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:54:26,492 - lava_callback - INFO - Received callback for node 68d573bf2be2da4660699677 INFO: 172.21.0.1:47158 - "POST /node/68d573bf2be2da4660699677 HTTP/1.0" 202 Accepted 2025-09-27 16:54:26,498 - lava_callback - INFO - Starting async job submit for node 68d573bf2be2da4660699677 2025-09-27 16:54:26,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:26,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573bf2be2da4660699677 HTTP/1.1" 200 None 2025-09-27 16:54:26,526 - lava_callback - DEBUG - Processing node 68d573bf2be2da4660699677: baseline-arm 2025-09-27 16:54:26,527 - lava_callback - ERROR - Error processing callback for node 68d573bf2be2da4660699677: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:54:32,125 - lava_callback - INFO - Received callback for node 68d759d8a6a7b6615d4c4dfd INFO: 172.21.0.1:55712 - "POST /node/68d759d8a6a7b6615d4c4dfd HTTP/1.0" 202 Accepted 2025-09-27 16:54:32,135 - lava_callback - INFO - Starting async job submit for node 68d759d8a6a7b6615d4c4dfd 2025-09-27 16:54:32,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:32,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d8a6a7b6615d4c4dfd HTTP/1.1" 200 None 2025-09-27 16:54:32,205 - lava_callback - DEBUG - Processing node 68d759d8a6a7b6615d4c4dfd: baseline-arm 2025-09-27 16:54:32,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:54:32,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:54:32,852 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d8a6a7b6615d4c4dfd/log.txt.gz 2025-09-27 16:54:32,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:54:33,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:54:33,036 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d759d8a6a7b6615d4c4dfd/lava_callback.json.gz 2025-09-27 16:54:33,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:33,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d759d8a6a7b6615d4c4dfd HTTP/1.1" 200 None 2025-09-27 16:54:33,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:33,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:54:33,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:33,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d759d8a6a7b6615d4c4dfd HTTP/1.1" 200 None 2025-09-27 16:54:33,153 - lava_callback - INFO - Completed processing callback for node 68d759d8a6a7b6615d4c4dfd INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:54:36,922 - lava_callback - INFO - Received callback for node 68d5710e2be2da46606994b0 INFO: 172.21.0.1:55726 - "POST /node/68d5710e2be2da46606994b0 HTTP/1.0" 202 Accepted 2025-09-27 16:54:36,931 - lava_callback - INFO - Starting async job submit for node 68d5710e2be2da46606994b0 2025-09-27 16:54:36,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:54:37,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5710e2be2da46606994b0 HTTP/1.1" 200 None 2025-09-27 16:54:37,019 - lava_callback - DEBUG - Processing node 68d5710e2be2da46606994b0: baseline-arm 2025-09-27 16:54:37,429 - lava_callback - ERROR - Error processing callback for node 68d5710e2be2da46606994b0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:55:38,627 - lava_callback - INFO - Received callback for node 68d573ff2be2da46606996c3 INFO: 172.21.0.1:41280 - "POST /node/68d573ff2be2da46606996c3 HTTP/1.0" 202 Accepted 2025-09-27 16:55:38,633 - lava_callback - INFO - Starting async job submit for node 68d573ff2be2da46606996c3 2025-09-27 16:55:38,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:38,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d573ff2be2da46606996c3 HTTP/1.1" 200 None 2025-09-27 16:55:38,673 - lava_callback - DEBUG - Processing node 68d573ff2be2da46606996c3: baseline-arm-broonie 2025-09-27 16:55:38,673 - lava_callback - ERROR - Error processing callback for node 68d573ff2be2da46606996c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:55:53,219 - lava_callback - INFO - Received callback for node 68d574042be2da46606996cc INFO: 172.21.0.1:50512 - "POST /node/68d574042be2da46606996cc HTTP/1.0" 202 Accepted 2025-09-27 16:55:53,225 - lava_callback - INFO - Starting async job submit for node 68d574042be2da46606996cc 2025-09-27 16:55:53,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:53,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574042be2da46606996cc HTTP/1.1" 200 None 2025-09-27 16:55:53,241 - lava_callback - DEBUG - Processing node 68d574042be2da46606996cc: baseline-arm-clabbe 2025-09-27 16:55:53,241 - lava_callback - ERROR - Error processing callback for node 68d574042be2da46606996cc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:55:53,858 - lava_callback - INFO - Received callback for node 68d574072be2da46606996cf INFO: 172.21.0.1:50520 - "POST /node/68d574072be2da46606996cf HTTP/1.0" 202 Accepted 2025-09-27 16:55:53,864 - lava_callback - INFO - Starting async job submit for node 68d574072be2da46606996cf 2025-09-27 16:55:53,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:53,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574072be2da46606996cf HTTP/1.1" 200 None 2025-09-27 16:55:53,885 - lava_callback - DEBUG - Processing node 68d574072be2da46606996cf: baseline-arm-clabbe 2025-09-27 16:55:53,885 - lava_callback - ERROR - Error processing callback for node 68d574072be2da46606996cf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:55:54,504 - lava_callback - INFO - Received callback for node 68d5740a2be2da46606996d5 INFO: 172.21.0.1:50534 - "POST /node/68d5740a2be2da46606996d5 HTTP/1.0" 202 Accepted 2025-09-27 16:55:54,510 - lava_callback - INFO - Starting async job submit for node 68d5740a2be2da46606996d5 2025-09-27 16:55:54,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:54,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5740a2be2da46606996d5 HTTP/1.1" 200 None 2025-09-27 16:55:54,524 - lava_callback - DEBUG - Processing node 68d5740a2be2da46606996d5: baseline-arm-clabbe 2025-09-27 16:55:54,524 - lava_callback - ERROR - Error processing callback for node 68d5740a2be2da46606996d5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:55:55,142 - lava_callback - INFO - Received callback for node 68d574132be2da46606996e4 INFO: 172.21.0.1:50550 - "POST /node/68d574132be2da46606996e4 HTTP/1.0" 202 Accepted 2025-09-27 16:55:55,152 - lava_callback - INFO - Starting async job submit for node 68d574132be2da46606996e4 2025-09-27 16:55:55,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:55,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574132be2da46606996e4 HTTP/1.1" 200 None 2025-09-27 16:55:55,178 - lava_callback - DEBUG - Processing node 68d574132be2da46606996e4: baseline-arm-clabbe 2025-09-27 16:55:55,179 - lava_callback - ERROR - Error processing callback for node 68d574132be2da46606996e4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:50556 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:55:55,816 - lava_callback - INFO - Received callback for node 68d5740c2be2da46606996d8 INFO: 172.21.0.1:50564 - "POST /node/68d5740c2be2da46606996d8 HTTP/1.0" 202 Accepted 2025-09-27 16:55:55,822 - lava_callback - INFO - Starting async job submit for node 68d5740c2be2da46606996d8 2025-09-27 16:55:55,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:55,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5740c2be2da46606996d8 HTTP/1.1" 200 None 2025-09-27 16:55:55,835 - lava_callback - DEBUG - Processing node 68d5740c2be2da46606996d8: baseline-arm-clabbe 2025-09-27 16:55:55,835 - lava_callback - ERROR - Error processing callback for node 68d5740c2be2da46606996d8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:55:56,482 - lava_callback - INFO - Received callback for node 68d5740d2be2da46606996db INFO: 172.21.0.1:50576 - "POST /node/68d5740d2be2da46606996db HTTP/1.0" 202 Accepted 2025-09-27 16:55:56,488 - lava_callback - INFO - Starting async job submit for node 68d5740d2be2da46606996db 2025-09-27 16:55:56,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:56,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5740d2be2da46606996db HTTP/1.1" 200 None 2025-09-27 16:55:56,502 - lava_callback - DEBUG - Processing node 68d5740d2be2da46606996db: baseline-arm-clabbe 2025-09-27 16:55:56,502 - lava_callback - ERROR - Error processing callback for node 68d5740d2be2da46606996db: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:55:58,098 - lava_callback - INFO - Received callback for node 68d816e31fd44e101337f60c INFO: 172.21.0.1:50586 - "POST /node/68d816e31fd44e101337f60c HTTP/1.0" 202 Accepted 2025-09-27 16:55:58,104 - lava_callback - INFO - Starting async job submit for node 68d816e31fd44e101337f60c 2025-09-27 16:55:58,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:58,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e31fd44e101337f60c HTTP/1.1" 200 None 2025-09-27 16:55:58,137 - lava_callback - DEBUG - Processing node 68d816e31fd44e101337f60c: baseline-arm 2025-09-27 16:55:58,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:55:58,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:55:58,595 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e31fd44e101337f60c/log.txt.gz 2025-09-27 16:55:58,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:55:58,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:55:58,723 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e31fd44e101337f60c/lava_callback.json.gz 2025-09-27 16:55:58,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:58,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e31fd44e101337f60c HTTP/1.1" 200 None 2025-09-27 16:55:58,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:58,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:55:58,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:55:58,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e31fd44e101337f60c HTTP/1.1" 200 None 2025-09-27 16:55:58,830 - lava_callback - INFO - Completed processing callback for node 68d816e31fd44e101337f60c 2025-09-27 16:56:04,693 - lava_callback - INFO - Received callback for node 68d816e11fd44e101337f600 INFO: 172.21.0.1:41596 - "POST /node/68d816e11fd44e101337f600 HTTP/1.0" 202 Accepted 2025-09-27 16:56:04,700 - lava_callback - INFO - Starting async job submit for node 68d816e11fd44e101337f600 2025-09-27 16:56:04,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:04,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e11fd44e101337f600 HTTP/1.1" 200 None 2025-09-27 16:56:04,739 - lava_callback - DEBUG - Processing node 68d816e11fd44e101337f600: baseline-arm 2025-09-27 16:56:05,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:05,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:05,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e11fd44e101337f600/log.txt.gz 2025-09-27 16:56:05,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:05,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:05,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e11fd44e101337f600/lava_callback.json.gz 2025-09-27 16:56:05,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:05,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e11fd44e101337f600 HTTP/1.1" 200 None 2025-09-27 16:56:05,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:05,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:05,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:05,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e11fd44e101337f600 HTTP/1.1" 200 None 2025-09-27 16:56:05,400 - lava_callback - INFO - Completed processing callback for node 68d816e11fd44e101337f600 INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:56:12,842 - lava_callback - INFO - Received callback for node 68d816f41fd44e101337f67e INFO: 172.21.0.1:55498 - "POST /node/68d816f41fd44e101337f67e HTTP/1.0" 202 Accepted 2025-09-27 16:56:12,888 - lava_callback - INFO - Starting async job submit for node 68d816f41fd44e101337f67e 2025-09-27 16:56:12,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:12,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f41fd44e101337f67e HTTP/1.1" 200 None 2025-09-27 16:56:12,930 - lava_callback - DEBUG - Processing node 68d816f41fd44e101337f67e: baseline-arm-pengutronix 2025-09-27 16:56:13,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:13,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:13,157 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d816f41fd44e101337f67e/log.txt.gz 2025-09-27 16:56:13,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:13,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:13,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d816f41fd44e101337f67e/lava_callback.json.gz 2025-09-27 16:56:13,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:13,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f41fd44e101337f67e HTTP/1.1" 200 None 2025-09-27 16:56:13,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:13,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:13,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:13,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816f41fd44e101337f67e HTTP/1.1" 200 None 2025-09-27 16:56:13,364 - lava_callback - INFO - Completed processing callback for node 68d816f41fd44e101337f67e INFO: 172.21.0.1:55506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55516 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:56:18,640 - lava_callback - INFO - Received callback for node 68d5741e2be2da46606996f7 INFO: 172.21.0.1:55520 - "POST /node/68d5741e2be2da46606996f7 HTTP/1.0" 202 Accepted 2025-09-27 16:56:18,647 - lava_callback - INFO - Starting async job submit for node 68d5741e2be2da46606996f7 2025-09-27 16:56:18,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:18,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5741e2be2da46606996f7 HTTP/1.1" 200 None 2025-09-27 16:56:18,666 - lava_callback - DEBUG - Processing node 68d5741e2be2da46606996f7: ltp-controllers 2025-09-27 16:56:18,666 - lava_callback - ERROR - Error processing callback for node 68d5741e2be2da46606996f7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:19,377 - lava_callback - INFO - Received callback for node 68d574202be2da46606996fa INFO: 172.21.0.1:33438 - "POST /node/68d574202be2da46606996fa HTTP/1.0" 202 Accepted 2025-09-27 16:56:19,384 - lava_callback - INFO - Starting async job submit for node 68d574202be2da46606996fa 2025-09-27 16:56:19,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:19,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574202be2da46606996fa HTTP/1.1" 200 None 2025-09-27 16:56:19,400 - lava_callback - DEBUG - Processing node 68d574202be2da46606996fa: ltp-cve 2025-09-27 16:56:19,400 - lava_callback - ERROR - Error processing callback for node 68d574202be2da46606996fa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:20,161 - lava_callback - INFO - Received callback for node 68d574232be2da4660699700 INFO: 172.21.0.1:33454 - "POST /node/68d574232be2da4660699700 HTTP/1.0" 202 Accepted 2025-09-27 16:56:20,170 - lava_callback - INFO - Starting async job submit for node 68d574232be2da4660699700 2025-09-27 16:56:20,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:20,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574232be2da4660699700 HTTP/1.1" 200 None 2025-09-27 16:56:20,207 - lava_callback - DEBUG - Processing node 68d574232be2da4660699700: ltp-fs-bind 2025-09-27 16:56:20,207 - lava_callback - ERROR - Error processing callback for node 68d574232be2da4660699700: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:20,964 - lava_callback - INFO - Received callback for node 68d574252be2da4660699703 INFO: 172.21.0.1:33468 - "POST /node/68d574252be2da4660699703 HTTP/1.0" 202 Accepted 2025-09-27 16:56:20,974 - lava_callback - INFO - Starting async job submit for node 68d574252be2da4660699703 2025-09-27 16:56:20,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:20,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574252be2da4660699703 HTTP/1.1" 200 None 2025-09-27 16:56:20,998 - lava_callback - DEBUG - Processing node 68d574252be2da4660699703: ltp-fsx 2025-09-27 16:56:20,998 - lava_callback - ERROR - Error processing callback for node 68d574252be2da4660699703: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:21,747 - lava_callback - INFO - Received callback for node 68d574262be2da4660699706 INFO: 172.21.0.1:33478 - "POST /node/68d574262be2da4660699706 HTTP/1.0" 202 Accepted 2025-09-27 16:56:21,757 - lava_callback - INFO - Starting async job submit for node 68d574262be2da4660699706 2025-09-27 16:56:21,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:21,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574262be2da4660699706 HTTP/1.1" 200 None 2025-09-27 16:56:21,776 - lava_callback - DEBUG - Processing node 68d574262be2da4660699706: ltp-input 2025-09-27 16:56:21,776 - lava_callback - ERROR - Error processing callback for node 68d574262be2da4660699706: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:22,492 - lava_callback - INFO - Received callback for node 68d574282be2da4660699709 INFO: 172.21.0.1:33490 - "POST /node/68d574282be2da4660699709 HTTP/1.0" 202 Accepted 2025-09-27 16:56:22,501 - lava_callback - INFO - Starting async job submit for node 68d574282be2da4660699709 2025-09-27 16:56:22,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:22,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574282be2da4660699709 HTTP/1.1" 200 None 2025-09-27 16:56:22,519 - lava_callback - DEBUG - Processing node 68d574282be2da4660699709: ltp-ipc 2025-09-27 16:56:22,519 - lava_callback - ERROR - Error processing callback for node 68d574282be2da4660699709: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:23,126 - lava_callback - INFO - Received callback for node 68d816e81fd44e101337f633 INFO: 172.21.0.1:33494 - "POST /node/68d816e81fd44e101337f633 HTTP/1.0" 202 Accepted 2025-09-27 16:56:23,136 - lava_callback - INFO - Starting async job submit for node 68d816e81fd44e101337f633 2025-09-27 16:56:23,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e81fd44e101337f633 HTTP/1.1" 200 None 2025-09-27 16:56:23,198 - lava_callback - DEBUG - Processing node 68d816e81fd44e101337f633: baseline-arm-broonie 2025-09-27 16:56:23,256 - lava_callback - INFO - Received callback for node 68d5742a2be2da466069970c INFO: 172.21.0.1:33506 - "POST /node/68d5742a2be2da466069970c HTTP/1.0" 202 Accepted 2025-09-27 16:56:23,268 - lava_callback - INFO - Starting async job submit for node 68d5742a2be2da466069970c 2025-09-27 16:56:23,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:23,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5742a2be2da466069970c HTTP/1.1" 200 None 2025-09-27 16:56:23,321 - lava_callback - DEBUG - Processing node 68d5742a2be2da466069970c: ltp-pty 2025-09-27 16:56:23,321 - lava_callback - ERROR - Error processing callback for node 68d5742a2be2da466069970c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:23,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:23,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:23,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d816e81fd44e101337f633/log.txt.gz 2025-09-27 16:56:23,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:23,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:23,888 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d816e81fd44e101337f633/lava_callback.json.gz 2025-09-27 16:56:23,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:23,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e81fd44e101337f633 HTTP/1.1" 200 None 2025-09-27 16:56:23,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:23,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:23,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:24,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e81fd44e101337f633 HTTP/1.1" 200 None 2025-09-27 16:56:24,004 - lava_callback - INFO - Completed processing callback for node 68d816e81fd44e101337f633 2025-09-27 16:56:24,057 - lava_callback - INFO - Received callback for node 68d5742b2be2da466069970f INFO: 172.21.0.1:33520 - "POST /node/68d5742b2be2da466069970f HTTP/1.0" 202 Accepted 2025-09-27 16:56:24,073 - lava_callback - INFO - Starting async job submit for node 68d5742b2be2da466069970f 2025-09-27 16:56:24,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:24,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5742b2be2da466069970f HTTP/1.1" 200 None 2025-09-27 16:56:24,106 - lava_callback - DEBUG - Processing node 68d5742b2be2da466069970f: ltp-sched 2025-09-27 16:56:24,106 - lava_callback - ERROR - Error processing callback for node 68d5742b2be2da466069970f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:25,024 - lava_callback - INFO - Received callback for node 68d5742d2be2da4660699712 INFO: 172.21.0.1:33524 - "POST /node/68d5742d2be2da4660699712 HTTP/1.0" 202 Accepted 2025-09-27 16:56:25,033 - lava_callback - INFO - Starting async job submit for node 68d5742d2be2da4660699712 2025-09-27 16:56:25,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:25,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5742d2be2da4660699712 HTTP/1.1" 200 None 2025-09-27 16:56:25,056 - lava_callback - DEBUG - Processing node 68d5742d2be2da4660699712: ltp-smoketest 2025-09-27 16:56:25,056 - lava_callback - ERROR - Error processing callback for node 68d5742d2be2da4660699712: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:25,860 - lava_callback - INFO - Received callback for node 68d5742f2be2da4660699715 INFO: 172.21.0.1:33540 - "POST /node/68d5742f2be2da4660699715 HTTP/1.0" 202 Accepted 2025-09-27 16:56:25,870 - lava_callback - INFO - Starting async job submit for node 68d5742f2be2da4660699715 2025-09-27 16:56:25,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:25,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5742f2be2da4660699715 HTTP/1.1" 200 None 2025-09-27 16:56:25,883 - lava_callback - DEBUG - Processing node 68d5742f2be2da4660699715: ltp-syscalls 2025-09-27 16:56:25,883 - lava_callback - ERROR - Error processing callback for node 68d5742f2be2da4660699715: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:56:26,608 - lava_callback - INFO - Received callback for node 68d574302be2da4660699718 INFO: 172.21.0.1:33564 - "POST /node/68d574302be2da4660699718 HTTP/1.0" 202 Accepted 2025-09-27 16:56:26,618 - lava_callback - INFO - Starting async job submit for node 68d574302be2da4660699718 2025-09-27 16:56:26,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:26,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574302be2da4660699718 HTTP/1.1" 200 None 2025-09-27 16:56:26,636 - lava_callback - DEBUG - Processing node 68d574302be2da4660699718: ltp-syscalls-ipc 2025-09-27 16:56:26,636 - lava_callback - ERROR - Error processing callback for node 68d574302be2da4660699718: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:27,350 - lava_callback - INFO - Received callback for node 68d574322be2da466069971b INFO: 172.21.0.1:33578 - "POST /node/68d574322be2da466069971b HTTP/1.0" 202 Accepted 2025-09-27 16:56:27,358 - lava_callback - INFO - Starting async job submit for node 68d574322be2da466069971b 2025-09-27 16:56:27,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:27,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574322be2da466069971b HTTP/1.1" 200 None 2025-09-27 16:56:27,375 - lava_callback - DEBUG - Processing node 68d574322be2da466069971b: ltp-timers 2025-09-27 16:56:27,375 - lava_callback - ERROR - Error processing callback for node 68d574322be2da466069971b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:28,138 - lava_callback - INFO - Received callback for node 68d574342be2da466069971e INFO: 172.21.0.1:33588 - "POST /node/68d574342be2da466069971e HTTP/1.0" 202 Accepted 2025-09-27 16:56:28,148 - lava_callback - INFO - Starting async job submit for node 68d574342be2da466069971e 2025-09-27 16:56:28,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:28,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d574342be2da466069971e HTTP/1.1" 200 None 2025-09-27 16:56:28,178 - lava_callback - DEBUG - Processing node 68d574342be2da466069971e: ltp-watchqueue 2025-09-27 16:56:28,178 - lava_callback - ERROR - Error processing callback for node 68d574342be2da466069971e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 16:56:31,474 - lava_callback - INFO - Received callback for node 68d816e21fd44e101337f603 INFO: 172.21.0.1:42188 - "POST /node/68d816e21fd44e101337f603 HTTP/1.0" 202 Accepted 2025-09-27 16:56:31,480 - lava_callback - INFO - Starting async job submit for node 68d816e21fd44e101337f603 2025-09-27 16:56:31,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:31,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e21fd44e101337f603 HTTP/1.1" 200 None 2025-09-27 16:56:31,513 - lava_callback - DEBUG - Processing node 68d816e21fd44e101337f603: baseline-arm 2025-09-27 16:56:31,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:31,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:31,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e21fd44e101337f603/log.txt.gz 2025-09-27 16:56:31,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:31,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:31,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e21fd44e101337f603/lava_callback.json.gz 2025-09-27 16:56:32,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:32,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e21fd44e101337f603 HTTP/1.1" 200 None 2025-09-27 16:56:32,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:32,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:32,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:32,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e21fd44e101337f603 HTTP/1.1" 200 None 2025-09-27 16:56:32,062 - lava_callback - INFO - Completed processing callback for node 68d816e21fd44e101337f603 INFO: 172.21.0.1:42190 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:56:39,172 - lava_callback - INFO - Received callback for node 68d816e01fd44e101337f5f7 INFO: 172.21.0.1:42194 - "POST /node/68d816e01fd44e101337f5f7 HTTP/1.0" 202 Accepted 2025-09-27 16:56:39,178 - lava_callback - INFO - Starting async job submit for node 68d816e01fd44e101337f5f7 2025-09-27 16:56:39,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:39,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e01fd44e101337f5f7 HTTP/1.1" 200 None 2025-09-27 16:56:39,212 - lava_callback - DEBUG - Processing node 68d816e01fd44e101337f5f7: baseline-arm 2025-09-27 16:56:39,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:39,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:39,546 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e01fd44e101337f5f7/log.txt.gz 2025-09-27 16:56:39,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:39,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:39,657 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e01fd44e101337f5f7/lava_callback.json.gz 2025-09-27 16:56:39,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:39,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e01fd44e101337f5f7 HTTP/1.1" 200 None 2025-09-27 16:56:39,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:39,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:39,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:39,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e01fd44e101337f5f7 HTTP/1.1" 200 None 2025-09-27 16:56:39,743 - lava_callback - INFO - Completed processing callback for node 68d816e01fd44e101337f5f7 2025-09-27 16:56:42,741 - lava_callback - INFO - Received callback for node 68d816e91fd44e101337f636 INFO: 172.21.0.1:45860 - "POST /node/68d816e91fd44e101337f636 HTTP/1.0" 202 Accepted 2025-09-27 16:56:42,747 - lava_callback - INFO - Starting async job submit for node 68d816e91fd44e101337f636 2025-09-27 16:56:42,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:42,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e91fd44e101337f636 HTTP/1.1" 200 None 2025-09-27 16:56:42,781 - lava_callback - DEBUG - Processing node 68d816e91fd44e101337f636: baseline-arm-broonie 2025-09-27 16:56:42,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:43,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:43,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d816e91fd44e101337f636/log.txt.gz 2025-09-27 16:56:43,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:43,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:43,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d816e91fd44e101337f636/lava_callback.json.gz 2025-09-27 16:56:43,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:43,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e91fd44e101337f636 HTTP/1.1" 200 None 2025-09-27 16:56:43,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:43,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:43,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:43,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e91fd44e101337f636 HTTP/1.1" 200 None 2025-09-27 16:56:43,288 - lava_callback - INFO - Completed processing callback for node 68d816e91fd44e101337f636 2025-09-27 16:56:44,698 - lava_callback - INFO - Received callback for node 68d816ed1fd44e101337f651 INFO: 172.21.0.1:45862 - "POST /node/68d816ed1fd44e101337f651 HTTP/1.0" 202 Accepted 2025-09-27 16:56:44,704 - lava_callback - INFO - Starting async job submit for node 68d816ed1fd44e101337f651 2025-09-27 16:56:44,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:44,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816ed1fd44e101337f651 HTTP/1.1" 200 None 2025-09-27 16:56:44,737 - lava_callback - DEBUG - Processing node 68d816ed1fd44e101337f651: baseline-arm-clabbe 2025-09-27 16:56:44,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:45,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:45,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d816ed1fd44e101337f651/log.txt.gz 2025-09-27 16:56:45,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:45,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:45,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d816ed1fd44e101337f651/lava_callback.json.gz 2025-09-27 16:56:45,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:45,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816ed1fd44e101337f651 HTTP/1.1" 200 None 2025-09-27 16:56:45,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:45,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:45,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:45,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816ed1fd44e101337f651 HTTP/1.1" 200 None 2025-09-27 16:56:45,254 - lava_callback - INFO - Completed processing callback for node 68d816ed1fd44e101337f651 INFO: 172.21.0.1:45866 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:56:52,817 - lava_callback - INFO - Received callback for node 68d816f01fd44e101337f66c INFO: 172.21.0.1:40654 - "POST /node/68d816f01fd44e101337f66c HTTP/1.0" 202 Accepted 2025-09-27 16:56:52,823 - lava_callback - INFO - Starting async job submit for node 68d816f01fd44e101337f66c 2025-09-27 16:56:52,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:52,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f01fd44e101337f66c HTTP/1.1" 200 None 2025-09-27 16:56:52,857 - lava_callback - DEBUG - Processing node 68d816f01fd44e101337f66c: baseline-arm-kontron 2025-09-27 16:56:53,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:53,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:53,170 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d816f01fd44e101337f66c/log.txt.gz 2025-09-27 16:56:53,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:53,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:53,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d816f01fd44e101337f66c/lava_callback.json.gz 2025-09-27 16:56:53,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:53,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f01fd44e101337f66c HTTP/1.1" 200 None 2025-09-27 16:56:53,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:53,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:53,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:53,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816f01fd44e101337f66c HTTP/1.1" 200 None 2025-09-27 16:56:53,383 - lava_callback - INFO - Completed processing callback for node 68d816f01fd44e101337f66c 2025-09-27 16:56:54,071 - lava_callback - INFO - Received callback for node 68d816f11fd44e101337f672 INFO: 172.21.0.1:40662 - "POST /node/68d816f11fd44e101337f672 HTTP/1.0" 202 Accepted 2025-09-27 16:56:54,077 - lava_callback - INFO - Starting async job submit for node 68d816f11fd44e101337f672 2025-09-27 16:56:54,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:54,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f11fd44e101337f672 HTTP/1.1" 200 None 2025-09-27 16:56:54,118 - lava_callback - DEBUG - Processing node 68d816f11fd44e101337f672: baseline-arm-kontron 2025-09-27 16:56:54,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:54,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:54,417 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d816f11fd44e101337f672/log.txt.gz 2025-09-27 16:56:54,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:56:54,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:56:54,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d816f11fd44e101337f672/lava_callback.json.gz 2025-09-27 16:56:54,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:54,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f11fd44e101337f672 HTTP/1.1" 200 None 2025-09-27 16:56:54,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:54,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:56:54,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:54,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816f11fd44e101337f672 HTTP/1.1" 200 None 2025-09-27 16:56:54,632 - lava_callback - INFO - Completed processing callback for node 68d816f11fd44e101337f672 INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:56:59,570 - lava_callback - INFO - Received callback for node 68d75a16a6a7b6615d4c4e2e INFO: 172.21.0.1:53068 - "POST /node/68d75a16a6a7b6615d4c4e2e HTTP/1.0" 202 Accepted 2025-09-27 16:56:59,576 - lava_callback - INFO - Starting async job submit for node 68d75a16a6a7b6615d4c4e2e 2025-09-27 16:56:59,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:56:59,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a16a6a7b6615d4c4e2e HTTP/1.1" 200 None 2025-09-27 16:56:59,616 - lava_callback - DEBUG - Processing node 68d75a16a6a7b6615d4c4e2e: baseline-arm 2025-09-27 16:56:59,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:00,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:00,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a16a6a7b6615d4c4e2e/log.txt.gz 2025-09-27 16:57:00,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:00,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:00,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a16a6a7b6615d4c4e2e/lava_callback.json.gz 2025-09-27 16:57:00,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:00,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a16a6a7b6615d4c4e2e HTTP/1.1" 200 None 2025-09-27 16:57:00,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:00,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:57:00,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:00,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75a16a6a7b6615d4c4e2e HTTP/1.1" 200 None 2025-09-27 16:57:00,260 - lava_callback - INFO - Completed processing callback for node 68d75a16a6a7b6615d4c4e2e 2025-09-27 16:57:05,770 - lava_callback - INFO - Received callback for node 68d816e41fd44e101337f612 INFO: 172.21.0.1:53078 - "POST /node/68d816e41fd44e101337f612 HTTP/1.0" 202 Accepted 2025-09-27 16:57:05,776 - lava_callback - INFO - Starting async job submit for node 68d816e41fd44e101337f612 2025-09-27 16:57:05,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:05,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e41fd44e101337f612 HTTP/1.1" 200 None 2025-09-27 16:57:05,811 - lava_callback - DEBUG - Processing node 68d816e41fd44e101337f612: baseline-arm-baylibre 2025-09-27 16:57:06,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:06,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:06,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e41fd44e101337f612/log.txt.gz 2025-09-27 16:57:06,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:06,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:06,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e41fd44e101337f612/lava_callback.json.gz 2025-09-27 16:57:06,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:06,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e41fd44e101337f612 HTTP/1.1" 200 None 2025-09-27 16:57:06,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:06,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:57:06,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:06,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e41fd44e101337f612 HTTP/1.1" 200 None 2025-09-27 16:57:06,413 - lava_callback - INFO - Completed processing callback for node 68d816e41fd44e101337f612 INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:57:17,192 - lava_callback - INFO - Received callback for node 68d816f31fd44e101337f67b INFO: 172.21.0.1:48606 - "POST /node/68d816f31fd44e101337f67b HTTP/1.0" 202 Accepted 2025-09-27 16:57:17,198 - lava_callback - INFO - Starting async job submit for node 68d816f31fd44e101337f67b 2025-09-27 16:57:17,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:17,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f31fd44e101337f67b HTTP/1.1" 200 None 2025-09-27 16:57:17,233 - lava_callback - DEBUG - Processing node 68d816f31fd44e101337f67b: baseline-arm-pengutronix 2025-09-27 16:57:17,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:17,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:17,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d816f31fd44e101337f67b/log.txt.gz 2025-09-27 16:57:17,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:17,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:17,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d816f31fd44e101337f67b/lava_callback.json.gz 2025-09-27 16:57:17,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:17,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f31fd44e101337f67b HTTP/1.1" 200 None 2025-09-27 16:57:17,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:17,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:57:17,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:17,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816f31fd44e101337f67b HTTP/1.1" 200 None 2025-09-27 16:57:17,700 - lava_callback - INFO - Completed processing callback for node 68d816f31fd44e101337f67b 2025-09-27 16:57:18,236 - lava_callback - INFO - Received callback for node 68d816f21fd44e101337f675 INFO: 172.21.0.1:48620 - "POST /node/68d816f21fd44e101337f675 HTTP/1.0" 202 Accepted 2025-09-27 16:57:18,244 - lava_callback - INFO - Starting async job submit for node 68d816f21fd44e101337f675 2025-09-27 16:57:18,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:18,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f21fd44e101337f675 HTTP/1.1" 200 None 2025-09-27 16:57:18,285 - lava_callback - DEBUG - Processing node 68d816f21fd44e101337f675: baseline-arm-pengutronix 2025-09-27 16:57:18,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:18,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:18,582 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d816f21fd44e101337f675/log.txt.gz 2025-09-27 16:57:18,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:18,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:18,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d816f21fd44e101337f675/lava_callback.json.gz 2025-09-27 16:57:18,747 - lava_callback - INFO - Received callback for node 68d816e41fd44e101337f615 INFO: 172.21.0.1:48632 - "POST /node/68d816e41fd44e101337f615 HTTP/1.0" 202 Accepted 2025-09-27 16:57:18,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:18,762 - lava_callback - INFO - Starting async job submit for node 68d816e41fd44e101337f615 2025-09-27 16:57:18,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:18,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f21fd44e101337f675 HTTP/1.1" 200 None 2025-09-27 16:57:18,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e41fd44e101337f615 HTTP/1.1" 200 None 2025-09-27 16:57:18,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:18,796 - lava_callback - DEBUG - Processing node 68d816e41fd44e101337f615: baseline-arm-baylibre 2025-09-27 16:57:18,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:57:18,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:18,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816f21fd44e101337f675 HTTP/1.1" 200 None 2025-09-27 16:57:19,000 - lava_callback - INFO - Completed processing callback for node 68d816f21fd44e101337f675 2025-09-27 16:57:19,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:19,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:19,164 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e41fd44e101337f615/log.txt.gz 2025-09-27 16:57:19,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:19,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:19,279 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e41fd44e101337f615/lava_callback.json.gz 2025-09-27 16:57:19,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:19,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e41fd44e101337f615 HTTP/1.1" 200 None 2025-09-27 16:57:19,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:19,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:57:19,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:19,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e41fd44e101337f615 HTTP/1.1" 200 None 2025-09-27 16:57:19,376 - lava_callback - INFO - Completed processing callback for node 68d816e41fd44e101337f615 INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:57:33,697 - lava_callback - INFO - Received callback for node 68d816e61fd44e101337f624 INFO: 172.21.0.1:53162 - "POST /node/68d816e61fd44e101337f624 HTTP/1.0" 202 Accepted 2025-09-27 16:57:33,703 - lava_callback - INFO - Starting async job submit for node 68d816e61fd44e101337f624 2025-09-27 16:57:33,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:33,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e61fd44e101337f624 HTTP/1.1" 200 None 2025-09-27 16:57:33,740 - lava_callback - DEBUG - Processing node 68d816e61fd44e101337f624: baseline-arm-baylibre 2025-09-27 16:57:33,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:34,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:34,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e61fd44e101337f624/log.txt.gz 2025-09-27 16:57:34,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:34,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:34,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e61fd44e101337f624/lava_callback.json.gz 2025-09-27 16:57:34,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:34,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e61fd44e101337f624 HTTP/1.1" 200 None 2025-09-27 16:57:34,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:34,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:57:34,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:34,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e61fd44e101337f624 HTTP/1.1" 200 None 2025-09-27 16:57:34,305 - lava_callback - INFO - Completed processing callback for node 68d816e61fd44e101337f624 2025-09-27 16:57:35,312 - lava_callback - INFO - Received callback for node 68d816e51fd44e101337f61b INFO: 172.21.0.1:53172 - "POST /node/68d816e51fd44e101337f61b HTTP/1.0" 202 Accepted 2025-09-27 16:57:35,318 - lava_callback - INFO - Starting async job submit for node 68d816e51fd44e101337f61b 2025-09-27 16:57:35,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:35,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e51fd44e101337f61b HTTP/1.1" 200 None 2025-09-27 16:57:35,351 - lava_callback - DEBUG - Processing node 68d816e51fd44e101337f61b: baseline-arm-baylibre 2025-09-27 16:57:35,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:35,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:35,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e51fd44e101337f61b/log.txt.gz 2025-09-27 16:57:35,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:35,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:35,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e51fd44e101337f61b/lava_callback.json.gz 2025-09-27 16:57:35,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:35,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e51fd44e101337f61b HTTP/1.1" 200 None 2025-09-27 16:57:35,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:35,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:57:35,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:35,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e51fd44e101337f61b HTTP/1.1" 200 None 2025-09-27 16:57:35,896 - lava_callback - INFO - Completed processing callback for node 68d816e51fd44e101337f61b INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:57:43,147 - lava_callback - INFO - Received callback for node 68d816f61fd44e101337f690 INFO: 172.21.0.1:49522 - "POST /node/68d816f61fd44e101337f690 HTTP/1.0" 202 Accepted 2025-09-27 16:57:43,154 - lava_callback - INFO - Starting async job submit for node 68d816f61fd44e101337f690 2025-09-27 16:57:43,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:43,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f61fd44e101337f690 HTTP/1.1" 200 None 2025-09-27 16:57:43,203 - lava_callback - DEBUG - Processing node 68d816f61fd44e101337f690: ltp-dio 2025-09-27 16:57:43,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:43,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:43,710 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d816f61fd44e101337f690/log.txt.gz 2025-09-27 16:57:43,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:57:43,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:57:43,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d816f61fd44e101337f690/lava_callback.json.gz 2025-09-27 16:57:43,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:43,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f61fd44e101337f690 HTTP/1.1" 200 None 2025-09-27 16:57:43,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:43,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:57:43,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:57:43,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816f61fd44e101337f690 HTTP/1.1" 200 None 2025-09-27 16:57:43,983 - lava_callback - INFO - Completed processing callback for node 68d816f61fd44e101337f690 INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:58:03,149 - lava_callback - INFO - Received callback for node 68d816e51fd44e101337f618 INFO: 172.21.0.1:48150 - "POST /node/68d816e51fd44e101337f618 HTTP/1.0" 202 Accepted 2025-09-27 16:58:03,155 - lava_callback - INFO - Starting async job submit for node 68d816e51fd44e101337f618 2025-09-27 16:58:03,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:03,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e51fd44e101337f618 HTTP/1.1" 200 None 2025-09-27 16:58:03,210 - lava_callback - DEBUG - Processing node 68d816e51fd44e101337f618: baseline-arm-baylibre 2025-09-27 16:58:03,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:58:03,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:58:03,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e51fd44e101337f618/log.txt.gz 2025-09-27 16:58:03,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:58:03,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:58:03,672 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e51fd44e101337f618/lava_callback.json.gz 2025-09-27 16:58:03,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:03,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e51fd44e101337f618 HTTP/1.1" 200 None 2025-09-27 16:58:03,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:03,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:58:03,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:03,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e51fd44e101337f618 HTTP/1.1" 200 None 2025-09-27 16:58:03,752 - lava_callback - INFO - Completed processing callback for node 68d816e51fd44e101337f618 INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:58:13,464 - lava_callback - INFO - Received callback for node 68d8176e1fd44e101337f6ed INFO: 172.21.0.1:56384 - "POST /node/68d8176e1fd44e101337f6ed HTTP/1.0" 202 Accepted 2025-09-27 16:58:13,470 - lava_callback - INFO - Starting async job submit for node 68d8176e1fd44e101337f6ed 2025-09-27 16:58:13,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:13,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8176e1fd44e101337f6ed HTTP/1.1" 200 None 2025-09-27 16:58:13,505 - lava_callback - DEBUG - Processing node 68d8176e1fd44e101337f6ed: baseline-arm-pengutronix 2025-09-27 16:58:13,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:58:13,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:58:13,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d8176e1fd44e101337f6ed/log.txt.gz 2025-09-27 16:58:13,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:58:13,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:58:13,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d8176e1fd44e101337f6ed/lava_callback.json.gz 2025-09-27 16:58:13,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:13,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8176e1fd44e101337f6ed HTTP/1.1" 200 None 2025-09-27 16:58:13,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:13,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:58:13,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:13,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8176e1fd44e101337f6ed HTTP/1.1" 200 None 2025-09-27 16:58:13,989 - lava_callback - INFO - Completed processing callback for node 68d8176e1fd44e101337f6ed INFO: 172.21.0.1:56400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:58:23,841 - lava_callback - INFO - Received callback for node 68d816ef1fd44e101337f662 INFO: 172.21.0.1:42800 - "POST /node/68d816ef1fd44e101337f662 HTTP/1.0" 202 Accepted 2025-09-27 16:58:23,847 - lava_callback - INFO - Starting async job submit for node 68d816ef1fd44e101337f662 2025-09-27 16:58:23,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:23,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816ef1fd44e101337f662 HTTP/1.1" 200 None 2025-09-27 16:58:23,881 - lava_callback - DEBUG - Processing node 68d816ef1fd44e101337f662: baseline-arm-clabbe 2025-09-27 16:58:24,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:58:24,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:58:24,203 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d816ef1fd44e101337f662/log.txt.gz 2025-09-27 16:58:24,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:58:24,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:58:24,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d816ef1fd44e101337f662/lava_callback.json.gz 2025-09-27 16:58:24,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:24,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816ef1fd44e101337f662 HTTP/1.1" 200 None 2025-09-27 16:58:24,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:24,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:58:24,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:24,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816ef1fd44e101337f662 HTTP/1.1" 200 None 2025-09-27 16:58:24,420 - lava_callback - INFO - Completed processing callback for node 68d816ef1fd44e101337f662 2025-09-27 16:58:25,543 - lava_callback - INFO - Received callback for node 68d589dc2be2da4660699b6d INFO: 172.21.0.1:42804 - "POST /node/68d589dc2be2da4660699b6d HTTP/1.0" 202 Accepted 2025-09-27 16:58:25,549 - lava_callback - INFO - Starting async job submit for node 68d589dc2be2da4660699b6d 2025-09-27 16:58:25,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:58:25,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589dc2be2da4660699b6d HTTP/1.1" 200 None 2025-09-27 16:58:25,584 - lava_callback - DEBUG - Processing node 68d589dc2be2da4660699b6d: baseline-arm-broonie 2025-09-27 16:58:25,814 - lava_callback - ERROR - Error processing callback for node 68d589dc2be2da4660699b6d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:59:11,454 - lava_callback - INFO - Received callback for node 68d817701fd44e101337f6f8 INFO: 172.21.0.1:42056 - "POST /node/68d817701fd44e101337f6f8 HTTP/1.0" 202 Accepted 2025-09-27 16:59:11,460 - lava_callback - INFO - Starting async job submit for node 68d817701fd44e101337f6f8 2025-09-27 16:59:11,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:59:11,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d817701fd44e101337f6f8 HTTP/1.1" 200 None 2025-09-27 16:59:11,494 - lava_callback - DEBUG - Processing node 68d817701fd44e101337f6f8: baseline-arm-pengutronix INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK 2025-09-27 16:59:11,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:59:11,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:59:11,769 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d817701fd44e101337f6f8/log.txt.gz 2025-09-27 16:59:11,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:59:11,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:59:11,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d817701fd44e101337f6f8/lava_callback.json.gz 2025-09-27 16:59:11,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:59:11,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d817701fd44e101337f6f8 HTTP/1.1" 200 None 2025-09-27 16:59:11,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:59:11,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 16:59:11,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:59:12,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d817701fd44e101337f6f8 HTTP/1.1" 200 None 2025-09-27 16:59:12,013 - lava_callback - INFO - Completed processing callback for node 68d817701fd44e101337f6f8 2025-09-27 16:59:14,843 - lava_callback - INFO - Received callback for node 68d75a16a6a7b6615d4c4e31 INFO: 172.21.0.1:42084 - "POST /node/68d75a16a6a7b6615d4c4e31 HTTP/1.0" 202 Accepted 2025-09-27 16:59:14,849 - lava_callback - INFO - Starting async job submit for node 68d75a16a6a7b6615d4c4e31 2025-09-27 16:59:14,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:59:14,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a16a6a7b6615d4c4e31 HTTP/1.1" 200 None 2025-09-27 16:59:14,882 - lava_callback - DEBUG - Processing node 68d75a16a6a7b6615d4c4e31: baseline-arm 2025-09-27 16:59:15,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42086 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 16:59:15,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:59:15,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a16a6a7b6615d4c4e31/log.txt.gz 2025-09-27 16:59:15,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 16:59:15,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 16:59:15,401 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a16a6a7b6615d4c4e31/lava_callback.json.gz 2025-09-27 16:59:15,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:59:15,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a16a6a7b6615d4c4e31 HTTP/1.1" 200 None 2025-09-27 16:59:15,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:59:15,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 16:59:15,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 16:59:15,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75a16a6a7b6615d4c4e31 HTTP/1.1" 200 None 2025-09-27 16:59:15,474 - lava_callback - INFO - Completed processing callback for node 68d75a16a6a7b6615d4c4e31 INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:00:02,979 - lava_callback - INFO - Received callback for node 68d816f01fd44e101337f666 INFO: 172.21.0.1:58304 - "POST /node/68d816f01fd44e101337f666 HTTP/1.0" 202 Accepted 2025-09-27 17:00:02,986 - lava_callback - INFO - Starting async job submit for node 68d816f01fd44e101337f666 2025-09-27 17:00:03,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:03,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f01fd44e101337f666 HTTP/1.1" 200 None 2025-09-27 17:00:03,026 - lava_callback - DEBUG - Processing node 68d816f01fd44e101337f666: baseline-arm-clabbe 2025-09-27 17:00:03,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:00:03,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:00:03,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d816f01fd44e101337f666/log.txt.gz 2025-09-27 17:00:03,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:00:04,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:00:04,046 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d816f01fd44e101337f666/lava_callback.json.gz 2025-09-27 17:00:04,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:04,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816f01fd44e101337f666 HTTP/1.1" 200 None 2025-09-27 17:00:04,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:04,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 17:00:04,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:04,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816f01fd44e101337f666 HTTP/1.1" 200 None 2025-09-27 17:00:04,148 - lava_callback - INFO - Completed processing callback for node 68d816f01fd44e101337f666 2025-09-27 17:00:05,007 - lava_callback - INFO - Received callback for node 68d571222be2da4660699547 INFO: 172.21.0.1:58320 - "POST /node/68d571222be2da4660699547 HTTP/1.0" 202 Accepted 2025-09-27 17:00:05,029 - lava_callback - INFO - Starting async job submit for node 68d571222be2da4660699547 2025-09-27 17:00:05,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:05,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571222be2da4660699547 HTTP/1.1" 200 None 2025-09-27 17:00:05,625 - lava_callback - DEBUG - Processing node 68d571222be2da4660699547: ltp-controllers 2025-09-27 17:00:05,893 - lava_callback - INFO - Received callback for node 68d5741c2be2da46606996f4 INFO: 172.21.0.1:58328 - "POST /node/68d5741c2be2da46606996f4 HTTP/1.0" 202 Accepted 2025-09-27 17:00:05,941 - lava_callback - INFO - Starting async job submit for node 68d5741c2be2da46606996f4 2025-09-27 17:00:06,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:06,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5741c2be2da46606996f4 HTTP/1.1" 200 None 2025-09-27 17:00:06,311 - lava_callback - DEBUG - Processing node 68d5741c2be2da46606996f4: ltp-containers INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:00:08,762 - lava_callback - ERROR - Error processing callback for node 68d5741c2be2da46606996f4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 17:00:11,053 - lava_callback - ERROR - Error processing callback for node 68d571222be2da4660699547: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:00:12,209 - lava_callback - INFO - Received callback for node 68d817e01fd44e101337f724 INFO: 172.21.0.1:59808 - "POST /node/68d817e01fd44e101337f724 HTTP/1.0" 202 Accepted 2025-09-27 17:00:12,218 - lava_callback - INFO - Starting async job submit for node 68d817e01fd44e101337f724 2025-09-27 17:00:12,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:12,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d817e01fd44e101337f724 HTTP/1.1" 200 None 2025-09-27 17:00:12,264 - lava_callback - DEBUG - Processing node 68d817e01fd44e101337f724: baseline-arm-pengutronix 2025-09-27 17:00:12,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:00:12,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:00:12,584 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d817e01fd44e101337f724/log.txt.gz 2025-09-27 17:00:12,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:00:12,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:00:12,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d817e01fd44e101337f724/lava_callback.json.gz 2025-09-27 17:00:12,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:12,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d817e01fd44e101337f724 HTTP/1.1" 200 None 2025-09-27 17:00:12,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:12,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 17:00:12,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:12,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d817e01fd44e101337f724 HTTP/1.1" 200 None 2025-09-27 17:00:12,909 - lava_callback - INFO - Completed processing callback for node 68d817e01fd44e101337f724 INFO: 172.21.0.1:59810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:00:40,601 - lava_callback - INFO - Received callback for node 68d816e71fd44e101337f62a INFO: 172.21.0.1:40910 - "POST /node/68d816e71fd44e101337f62a HTTP/1.0" 202 Accepted 2025-09-27 17:00:40,612 - lava_callback - INFO - Starting async job submit for node 68d816e71fd44e101337f62a 2025-09-27 17:00:40,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:40,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e71fd44e101337f62a HTTP/1.1" 200 None 2025-09-27 17:00:40,694 - lava_callback - DEBUG - Processing node 68d816e71fd44e101337f62a: baseline-arm-baylibre 2025-09-27 17:00:41,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:00:41,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:00:41,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e71fd44e101337f62a/log.txt.gz 2025-09-27 17:00:41,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:00:41,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:00:41,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d816e71fd44e101337f62a/lava_callback.json.gz 2025-09-27 17:00:41,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:41,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e71fd44e101337f62a HTTP/1.1" 200 None 2025-09-27 17:00:41,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:41,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 17:00:41,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:41,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e71fd44e101337f62a HTTP/1.1" 200 None 2025-09-27 17:00:41,613 - lava_callback - INFO - Completed processing callback for node 68d816e71fd44e101337f62a 2025-09-27 17:00:45,784 - lava_callback - INFO - Received callback for node 68d571212be2da4660699544 INFO: 172.21.0.1:40920 - "POST /node/68d571212be2da4660699544 HTTP/1.0" 202 Accepted 2025-09-27 17:00:45,796 - lava_callback - INFO - Starting async job submit for node 68d571212be2da4660699544 2025-09-27 17:00:45,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:00:45,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d571212be2da4660699544 HTTP/1.1" 200 None 2025-09-27 17:00:45,863 - lava_callback - DEBUG - Processing node 68d571212be2da4660699544: ltp-containers 2025-09-27 17:00:46,477 - lava_callback - ERROR - Error processing callback for node 68d571212be2da4660699544: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:01:10,030 - lava_callback - INFO - Received callback for node 68d813f61fd44e101337f24f INFO: 172.21.0.1:58002 - "POST /node/68d813f61fd44e101337f24f HTTP/1.0" 202 Accepted 2025-09-27 17:01:10,036 - lava_callback - INFO - Starting async job submit for node 68d813f61fd44e101337f24f 2025-09-27 17:01:10,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:10,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d813f61fd44e101337f24f HTTP/1.1" 200 None 2025-09-27 17:01:10,094 - lava_callback - DEBUG - Processing node 68d813f61fd44e101337f24f: baseline-arm 2025-09-27 17:01:10,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:01:10,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:01:10,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d813f61fd44e101337f24f/log.txt.gz 2025-09-27 17:01:10,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:01:10,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:01:10,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d813f61fd44e101337f24f/lava_callback.json.gz DEBUG: Setup failed for 68d813f61fd44e101337f24f. Transitting job node result: incomplete -> fail 2025-09-27 17:01:10,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:10,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d813f61fd44e101337f24f HTTP/1.1" 200 None 2025-09-27 17:01:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:10,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 17:01:10,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:10,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d813f61fd44e101337f24f HTTP/1.1" 200 None 2025-09-27 17:01:10,851 - lava_callback - INFO - Completed processing callback for node 68d813f61fd44e101337f24f INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:01:23,566 - lava_callback - INFO - Received callback for node 68d817ea1fd44e101337f72d INFO: 172.21.0.1:41338 - "POST /node/68d817ea1fd44e101337f72d HTTP/1.0" 202 Accepted 2025-09-27 17:01:23,572 - lava_callback - INFO - Starting async job submit for node 68d817ea1fd44e101337f72d 2025-09-27 17:01:23,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:23,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d817ea1fd44e101337f72d HTTP/1.1" 200 None 2025-09-27 17:01:23,606 - lava_callback - DEBUG - Processing node 68d817ea1fd44e101337f72d: baseline-arm 2025-09-27 17:01:23,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:01:23,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:01:23,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d817ea1fd44e101337f72d/log.txt.gz 2025-09-27 17:01:23,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:01:24,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:01:24,065 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d817ea1fd44e101337f72d/lava_callback.json.gz 2025-09-27 17:01:24,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:24,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d817ea1fd44e101337f72d HTTP/1.1" 200 None 2025-09-27 17:01:24,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:24,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f471fd44e101337efa7 HTTP/1.1" 200 None 2025-09-27 17:01:24,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:24,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d817ea1fd44e101337f72d HTTP/1.1" 200 None 2025-09-27 17:01:24,144 - lava_callback - INFO - Completed processing callback for node 68d817ea1fd44e101337f72d INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:01:35,293 - lava_callback - INFO - Received callback for node 68d75a18a6a7b6615d4c4e34 INFO: 172.21.0.1:33302 - "POST /node/68d75a18a6a7b6615d4c4e34 HTTP/1.0" 202 Accepted 2025-09-27 17:01:35,299 - lava_callback - INFO - Starting async job submit for node 68d75a18a6a7b6615d4c4e34 2025-09-27 17:01:35,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:35,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a18a6a7b6615d4c4e34 HTTP/1.1" 200 None 2025-09-27 17:01:35,332 - lava_callback - DEBUG - Processing node 68d75a18a6a7b6615d4c4e34: baseline-arm 2025-09-27 17:01:35,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:01:35,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:01:35,683 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a18a6a7b6615d4c4e34/log.txt.gz 2025-09-27 17:01:35,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:01:35,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:01:35,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a18a6a7b6615d4c4e34/lava_callback.json.gz 2025-09-27 17:01:35,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:35,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a18a6a7b6615d4c4e34 HTTP/1.1" 200 None 2025-09-27 17:01:35,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:35,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 17:01:35,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:35,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75a18a6a7b6615d4c4e34 HTTP/1.1" 200 None 2025-09-27 17:01:35,936 - lava_callback - INFO - Completed processing callback for node 68d75a18a6a7b6615d4c4e34 INFO: 172.21.0.1:33304 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:01:39,541 - lava_callback - INFO - Received callback for node 68d5755e2be2da4660699761 INFO: 172.21.0.1:56522 - "POST /node/68d5755e2be2da4660699761 HTTP/1.0" 202 Accepted 2025-09-27 17:01:39,547 - lava_callback - INFO - Starting async job submit for node 68d5755e2be2da4660699761 2025-09-27 17:01:39,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:39,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5755e2be2da4660699761 HTTP/1.1" 200 None 2025-09-27 17:01:39,561 - lava_callback - DEBUG - Processing node 68d5755e2be2da4660699761: baseline-arm64-baylibre 2025-09-27 17:01:39,561 - lava_callback - ERROR - Error processing callback for node 68d5755e2be2da4660699761: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:01:40,190 - lava_callback - INFO - Received callback for node 68d575672be2da4660699782 INFO: 172.21.0.1:56530 - "POST /node/68d575672be2da4660699782 HTTP/1.0" 202 Accepted 2025-09-27 17:01:40,196 - lava_callback - INFO - Starting async job submit for node 68d575672be2da4660699782 2025-09-27 17:01:40,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:40,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d575672be2da4660699782 HTTP/1.1" 200 None 2025-09-27 17:01:40,217 - lava_callback - DEBUG - Processing node 68d575672be2da4660699782: baseline-arm64-baylibre 2025-09-27 17:01:40,217 - lava_callback - ERROR - Error processing callback for node 68d575672be2da4660699782: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:01:53,560 - lava_callback - INFO - Received callback for node 68d575782be2da46606997bb INFO: 172.21.0.1:48618 - "POST /node/68d575782be2da46606997bb HTTP/1.0" 202 Accepted 2025-09-27 17:01:53,567 - lava_callback - INFO - Starting async job submit for node 68d575782be2da46606997bb 2025-09-27 17:01:53,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:53,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d575782be2da46606997bb HTTP/1.1" 200 None 2025-09-27 17:01:53,583 - lava_callback - DEBUG - Processing node 68d575782be2da46606997bb: baseline-arm64-clabbe 2025-09-27 17:01:53,583 - lava_callback - ERROR - Error processing callback for node 68d575782be2da46606997bb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:01:54,214 - lava_callback - INFO - Received callback for node 68d575792be2da46606997be INFO: 172.21.0.1:48622 - "POST /node/68d575792be2da46606997be HTTP/1.0" 202 Accepted 2025-09-27 17:01:54,220 - lava_callback - INFO - Starting async job submit for node 68d575792be2da46606997be 2025-09-27 17:01:54,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:54,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d575792be2da46606997be HTTP/1.1" 200 None 2025-09-27 17:01:54,233 - lava_callback - DEBUG - Processing node 68d575792be2da46606997be: baseline-arm64-clabbe 2025-09-27 17:01:54,234 - lava_callback - ERROR - Error processing callback for node 68d575792be2da46606997be: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:01:54,882 - lava_callback - INFO - Received callback for node 68d5757c2be2da46606997ca INFO: 172.21.0.1:48632 - "POST /node/68d5757c2be2da46606997ca HTTP/1.0" 202 Accepted 2025-09-27 17:01:54,888 - lava_callback - INFO - Starting async job submit for node 68d5757c2be2da46606997ca 2025-09-27 17:01:54,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:54,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5757c2be2da46606997ca HTTP/1.1" 200 None 2025-09-27 17:01:54,902 - lava_callback - DEBUG - Processing node 68d5757c2be2da46606997ca: baseline-arm64-clabbe 2025-09-27 17:01:54,902 - lava_callback - ERROR - Error processing callback for node 68d5757c2be2da46606997ca: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:01:55,545 - lava_callback - INFO - Received callback for node 68d575742be2da46606997b4 INFO: 172.21.0.1:48642 - "POST /node/68d575742be2da46606997b4 HTTP/1.0" 202 Accepted 2025-09-27 17:01:55,550 - lava_callback - INFO - Starting async job submit for node 68d575742be2da46606997b4 2025-09-27 17:01:55,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:55,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d575742be2da46606997b4 HTTP/1.1" 200 None 2025-09-27 17:01:55,565 - lava_callback - DEBUG - Processing node 68d575742be2da46606997b4: baseline-arm64-clabbe 2025-09-27 17:01:55,565 - lava_callback - ERROR - Error processing callback for node 68d575742be2da46606997b4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:01:56,186 - lava_callback - INFO - Received callback for node 68d575792be2da46606997c3 INFO: 172.21.0.1:48652 - "POST /node/68d575792be2da46606997c3 HTTP/1.0" 202 Accepted 2025-09-27 17:01:56,191 - lava_callback - INFO - Starting async job submit for node 68d575792be2da46606997c3 2025-09-27 17:01:56,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:56,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d575792be2da46606997c3 HTTP/1.1" 200 None 2025-09-27 17:01:56,205 - lava_callback - DEBUG - Processing node 68d575792be2da46606997c3: baseline-arm64-clabbe 2025-09-27 17:01:56,205 - lava_callback - ERROR - Error processing callback for node 68d575792be2da46606997c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:48654 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:01:56,825 - lava_callback - INFO - Received callback for node 68d5757b2be2da46606997c7 INFO: 172.21.0.1:48662 - "POST /node/68d5757b2be2da46606997c7 HTTP/1.0" 202 Accepted 2025-09-27 17:01:56,831 - lava_callback - INFO - Starting async job submit for node 68d5757b2be2da46606997c7 2025-09-27 17:01:56,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:01:56,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5757b2be2da46606997c7 HTTP/1.1" 200 None 2025-09-27 17:01:56,878 - lava_callback - DEBUG - Processing node 68d5757b2be2da46606997c7: baseline-arm64-clabbe 2025-09-27 17:01:56,878 - lava_callback - ERROR - Error processing callback for node 68d5757b2be2da46606997c7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:02:02,673 - lava_callback - INFO - Received callback for node 68d589bc2be2da4660699b48 INFO: 172.21.0.1:52510 - "POST /node/68d589bc2be2da4660699b48 HTTP/1.0" 202 Accepted 2025-09-27 17:02:02,678 - lava_callback - INFO - Starting async job submit for node 68d589bc2be2da4660699b48 2025-09-27 17:02:02,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:02:02,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589bc2be2da4660699b48 HTTP/1.1" 200 None 2025-09-27 17:02:02,733 - lava_callback - DEBUG - Processing node 68d589bc2be2da4660699b48: baseline-arm-broonie 2025-09-27 17:02:02,930 - lava_callback - ERROR - Error processing callback for node 68d589bc2be2da4660699b48: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:02:36,236 - lava_callback - INFO - Received callback for node 68d732d8a6a7b6615d4c45ab INFO: 172.21.0.1:41718 - "POST /node/68d732d8a6a7b6615d4c45ab HTTP/1.0" 202 Accepted 2025-09-27 17:02:36,244 - lava_callback - INFO - Starting async job submit for node 68d732d8a6a7b6615d4c45ab 2025-09-27 17:02:36,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:02:36,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732d8a6a7b6615d4c45ab HTTP/1.1" 200 None 2025-09-27 17:02:36,298 - lava_callback - DEBUG - Processing node 68d732d8a6a7b6615d4c45ab: baseline-arm64 INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:02:37,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:02:37,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:02:37,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732d8a6a7b6615d4c45ab/log.txt.gz 2025-09-27 17:02:37,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:02:37,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:02:37,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732d8a6a7b6615d4c45ab/lava_callback.json.gz DEBUG: Setup failed for 68d732d8a6a7b6615d4c45ab. Transitting job node result: incomplete -> fail 2025-09-27 17:02:37,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:02:37,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732d8a6a7b6615d4c45ab HTTP/1.1" 200 None 2025-09-27 17:02:37,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:02:37,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:02:37,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:02:37,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732d8a6a7b6615d4c45ab HTTP/1.1" 200 None 2025-09-27 17:02:37,673 - lava_callback - INFO - Completed processing callback for node 68d732d8a6a7b6615d4c45ab 2025-09-27 17:02:45,025 - lava_callback - INFO - Received callback for node 68d732dba6a7b6615d4c45ae INFO: 172.21.0.1:32910 - "POST /node/68d732dba6a7b6615d4c45ae HTTP/1.0" 202 Accepted 2025-09-27 17:02:45,032 - lava_callback - INFO - Starting async job submit for node 68d732dba6a7b6615d4c45ae 2025-09-27 17:02:45,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:02:45,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732dba6a7b6615d4c45ae HTTP/1.1" 200 None 2025-09-27 17:02:45,089 - lava_callback - DEBUG - Processing node 68d732dba6a7b6615d4c45ae: baseline-arm64 2025-09-27 17:02:45,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:02:46,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:02:46,227 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732dba6a7b6615d4c45ae/log.txt.gz 2025-09-27 17:02:46,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:02:46,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:02:46,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732dba6a7b6615d4c45ae/lava_callback.json.gz DEBUG: Setup failed for 68d732dba6a7b6615d4c45ae. Transitting job node result: incomplete -> fail 2025-09-27 17:02:46,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:02:46,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732dba6a7b6615d4c45ae HTTP/1.1" 200 None 2025-09-27 17:02:46,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:02:46,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:02:46,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:02:46,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732dba6a7b6615d4c45ae HTTP/1.1" 200 None 2025-09-27 17:02:46,541 - lava_callback - INFO - Completed processing callback for node 68d732dba6a7b6615d4c45ae INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:03:05,831 - lava_callback - INFO - Received callback for node 68d732dca6a7b6615d4c45b1 INFO: 172.21.0.1:56626 - "POST /node/68d732dca6a7b6615d4c45b1 HTTP/1.0" 202 Accepted 2025-09-27 17:03:05,838 - lava_callback - INFO - Starting async job submit for node 68d732dca6a7b6615d4c45b1 2025-09-27 17:03:05,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:03:05,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732dca6a7b6615d4c45b1 HTTP/1.1" 200 None 2025-09-27 17:03:05,909 - lava_callback - DEBUG - Processing node 68d732dca6a7b6615d4c45b1: baseline-arm64 INFO: 172.21.0.1:56638 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:03:06,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:03:06,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:03:06,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732dca6a7b6615d4c45b1/log.txt.gz 2025-09-27 17:03:06,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:03:07,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:03:07,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732dca6a7b6615d4c45b1/lava_callback.json.gz DEBUG: Setup failed for 68d732dca6a7b6615d4c45b1. Transitting job node result: incomplete -> fail 2025-09-27 17:03:07,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:03:07,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732dca6a7b6615d4c45b1 HTTP/1.1" 200 None 2025-09-27 17:03:07,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:03:07,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:03:07,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:03:07,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732dca6a7b6615d4c45b1 HTTP/1.1" 200 None 2025-09-27 17:03:07,279 - lava_callback - INFO - Completed processing callback for node 68d732dca6a7b6615d4c45b1 INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:03:54,464 - lava_callback - INFO - Received callback for node 68d75a18a6a7b6615d4c4e37 INFO: 172.21.0.1:33720 - "POST /node/68d75a18a6a7b6615d4c4e37 HTTP/1.0" 202 Accepted 2025-09-27 17:03:54,469 - lava_callback - INFO - Starting async job submit for node 68d75a18a6a7b6615d4c4e37 2025-09-27 17:03:54,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:03:54,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a18a6a7b6615d4c4e37 HTTP/1.1" 200 None 2025-09-27 17:03:54,535 - lava_callback - DEBUG - Processing node 68d75a18a6a7b6615d4c4e37: baseline-arm 2025-09-27 17:03:54,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:03:54,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:03:54,955 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a18a6a7b6615d4c4e37/log.txt.gz 2025-09-27 17:03:54,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:03:55,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:03:55,100 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a18a6a7b6615d4c4e37/lava_callback.json.gz 2025-09-27 17:03:55,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:03:55,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a18a6a7b6615d4c4e37 HTTP/1.1" 200 None 2025-09-27 17:03:55,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:03:55,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 17:03:55,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:03:55,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75a18a6a7b6615d4c4e37 HTTP/1.1" 200 None 2025-09-27 17:03:55,208 - lava_callback - INFO - Completed processing callback for node 68d75a18a6a7b6615d4c4e37 INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:04:25,945 - lava_callback - INFO - Received callback for node 68d589e82be2da4660699b7f INFO: 172.21.0.1:44956 - "POST /node/68d589e82be2da4660699b7f HTTP/1.0" 202 Accepted 2025-09-27 17:04:25,952 - lava_callback - INFO - Starting async job submit for node 68d589e82be2da4660699b7f 2025-09-27 17:04:25,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:04:25,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589e82be2da4660699b7f HTTP/1.1" 200 None 2025-09-27 17:04:25,990 - lava_callback - DEBUG - Processing node 68d589e82be2da4660699b7f: ltp-cap-bounds 2025-09-27 17:04:26,322 - lava_callback - ERROR - Error processing callback for node 68d589e82be2da4660699b7f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:04:53,665 - lava_callback - INFO - Received callback for node 68d814771fd44e101337f270 INFO: 172.21.0.1:34316 - "POST /node/68d814771fd44e101337f270 HTTP/1.0" 202 Accepted 2025-09-27 17:04:53,671 - lava_callback - INFO - Starting async job submit for node 68d814771fd44e101337f270 2025-09-27 17:04:53,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:04:53,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d814771fd44e101337f270 HTTP/1.1" 200 None 2025-09-27 17:04:53,713 - lava_callback - DEBUG - Processing node 68d814771fd44e101337f270: baseline-x86-kcidebug-intel 2025-09-27 17:04:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:04:54,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:04:54,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d814771fd44e101337f270/log.txt.gz 2025-09-27 17:04:54,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:04:54,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:04:54,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d814771fd44e101337f270/lava_callback.json.gz DEBUG: Setup failed for 68d814771fd44e101337f270. Transitting job node result: incomplete -> fail 2025-09-27 17:04:54,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:04:54,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d814771fd44e101337f270 HTTP/1.1" 200 None 2025-09-27 17:04:54,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:04:54,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b758dd6b39fd1aeb993 HTTP/1.1" 200 None 2025-09-27 17:04:54,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:04:54,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d814771fd44e101337f270 HTTP/1.1" 200 None 2025-09-27 17:04:54,365 - lava_callback - INFO - Completed processing callback for node 68d814771fd44e101337f270 INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 17:06:15,314 - lava_callback - INFO - Received callback for node 68d75a1aa6a7b6615d4c4e3a INFO: 172.21.0.1:44314 - "POST /node/68d75a1aa6a7b6615d4c4e3a HTTP/1.0" 202 Accepted 2025-09-27 17:06:15,320 - lava_callback - INFO - Starting async job submit for node 68d75a1aa6a7b6615d4c4e3a 2025-09-27 17:06:15,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:06:15,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a1aa6a7b6615d4c4e3a HTTP/1.1" 200 None 2025-09-27 17:06:15,370 - lava_callback - DEBUG - Processing node 68d75a1aa6a7b6615d4c4e3a: baseline-arm 2025-09-27 17:06:15,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:06:15,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:06:15,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a1aa6a7b6615d4c4e3a/log.txt.gz 2025-09-27 17:06:15,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:06:15,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:06:15,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a1aa6a7b6615d4c4e3a/lava_callback.json.gz 2025-09-27 17:06:15,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:06:15,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a1aa6a7b6615d4c4e3a HTTP/1.1" 200 None 2025-09-27 17:06:15,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:06:15,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 17:06:15,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:06:15,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75a1aa6a7b6615d4c4e3a HTTP/1.1" 200 None 2025-09-27 17:06:15,915 - lava_callback - INFO - Completed processing callback for node 68d75a1aa6a7b6615d4c4e3a INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:06:39,730 - lava_callback - INFO - Received callback for node 68d5768d2be2da46606998f2 INFO: 172.21.0.1:44694 - "POST /node/68d5768d2be2da46606998f2 HTTP/1.0" 202 Accepted 2025-09-27 17:06:39,736 - lava_callback - INFO - Starting async job submit for node 68d5768d2be2da46606998f2 2025-09-27 17:06:39,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:06:39,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5768d2be2da46606998f2 HTTP/1.1" 200 None 2025-09-27 17:06:39,755 - lava_callback - DEBUG - Processing node 68d5768d2be2da46606998f2: baseline-arm64-baylibre 2025-09-27 17:06:39,755 - lava_callback - ERROR - Error processing callback for node 68d5768d2be2da46606998f2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:06:59,737 - lava_callback - INFO - Received callback for node 68d576a62be2da4660699935 INFO: 172.21.0.1:34344 - "POST /node/68d576a62be2da4660699935 HTTP/1.0" 202 Accepted 2025-09-27 17:06:59,743 - lava_callback - INFO - Starting async job submit for node 68d576a62be2da4660699935 2025-09-27 17:06:59,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:06:59,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576a62be2da4660699935 HTTP/1.1" 200 None 2025-09-27 17:06:59,757 - lava_callback - DEBUG - Processing node 68d576a62be2da4660699935: baseline-arm64-baylibre 2025-09-27 17:06:59,757 - lava_callback - ERROR - Error processing callback for node 68d576a62be2da4660699935: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:07:33,857 - lava_callback - INFO - Received callback for node 68d576d02be2da466069996b INFO: 172.21.0.1:59248 - "POST /node/68d576d02be2da466069996b HTTP/1.0" 202 Accepted 2025-09-27 17:07:33,863 - lava_callback - INFO - Starting async job submit for node 68d576d02be2da466069996b 2025-09-27 17:07:33,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:07:33,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576d02be2da466069996b HTTP/1.1" 200 None 2025-09-27 17:07:33,876 - lava_callback - DEBUG - Processing node 68d576d02be2da466069996b: baseline-arm64-clabbe 2025-09-27 17:07:33,876 - lava_callback - ERROR - Error processing callback for node 68d576d02be2da466069996b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:07:53,841 - lava_callback - INFO - Received callback for node 68d576d72be2da4660699971 INFO: 172.21.0.1:48384 - "POST /node/68d576d72be2da4660699971 HTTP/1.0" 202 Accepted 2025-09-27 17:07:53,846 - lava_callback - INFO - Starting async job submit for node 68d576d72be2da4660699971 2025-09-27 17:07:53,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:07:53,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576d72be2da4660699971 HTTP/1.1" 200 None 2025-09-27 17:07:53,859 - lava_callback - DEBUG - Processing node 68d576d72be2da4660699971: baseline-arm64-clabbe 2025-09-27 17:07:53,859 - lava_callback - ERROR - Error processing callback for node 68d576d72be2da4660699971: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:07:54,491 - lava_callback - INFO - Received callback for node 68d576da2be2da4660699974 INFO: 172.21.0.1:48386 - "POST /node/68d576da2be2da4660699974 HTTP/1.0" 202 Accepted 2025-09-27 17:07:54,497 - lava_callback - INFO - Starting async job submit for node 68d576da2be2da4660699974 2025-09-27 17:07:54,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:07:54,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576da2be2da4660699974 HTTP/1.1" 200 None 2025-09-27 17:07:54,510 - lava_callback - DEBUG - Processing node 68d576da2be2da4660699974: baseline-arm64-clabbe 2025-09-27 17:07:54,510 - lava_callback - ERROR - Error processing callback for node 68d576da2be2da4660699974: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:07:55,130 - lava_callback - INFO - Received callback for node 68d576dd2be2da4660699977 INFO: 172.21.0.1:48396 - "POST /node/68d576dd2be2da4660699977 HTTP/1.0" 202 Accepted 2025-09-27 17:07:55,135 - lava_callback - INFO - Starting async job submit for node 68d576dd2be2da4660699977 2025-09-27 17:07:55,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:07:55,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576dd2be2da4660699977 HTTP/1.1" 200 None 2025-09-27 17:07:55,149 - lava_callback - DEBUG - Processing node 68d576dd2be2da4660699977: baseline-arm64-clabbe 2025-09-27 17:07:55,149 - lava_callback - ERROR - Error processing callback for node 68d576dd2be2da4660699977: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:07:55,794 - lava_callback - INFO - Received callback for node 68d576e02be2da466069997a INFO: 172.21.0.1:48404 - "POST /node/68d576e02be2da466069997a HTTP/1.0" 202 Accepted 2025-09-27 17:07:55,803 - lava_callback - INFO - Starting async job submit for node 68d576e02be2da466069997a 2025-09-27 17:07:55,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:07:55,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576e02be2da466069997a HTTP/1.1" 200 None 2025-09-27 17:07:55,817 - lava_callback - DEBUG - Processing node 68d576e02be2da466069997a: baseline-arm64-clabbe 2025-09-27 17:07:55,817 - lava_callback - ERROR - Error processing callback for node 68d576e02be2da466069997a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 17:07:56,449 - lava_callback - INFO - Received callback for node 68d576e32be2da466069997d INFO: 172.21.0.1:48420 - "POST /node/68d576e32be2da466069997d HTTP/1.0" 202 Accepted 2025-09-27 17:07:56,454 - lava_callback - INFO - Starting async job submit for node 68d576e32be2da466069997d 2025-09-27 17:07:56,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:07:56,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d576e32be2da466069997d HTTP/1.1" 200 None 2025-09-27 17:07:56,468 - lava_callback - DEBUG - Processing node 68d576e32be2da466069997d: baseline-arm64-clabbe 2025-09-27 17:07:56,468 - lava_callback - ERROR - Error processing callback for node 68d576e32be2da466069997d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:08:37,687 - lava_callback - INFO - Received callback for node 68d75a1aa6a7b6615d4c4e3d INFO: 172.21.0.1:48224 - "POST /node/68d75a1aa6a7b6615d4c4e3d HTTP/1.0" 202 Accepted 2025-09-27 17:08:37,693 - lava_callback - INFO - Starting async job submit for node 68d75a1aa6a7b6615d4c4e3d 2025-09-27 17:08:37,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:08:37,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a1aa6a7b6615d4c4e3d HTTP/1.1" 200 None 2025-09-27 17:08:37,726 - lava_callback - DEBUG - Processing node 68d75a1aa6a7b6615d4c4e3d: baseline-arm 2025-09-27 17:08:37,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:08:38,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:08:38,113 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a1aa6a7b6615d4c4e3d/log.txt.gz 2025-09-27 17:08:38,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:08:38,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:08:38,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a1aa6a7b6615d4c4e3d/lava_callback.json.gz 2025-09-27 17:08:38,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:08:38,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a1aa6a7b6615d4c4e3d HTTP/1.1" 200 None 2025-09-27 17:08:38,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:08:38,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 17:08:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:08:38,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75a1aa6a7b6615d4c4e3d HTTP/1.1" 200 None 2025-09-27 17:08:38,333 - lava_callback - INFO - Completed processing callback for node 68d75a1aa6a7b6615d4c4e3d INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:10:55,640 - lava_callback - INFO - Received callback for node 68d75a1ca6a7b6615d4c4e40 INFO: 172.21.0.1:34554 - "POST /node/68d75a1ca6a7b6615d4c4e40 HTTP/1.0" 202 Accepted 2025-09-27 17:10:55,650 - lava_callback - INFO - Starting async job submit for node 68d75a1ca6a7b6615d4c4e40 2025-09-27 17:10:55,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:10:55,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a1ca6a7b6615d4c4e40 HTTP/1.1" 200 None 2025-09-27 17:10:55,840 - lava_callback - DEBUG - Processing node 68d75a1ca6a7b6615d4c4e40: baseline-arm INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:10:56,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:10:56,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:10:56,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a1ca6a7b6615d4c4e40/log.txt.gz 2025-09-27 17:10:56,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:10:56,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:10:56,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a1ca6a7b6615d4c4e40/lava_callback.json.gz 2025-09-27 17:10:56,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:10:56,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a1ca6a7b6615d4c4e40 HTTP/1.1" 200 None 2025-09-27 17:10:56,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:10:56,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 17:10:56,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:10:56,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75a1ca6a7b6615d4c4e40 HTTP/1.1" 200 None 2025-09-27 17:10:56,498 - lava_callback - INFO - Completed processing callback for node 68d75a1ca6a7b6615d4c4e40 INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 17:13:15,445 - lava_callback - INFO - Received callback for node 68d75a1ca6a7b6615d4c4e43 INFO: 172.21.0.1:56574 - "POST /node/68d75a1ca6a7b6615d4c4e43 HTTP/1.0" 202 Accepted 2025-09-27 17:13:15,451 - lava_callback - INFO - Starting async job submit for node 68d75a1ca6a7b6615d4c4e43 2025-09-27 17:13:15,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:13:15,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a1ca6a7b6615d4c4e43 HTTP/1.1" 200 None 2025-09-27 17:13:15,506 - lava_callback - DEBUG - Processing node 68d75a1ca6a7b6615d4c4e43: baseline-arm 2025-09-27 17:13:15,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:13:15,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:13:15,857 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a1ca6a7b6615d4c4e43/log.txt.gz 2025-09-27 17:13:15,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:13:15,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:13:15,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75a1ca6a7b6615d4c4e43/lava_callback.json.gz 2025-09-27 17:13:16,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:13:16,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75a1ca6a7b6615d4c4e43 HTTP/1.1" 200 None 2025-09-27 17:13:16,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:13:16,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-27 17:13:16,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:13:16,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75a1ca6a7b6615d4c4e43 HTTP/1.1" 200 None 2025-09-27 17:13:16,076 - lava_callback - INFO - Completed processing callback for node 68d75a1ca6a7b6615d4c4e43 INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:13:33,712 - lava_callback - INFO - Received callback for node 68d816e31fd44e101337f60f INFO: 172.21.0.1:44092 - "POST /node/68d816e31fd44e101337f60f HTTP/1.0" 202 Accepted 2025-09-27 17:13:33,718 - lava_callback - INFO - Starting async job submit for node 68d816e31fd44e101337f60f 2025-09-27 17:13:33,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:13:33,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e31fd44e101337f60f HTTP/1.1" 200 None 2025-09-27 17:13:33,768 - lava_callback - DEBUG - Processing node 68d816e31fd44e101337f60f: baseline-arm 2025-09-27 17:13:34,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:13:34,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:13:34,222 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e31fd44e101337f60f/log.txt.gz 2025-09-27 17:13:34,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:13:34,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:13:34,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e31fd44e101337f60f/lava_callback.json.gz DEBUG: Setup failed for 68d816e31fd44e101337f60f. Transitting job node result: incomplete -> fail 2025-09-27 17:13:34,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:13:34,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e31fd44e101337f60f HTTP/1.1" 200 None 2025-09-27 17:13:34,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:13:34,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 17:13:34,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:13:34,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e31fd44e101337f60f HTTP/1.1" 200 None 2025-09-27 17:13:34,478 - lava_callback - INFO - Completed processing callback for node 68d816e31fd44e101337f60f INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:14:19,287 - lava_callback - INFO - Received callback for node 68d589662be2da4660699aa7 INFO: 172.21.0.1:59878 - "POST /node/68d589662be2da4660699aa7 HTTP/1.0" 202 Accepted 2025-09-27 17:14:19,293 - lava_callback - INFO - Starting async job submit for node 68d589662be2da4660699aa7 2025-09-27 17:14:19,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:14:19,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589662be2da4660699aa7 HTTP/1.1" 200 None 2025-09-27 17:14:19,354 - lava_callback - DEBUG - Processing node 68d589662be2da4660699aa7: baseline-arm 2025-09-27 17:14:19,653 - lava_callback - ERROR - Error processing callback for node 68d589662be2da4660699aa7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:15:00,408 - lava_callback - INFO - Received callback for node 68d815841fd44e101337f5a8 INFO: 172.21.0.1:37318 - "POST /node/68d815841fd44e101337f5a8 HTTP/1.0" 202 Accepted 2025-09-27 17:15:00,415 - lava_callback - INFO - Starting async job submit for node 68d815841fd44e101337f5a8 2025-09-27 17:15:00,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:15:00,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d815841fd44e101337f5a8 HTTP/1.1" 200 None 2025-09-27 17:15:00,473 - lava_callback - DEBUG - Processing node 68d815841fd44e101337f5a8: baseline-x86 2025-09-27 17:15:01,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:15:01,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:15:01,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d815841fd44e101337f5a8/log.txt.gz 2025-09-27 17:15:01,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:15:01,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:15:01,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d815841fd44e101337f5a8/lava_callback.json.gz DEBUG: Setup failed for 68d815841fd44e101337f5a8. Transitting job node result: incomplete -> fail 2025-09-27 17:15:01,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:15:01,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d815841fd44e101337f5a8 HTTP/1.1" 200 None 2025-09-27 17:15:01,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:15:01,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b728dd6b39fd1aeb990 HTTP/1.1" 200 None 2025-09-27 17:15:01,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:15:01,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d815841fd44e101337f5a8 HTTP/1.1" 200 None 2025-09-27 17:15:01,661 - lava_callback - INFO - Completed processing callback for node 68d815841fd44e101337f5a8 INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:15:29,103 - lava_callback - INFO - Received callback for node 68d75e0ca6a7b6615d4c4ebc INFO: 172.21.0.1:43240 - "POST /node/68d75e0ca6a7b6615d4c4ebc HTTP/1.0" 202 Accepted 2025-09-27 17:15:29,109 - lava_callback - INFO - Starting async job submit for node 68d75e0ca6a7b6615d4c4ebc 2025-09-27 17:15:29,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:15:29,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e0ca6a7b6615d4c4ebc HTTP/1.1" 200 None 2025-09-27 17:15:29,163 - lava_callback - DEBUG - Processing node 68d75e0ca6a7b6615d4c4ebc: baseline-arm 2025-09-27 17:15:29,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:15:29,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:15:29,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e0ca6a7b6615d4c4ebc/log.txt.gz 2025-09-27 17:15:29,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:15:29,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:15:29,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e0ca6a7b6615d4c4ebc/lava_callback.json.gz 2025-09-27 17:15:29,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:15:29,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e0ca6a7b6615d4c4ebc HTTP/1.1" 200 None 2025-09-27 17:15:29,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:15:29,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:15:29,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:15:29,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e0ca6a7b6615d4c4ebc HTTP/1.1" 200 None 2025-09-27 17:15:29,788 - lava_callback - INFO - Completed processing callback for node 68d75e0ca6a7b6615d4c4ebc INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:17:55,489 - lava_callback - INFO - Received callback for node 68d75e0da6a7b6615d4c4ebf INFO: 172.21.0.1:58356 - "POST /node/68d75e0da6a7b6615d4c4ebf HTTP/1.0" 202 Accepted 2025-09-27 17:17:55,495 - lava_callback - INFO - Starting async job submit for node 68d75e0da6a7b6615d4c4ebf 2025-09-27 17:17:55,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:17:55,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e0da6a7b6615d4c4ebf HTTP/1.1" 200 None 2025-09-27 17:17:55,536 - lava_callback - DEBUG - Processing node 68d75e0da6a7b6615d4c4ebf: baseline-arm 2025-09-27 17:17:55,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:17:55,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:17:55,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e0da6a7b6615d4c4ebf/log.txt.gz 2025-09-27 17:17:55,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:17:56,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:17:56,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e0da6a7b6615d4c4ebf/lava_callback.json.gz 2025-09-27 17:17:56,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:17:56,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e0da6a7b6615d4c4ebf HTTP/1.1" 200 None 2025-09-27 17:17:56,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:17:56,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:17:56,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:17:56,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e0da6a7b6615d4c4ebf HTTP/1.1" 200 None 2025-09-27 17:17:56,141 - lava_callback - INFO - Completed processing callback for node 68d75e0da6a7b6615d4c4ebf INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:18:35,762 - lava_callback - INFO - Received callback for node 68d81c471fd44e101337f7c5 INFO: 172.21.0.1:57908 - "POST /node/68d81c471fd44e101337f7c5 HTTP/1.0" 202 Accepted 2025-09-27 17:18:35,768 - lava_callback - INFO - Starting async job submit for node 68d81c471fd44e101337f7c5 2025-09-27 17:18:35,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:18:35,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c471fd44e101337f7c5 HTTP/1.1" 200 None 2025-09-27 17:18:35,799 - lava_callback - DEBUG - Processing node 68d81c471fd44e101337f7c5: baseline-x86 2025-09-27 17:18:35,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:18:36,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:18:36,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c471fd44e101337f7c5/log.txt.gz 2025-09-27 17:18:36,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:18:36,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:18:36,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c471fd44e101337f7c5/lava_callback.json.gz 2025-09-27 17:18:36,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:18:36,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c471fd44e101337f7c5 HTTP/1.1" 200 None 2025-09-27 17:18:36,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:18:36,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f681fd44e101337efbf HTTP/1.1" 200 None 2025-09-27 17:18:36,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:18:36,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81c471fd44e101337f7c5 HTTP/1.1" 200 None 2025-09-27 17:18:36,332 - lava_callback - INFO - Completed processing callback for node 68d81c471fd44e101337f7c5 INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:19:50,563 - lava_callback - INFO - Received callback for node 68d817eb1fd44e101337f730 INFO: 172.21.0.1:40770 - "POST /node/68d817eb1fd44e101337f730 HTTP/1.0" 202 Accepted 2025-09-27 17:19:50,570 - lava_callback - INFO - Starting async job submit for node 68d817eb1fd44e101337f730 2025-09-27 17:19:50,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:19:50,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d817eb1fd44e101337f730 HTTP/1.1" 200 None 2025-09-27 17:19:50,659 - lava_callback - DEBUG - Processing node 68d817eb1fd44e101337f730: ltp-smoketest 2025-09-27 17:19:51,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:19:51,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:19:51,272 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d817eb1fd44e101337f730/log.txt.gz 2025-09-27 17:19:51,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:19:51,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:19:51,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d817eb1fd44e101337f730/lava_callback.json.gz 2025-09-27 17:19:51,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:19:51,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d817eb1fd44e101337f730 HTTP/1.1" 200 None 2025-09-27 17:19:51,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:19:51,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f471fd44e101337efa7 HTTP/1.1" 200 None 2025-09-27 17:19:51,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:19:51,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d817eb1fd44e101337f730 HTTP/1.1" 200 None 2025-09-27 17:19:51,602 - lava_callback - INFO - Completed processing callback for node 68d817eb1fd44e101337f730 2025-09-27 17:19:53,584 - lava_callback - INFO - Received callback for node 68d818571fd44e101337f745 INFO: 172.21.0.1:40786 - "POST /node/68d818571fd44e101337f745 HTTP/1.0" 202 Accepted 2025-09-27 17:19:53,590 - lava_callback - INFO - Starting async job submit for node 68d818571fd44e101337f745 2025-09-27 17:19:53,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:19:53,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d818571fd44e101337f745 HTTP/1.1" 200 None 2025-09-27 17:19:53,642 - lava_callback - DEBUG - Processing node 68d818571fd44e101337f745: baseline-arm 2025-09-27 17:19:53,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:19:54,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:19:54,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d818571fd44e101337f745/log.txt.gz 2025-09-27 17:19:54,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:19:54,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:19:54,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d818571fd44e101337f745/lava_callback.json.gz DEBUG: Setup failed for 68d818571fd44e101337f745. Transitting job node result: incomplete -> fail 2025-09-27 17:19:54,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:19:54,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d818571fd44e101337f745 HTTP/1.1" 200 None 2025-09-27 17:19:54,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:19:54,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 17:19:54,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:19:54,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d818571fd44e101337f745 HTTP/1.1" 200 None 2025-09-27 17:19:54,393 - lava_callback - INFO - Completed processing callback for node 68d818571fd44e101337f745 INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59534 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 17:20:16,090 - lava_callback - INFO - Received callback for node 68d75e0fa6a7b6615d4c4ec2 INFO: 172.21.0.1:59550 - "POST /node/68d75e0fa6a7b6615d4c4ec2 HTTP/1.0" 202 Accepted 2025-09-27 17:20:16,096 - lava_callback - INFO - Starting async job submit for node 68d75e0fa6a7b6615d4c4ec2 2025-09-27 17:20:16,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:20:16,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e0fa6a7b6615d4c4ec2 HTTP/1.1" 200 None 2025-09-27 17:20:16,130 - lava_callback - DEBUG - Processing node 68d75e0fa6a7b6615d4c4ec2: baseline-arm 2025-09-27 17:20:16,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:20:16,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:20:16,495 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e0fa6a7b6615d4c4ec2/log.txt.gz 2025-09-27 17:20:16,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:20:16,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:20:16,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e0fa6a7b6615d4c4ec2/lava_callback.json.gz 2025-09-27 17:20:16,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:20:16,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e0fa6a7b6615d4c4ec2 HTTP/1.1" 200 None 2025-09-27 17:20:16,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:20:16,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:20:16,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:20:16,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e0fa6a7b6615d4c4ec2 HTTP/1.1" 200 None 2025-09-27 17:20:16,717 - lava_callback - INFO - Completed processing callback for node 68d75e0fa6a7b6615d4c4ec2 INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:20:51,369 - lava_callback - INFO - Received callback for node 68d589eb2be2da4660699b85 INFO: 172.21.0.1:37478 - "POST /node/68d589eb2be2da4660699b85 HTTP/1.0" 202 Accepted 2025-09-27 17:20:51,382 - lava_callback - INFO - Starting async job submit for node 68d589eb2be2da4660699b85 2025-09-27 17:20:51,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:20:51,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589eb2be2da4660699b85 HTTP/1.1" 200 None 2025-09-27 17:20:51,770 - lava_callback - DEBUG - Processing node 68d589eb2be2da4660699b85: ltp-controllers 2025-09-27 17:20:54,547 - lava_callback - ERROR - Error processing callback for node 68d589eb2be2da4660699b85: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:21:06,558 - lava_callback - INFO - Received callback for node 68d589e92be2da4660699b82 INFO: 172.21.0.1:58210 - "POST /node/68d589e92be2da4660699b82 HTTP/1.0" 202 Accepted 2025-09-27 17:21:06,565 - lava_callback - INFO - Starting async job submit for node 68d589e92be2da4660699b82 2025-09-27 17:21:06,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:21:06,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589e92be2da4660699b82 HTTP/1.1" 200 None 2025-09-27 17:21:06,616 - lava_callback - DEBUG - Processing node 68d589e92be2da4660699b82: ltp-containers 2025-09-27 17:21:06,993 - lava_callback - ERROR - Error processing callback for node 68d589e92be2da4660699b82: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 17:21:08,818 - lava_callback - INFO - Received callback for node 68d81c161fd44e101337f7b8 INFO: 172.21.0.1:58216 - "POST /node/68d81c161fd44e101337f7b8 HTTP/1.0" 202 Accepted 2025-09-27 17:21:08,823 - lava_callback - INFO - Starting async job submit for node 68d81c161fd44e101337f7b8 2025-09-27 17:21:08,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:21:08,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c161fd44e101337f7b8 HTTP/1.1" 200 None 2025-09-27 17:21:08,854 - lava_callback - DEBUG - Processing node 68d81c161fd44e101337f7b8: baseline-x86 2025-09-27 17:21:09,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:21:09,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:21:09,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c161fd44e101337f7b8/log.txt.gz 2025-09-27 17:21:09,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:21:09,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:21:09,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c161fd44e101337f7b8/lava_callback.json.gz 2025-09-27 17:21:09,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:21:09,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c161fd44e101337f7b8 HTTP/1.1" 200 None 2025-09-27 17:21:09,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:21:09,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f681fd44e101337efbf HTTP/1.1" 200 None 2025-09-27 17:21:09,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:21:09,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81c161fd44e101337f7b8 HTTP/1.1" 200 None 2025-09-27 17:21:09,476 - lava_callback - INFO - Completed processing callback for node 68d81c161fd44e101337f7b8 INFO: 172.21.0.1:33666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 17:23:16,366 - lava_callback - INFO - Received callback for node 68d732e1a6a7b6615d4c45b4 INFO: 172.21.0.1:32954 - "POST /node/68d732e1a6a7b6615d4c45b4 HTTP/1.0" 202 Accepted 2025-09-27 17:23:16,378 - lava_callback - INFO - Starting async job submit for node 68d732e1a6a7b6615d4c45b4 2025-09-27 17:23:16,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:16,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732e1a6a7b6615d4c45b4 HTTP/1.1" 200 None 2025-09-27 17:23:16,442 - lava_callback - DEBUG - Processing node 68d732e1a6a7b6615d4c45b4: baseline-arm64 INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:23:17,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:23:17,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:23:17,821 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732e1a6a7b6615d4c45b4/log.txt.gz 2025-09-27 17:23:17,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:23:18,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:23:18,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732e1a6a7b6615d4c45b4/lava_callback.json.gz DEBUG: Setup failed for 68d732e1a6a7b6615d4c45b4. Transitting job node result: incomplete -> fail 2025-09-27 17:23:18,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:18,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732e1a6a7b6615d4c45b4 HTTP/1.1" 200 None 2025-09-27 17:23:18,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:18,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:23:18,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:18,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732e1a6a7b6615d4c45b4 HTTP/1.1" 200 None 2025-09-27 17:23:18,236 - lava_callback - INFO - Completed processing callback for node 68d732e1a6a7b6615d4c45b4 INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:23:26,613 - lava_callback - INFO - Received callback for node 68d732e2a6a7b6615d4c45b7 INFO: 172.21.0.1:53028 - "POST /node/68d732e2a6a7b6615d4c45b7 HTTP/1.0" 202 Accepted 2025-09-27 17:23:26,625 - lava_callback - INFO - Starting async job submit for node 68d732e2a6a7b6615d4c45b7 2025-09-27 17:23:26,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:26,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732e2a6a7b6615d4c45b7 HTTP/1.1" 200 None 2025-09-27 17:23:26,684 - lava_callback - DEBUG - Processing node 68d732e2a6a7b6615d4c45b7: baseline-arm64 2025-09-27 17:23:27,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:23:28,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:23:28,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732e2a6a7b6615d4c45b7/log.txt.gz 2025-09-27 17:23:28,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:23:28,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:23:28,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732e2a6a7b6615d4c45b7/lava_callback.json.gz DEBUG: Setup failed for 68d732e2a6a7b6615d4c45b7. Transitting job node result: incomplete -> fail 2025-09-27 17:23:28,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:28,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732e2a6a7b6615d4c45b7 HTTP/1.1" 200 None 2025-09-27 17:23:28,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:28,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:23:28,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:28,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732e2a6a7b6615d4c45b7 HTTP/1.1" 200 None 2025-09-27 17:23:28,476 - lava_callback - INFO - Completed processing callback for node 68d732e2a6a7b6615d4c45b7 2025-09-27 17:23:29,030 - lava_callback - INFO - Received callback for node 68d75e0fa6a7b6615d4c4ec5 INFO: 172.21.0.1:53034 - "POST /node/68d75e0fa6a7b6615d4c4ec5 HTTP/1.0" 202 Accepted 2025-09-27 17:23:29,037 - lava_callback - INFO - Starting async job submit for node 68d75e0fa6a7b6615d4c4ec5 2025-09-27 17:23:29,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:29,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e0fa6a7b6615d4c4ec5 HTTP/1.1" 200 None 2025-09-27 17:23:29,099 - lava_callback - DEBUG - Processing node 68d75e0fa6a7b6615d4c4ec5: baseline-arm 2025-09-27 17:23:29,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:23:29,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:23:29,563 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e0fa6a7b6615d4c4ec5/log.txt.gz 2025-09-27 17:23:29,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:23:29,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:23:29,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e0fa6a7b6615d4c4ec5/lava_callback.json.gz 2025-09-27 17:23:29,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:29,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e0fa6a7b6615d4c4ec5 HTTP/1.1" 200 None 2025-09-27 17:23:29,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:29,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:23:29,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:29,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e0fa6a7b6615d4c4ec5 HTTP/1.1" 200 None 2025-09-27 17:23:29,816 - lava_callback - INFO - Completed processing callback for node 68d75e0fa6a7b6615d4c4ec5 INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:23:46,908 - lava_callback - INFO - Received callback for node 68d732e6a6a7b6615d4c45ba INFO: 172.21.0.1:60070 - "POST /node/68d732e6a6a7b6615d4c45ba HTTP/1.0" 202 Accepted 2025-09-27 17:23:46,916 - lava_callback - INFO - Starting async job submit for node 68d732e6a6a7b6615d4c45ba 2025-09-27 17:23:46,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:46,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732e6a6a7b6615d4c45ba HTTP/1.1" 200 None 2025-09-27 17:23:46,990 - lava_callback - DEBUG - Processing node 68d732e6a6a7b6615d4c45ba: baseline-arm64 2025-09-27 17:23:48,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:23:48,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:23:48,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732e6a6a7b6615d4c45ba/log.txt.gz 2025-09-27 17:23:48,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:23:48,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:23:48,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732e6a6a7b6615d4c45ba/lava_callback.json.gz DEBUG: Setup failed for 68d732e6a6a7b6615d4c45ba. Transitting job node result: incomplete -> fail 2025-09-27 17:23:48,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:48,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732e6a6a7b6615d4c45ba HTTP/1.1" 200 None 2025-09-27 17:23:48,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:48,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:23:48,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:23:48,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732e6a6a7b6615d4c45ba HTTP/1.1" 200 None 2025-09-27 17:23:48,660 - lava_callback - INFO - Completed processing callback for node 68d732e6a6a7b6615d4c45ba INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:25:14,177 - lava_callback - INFO - Received callback for node 68d819361fd44e101337f767 INFO: 172.21.0.1:50680 - "POST /node/68d819361fd44e101337f767 HTTP/1.0" 202 Accepted 2025-09-27 17:25:14,183 - lava_callback - INFO - Starting async job submit for node 68d819361fd44e101337f767 2025-09-27 17:25:14,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:14,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d819361fd44e101337f767 HTTP/1.1" 200 None 2025-09-27 17:25:14,246 - lava_callback - DEBUG - Processing node 68d819361fd44e101337f767: baseline-x86-kcidebug-intel 2025-09-27 17:25:14,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:25:14,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:25:14,624 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d819361fd44e101337f767/log.txt.gz 2025-09-27 17:25:14,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:25:14,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:25:14,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d819361fd44e101337f767/lava_callback.json.gz DEBUG: Setup failed for 68d819361fd44e101337f767. Transitting job node result: incomplete -> fail 2025-09-27 17:25:14,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:14,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d819361fd44e101337f767 HTTP/1.1" 200 None 2025-09-27 17:25:14,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:14,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b758dd6b39fd1aeb993 HTTP/1.1" 200 None 2025-09-27 17:25:14,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:14,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d819361fd44e101337f767 HTTP/1.1" 200 None 2025-09-27 17:25:14,887 - lava_callback - INFO - Completed processing callback for node 68d819361fd44e101337f767 INFO: 172.21.0.1:50692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:25:26,795 - lava_callback - INFO - Received callback for node 68d589f22be2da4660699b91 INFO: 172.21.0.1:33470 - "POST /node/68d589f22be2da4660699b91 HTTP/1.0" 202 Accepted 2025-09-27 17:25:26,802 - lava_callback - INFO - Starting async job submit for node 68d589f22be2da4660699b91 2025-09-27 17:25:26,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:26,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589f22be2da4660699b91 HTTP/1.1" 200 None 2025-09-27 17:25:26,841 - lava_callback - DEBUG - Processing node 68d589f22be2da4660699b91: ltp-fsx 2025-09-27 17:25:27,197 - lava_callback - ERROR - Error processing callback for node 68d589f22be2da4660699b91: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:25:55,387 - lava_callback - INFO - Received callback for node 68d75e11a6a7b6615d4c4ec8 INFO: 172.21.0.1:49744 - "POST /node/68d75e11a6a7b6615d4c4ec8 HTTP/1.0" 202 Accepted 2025-09-27 17:25:55,393 - lava_callback - INFO - Starting async job submit for node 68d75e11a6a7b6615d4c4ec8 2025-09-27 17:25:55,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:55,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e11a6a7b6615d4c4ec8 HTTP/1.1" 200 None 2025-09-27 17:25:55,446 - lava_callback - DEBUG - Processing node 68d75e11a6a7b6615d4c4ec8: baseline-arm 2025-09-27 17:25:55,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:25:55,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:25:55,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e11a6a7b6615d4c4ec8/log.txt.gz 2025-09-27 17:25:55,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:25:55,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:25:55,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e11a6a7b6615d4c4ec8/lava_callback.json.gz 2025-09-27 17:25:55,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:55,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e11a6a7b6615d4c4ec8 HTTP/1.1" 200 None 2025-09-27 17:25:55,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:55,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:25:55,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:25:56,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e11a6a7b6615d4c4ec8 HTTP/1.1" 200 None 2025-09-27 17:25:56,014 - lava_callback - INFO - Completed processing callback for node 68d75e11a6a7b6615d4c4ec8 INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:26:42,770 - lava_callback - INFO - Received callback for node 68d81c481fd44e101337f7c8 INFO: 172.21.0.1:52632 - "POST /node/68d81c481fd44e101337f7c8 HTTP/1.0" 202 Accepted 2025-09-27 17:26:42,779 - lava_callback - INFO - Starting async job submit for node 68d81c481fd44e101337f7c8 2025-09-27 17:26:42,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:26:42,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c481fd44e101337f7c8 HTTP/1.1" 200 None 2025-09-27 17:26:42,835 - lava_callback - DEBUG - Processing node 68d81c481fd44e101337f7c8: baseline-x86 2025-09-27 17:26:43,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:26:43,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:26:43,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c481fd44e101337f7c8/log.txt.gz 2025-09-27 17:26:43,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:26:43,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:26:43,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c481fd44e101337f7c8/lava_callback.json.gz 2025-09-27 17:26:43,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:26:43,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c481fd44e101337f7c8 HTTP/1.1" 200 None 2025-09-27 17:26:43,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:26:43,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f681fd44e101337efbf HTTP/1.1" 200 None 2025-09-27 17:26:43,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:26:43,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81c481fd44e101337f7c8 HTTP/1.1" 200 None 2025-09-27 17:26:43,850 - lava_callback - INFO - Completed processing callback for node 68d81c481fd44e101337f7c8 INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:26:47,040 - lava_callback - INFO - Received callback for node 68d589ed2be2da4660699b88 INFO: 172.21.0.1:52646 - "POST /node/68d589ed2be2da4660699b88 HTTP/1.0" 202 Accepted 2025-09-27 17:26:47,053 - lava_callback - INFO - Starting async job submit for node 68d589ed2be2da4660699b88 2025-09-27 17:26:47,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:26:47,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589ed2be2da4660699b88 HTTP/1.1" 200 None 2025-09-27 17:26:47,248 - lava_callback - DEBUG - Processing node 68d589ed2be2da4660699b88: ltp-cve 2025-09-27 17:26:48,344 - lava_callback - ERROR - Error processing callback for node 68d589ed2be2da4660699b88: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:28:10,446 - lava_callback - INFO - Received callback for node 68d589f02be2da4660699b8e INFO: 172.21.0.1:43752 - "POST /node/68d589f02be2da4660699b8e HTTP/1.0" 202 Accepted 2025-09-27 17:28:10,453 - lava_callback - INFO - Starting async job submit for node 68d589f02be2da4660699b8e 2025-09-27 17:28:10,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:10,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589f02be2da4660699b8e HTTP/1.1" 200 None 2025-09-27 17:28:10,599 - lava_callback - DEBUG - Processing node 68d589f02be2da4660699b8e: ltp-fs-bind 2025-09-27 17:28:11,136 - lava_callback - ERROR - Error processing callback for node 68d589f02be2da4660699b8e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 17:28:14,794 - lava_callback - INFO - Received callback for node 68d81bbb1fd44e101337f7b3 INFO: 172.21.0.1:43758 - "POST /node/68d81bbb1fd44e101337f7b3 HTTP/1.0" 202 Accepted 2025-09-27 17:28:14,840 - lava_callback - INFO - Starting async job submit for node 68d81bbb1fd44e101337f7b3 2025-09-27 17:28:14,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:14,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81bbb1fd44e101337f7b3 HTTP/1.1" 200 None 2025-09-27 17:28:14,909 - lava_callback - DEBUG - Processing node 68d81bbb1fd44e101337f7b3: baseline-x86 2025-09-27 17:28:15,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:28:15,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:28:15,156 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d81bbb1fd44e101337f7b3/log.txt.gz 2025-09-27 17:28:15,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43760 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 17:28:15,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:28:15,331 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d81bbb1fd44e101337f7b3/lava_callback.json.gz 2025-09-27 17:28:15,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:15,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81bbb1fd44e101337f7b3 HTTP/1.1" 200 None 2025-09-27 17:28:15,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:15,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b728dd6b39fd1aeb990 HTTP/1.1" 200 None 2025-09-27 17:28:15,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:15,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81bbb1fd44e101337f7b3 HTTP/1.1" 200 None 2025-09-27 17:28:15,433 - lava_callback - INFO - Completed processing callback for node 68d81bbb1fd44e101337f7b3 2025-09-27 17:28:16,020 - lava_callback - INFO - Received callback for node 68d75e11a6a7b6615d4c4ecb INFO: 172.21.0.1:43766 - "POST /node/68d75e11a6a7b6615d4c4ecb HTTP/1.0" 202 Accepted 2025-09-27 17:28:16,028 - lava_callback - INFO - Starting async job submit for node 68d75e11a6a7b6615d4c4ecb 2025-09-27 17:28:16,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:16,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e11a6a7b6615d4c4ecb HTTP/1.1" 200 None 2025-09-27 17:28:16,066 - lava_callback - DEBUG - Processing node 68d75e11a6a7b6615d4c4ecb: baseline-arm 2025-09-27 17:28:16,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:28:16,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:28:16,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e11a6a7b6615d4c4ecb/log.txt.gz 2025-09-27 17:28:16,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:28:16,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:28:16,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e11a6a7b6615d4c4ecb/lava_callback.json.gz 2025-09-27 17:28:16,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:16,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e11a6a7b6615d4c4ecb HTTP/1.1" 200 None 2025-09-27 17:28:16,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:16,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:28:16,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:28:16,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e11a6a7b6615d4c4ecb HTTP/1.1" 200 None 2025-09-27 17:28:16,671 - lava_callback - INFO - Completed processing callback for node 68d75e11a6a7b6615d4c4ecb INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:29:46,975 - lava_callback - INFO - Received callback for node 68d589f32be2da4660699b94 INFO: 172.21.0.1:46572 - "POST /node/68d589f32be2da4660699b94 HTTP/1.0" 202 Accepted 2025-09-27 17:29:46,987 - lava_callback - INFO - Starting async job submit for node 68d589f32be2da4660699b94 2025-09-27 17:29:47,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:29:47,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589f32be2da4660699b94 HTTP/1.1" 200 None 2025-09-27 17:29:47,056 - lava_callback - DEBUG - Processing node 68d589f32be2da4660699b94: ltp-input 2025-09-27 17:29:47,704 - lava_callback - ERROR - Error processing callback for node 68d589f32be2da4660699b94: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:30:31,806 - lava_callback - INFO - Received callback for node 68d75e13a6a7b6615d4c4ece INFO: 172.21.0.1:38644 - "POST /node/68d75e13a6a7b6615d4c4ece HTTP/1.0" 202 Accepted 2025-09-27 17:30:31,812 - lava_callback - INFO - Starting async job submit for node 68d75e13a6a7b6615d4c4ece 2025-09-27 17:30:31,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:30:31,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e13a6a7b6615d4c4ece HTTP/1.1" 200 None 2025-09-27 17:30:31,856 - lava_callback - DEBUG - Processing node 68d75e13a6a7b6615d4c4ece: baseline-arm 2025-09-27 17:30:32,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:30:32,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:30:32,243 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e13a6a7b6615d4c4ece/log.txt.gz 2025-09-27 17:30:32,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:30:32,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:30:32,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e13a6a7b6615d4c4ece/lava_callback.json.gz 2025-09-27 17:30:32,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:30:32,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e13a6a7b6615d4c4ece HTTP/1.1" 200 None 2025-09-27 17:30:32,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:30:32,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:30:32,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:30:32,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e13a6a7b6615d4c4ece HTTP/1.1" 200 None 2025-09-27 17:30:32,498 - lava_callback - INFO - Completed processing callback for node 68d75e13a6a7b6615d4c4ece INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:31:06,993 - lava_callback - INFO - Received callback for node 68d589f52be2da4660699b97 INFO: 172.21.0.1:40648 - "POST /node/68d589f52be2da4660699b97 HTTP/1.0" 202 Accepted 2025-09-27 17:31:07,000 - lava_callback - INFO - Starting async job submit for node 68d589f52be2da4660699b97 2025-09-27 17:31:07,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:31:07,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589f52be2da4660699b97 HTTP/1.1" 200 None 2025-09-27 17:31:07,044 - lava_callback - DEBUG - Processing node 68d589f52be2da4660699b97: ltp-ipc 2025-09-27 17:31:07,389 - lava_callback - ERROR - Error processing callback for node 68d589f52be2da4660699b97: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:32:11,528 - lava_callback - INFO - Received callback for node 68d81b3e1fd44e101337f7a5 INFO: 172.21.0.1:51910 - "POST /node/68d81b3e1fd44e101337f7a5 HTTP/1.0" 202 Accepted 2025-09-27 17:32:11,535 - lava_callback - INFO - Starting async job submit for node 68d81b3e1fd44e101337f7a5 2025-09-27 17:32:11,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:32:11,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81b3e1fd44e101337f7a5 HTTP/1.1" 200 None 2025-09-27 17:32:11,578 - lava_callback - DEBUG - Processing node 68d81b3e1fd44e101337f7a5: baseline-arm 2025-09-27 17:32:11,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:32:12,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:32:12,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d81b3e1fd44e101337f7a5/log.txt.gz 2025-09-27 17:32:12,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:32:12,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:32:12,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d81b3e1fd44e101337f7a5/lava_callback.json.gz DEBUG: Setup failed for 68d81b3e1fd44e101337f7a5. Transitting job node result: incomplete -> fail 2025-09-27 17:32:12,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:32:12,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81b3e1fd44e101337f7a5 HTTP/1.1" 200 None 2025-09-27 17:32:12,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:32:12,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 17:32:12,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:32:12,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81b3e1fd44e101337f7a5 HTTP/1.1" 200 None 2025-09-27 17:32:12,324 - lava_callback - INFO - Completed processing callback for node 68d81b3e1fd44e101337f7a5 INFO: 172.21.0.1:51916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:32:58,297 - lava_callback - INFO - Received callback for node 68d75e13a6a7b6615d4c4ed1 INFO: 172.21.0.1:53156 - "POST /node/68d75e13a6a7b6615d4c4ed1 HTTP/1.0" 202 Accepted 2025-09-27 17:32:58,304 - lava_callback - INFO - Starting async job submit for node 68d75e13a6a7b6615d4c4ed1 2025-09-27 17:32:58,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:32:58,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e13a6a7b6615d4c4ed1 HTTP/1.1" 200 None 2025-09-27 17:32:58,353 - lava_callback - DEBUG - Processing node 68d75e13a6a7b6615d4c4ed1: baseline-arm 2025-09-27 17:32:58,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:32:58,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:32:58,732 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e13a6a7b6615d4c4ed1/log.txt.gz 2025-09-27 17:32:58,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:32:58,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:32:58,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e13a6a7b6615d4c4ed1/lava_callback.json.gz 2025-09-27 17:32:58,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:32:58,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e13a6a7b6615d4c4ed1 HTTP/1.1" 200 None 2025-09-27 17:32:58,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:32:58,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:32:58,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:32:58,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e13a6a7b6615d4c4ed1 HTTP/1.1" 200 None 2025-09-27 17:32:58,969 - lava_callback - INFO - Completed processing callback for node 68d75e13a6a7b6615d4c4ed1 INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:34:02,566 - lava_callback - INFO - Received callback for node 68d589672be2da4660699aaa INFO: 172.21.0.1:33840 - "POST /node/68d589672be2da4660699aaa HTTP/1.0" 202 Accepted 2025-09-27 17:34:02,573 - lava_callback - INFO - Starting async job submit for node 68d589672be2da4660699aaa 2025-09-27 17:34:02,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:34:02,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589672be2da4660699aaa HTTP/1.1" 200 None 2025-09-27 17:34:02,630 - lava_callback - DEBUG - Processing node 68d589672be2da4660699aaa: baseline-arm 2025-09-27 17:34:02,905 - lava_callback - ERROR - Error processing callback for node 68d589672be2da4660699aaa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36482 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:35:11,413 - lava_callback - INFO - Received callback for node 68d75e52a6a7b6615d4c4f04 INFO: 172.21.0.1:38014 - "POST /node/68d75e52a6a7b6615d4c4f04 HTTP/1.0" 202 Accepted 2025-09-27 17:35:11,419 - lava_callback - INFO - Starting async job submit for node 68d75e52a6a7b6615d4c4f04 2025-09-27 17:35:11,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:35:11,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e52a6a7b6615d4c4f04 HTTP/1.1" 200 None 2025-09-27 17:35:11,452 - lava_callback - DEBUG - Processing node 68d75e52a6a7b6615d4c4f04: baseline-arm 2025-09-27 17:35:11,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:35:11,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:35:11,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e52a6a7b6615d4c4f04/log.txt.gz 2025-09-27 17:35:11,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:35:12,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:35:12,001 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e52a6a7b6615d4c4f04/lava_callback.json.gz 2025-09-27 17:35:12,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:35:12,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e52a6a7b6615d4c4f04 HTTP/1.1" 200 None 2025-09-27 17:35:12,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:35:12,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:35:12,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:35:12,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e52a6a7b6615d4c4f04 HTTP/1.1" 200 None 2025-09-27 17:35:12,104 - lava_callback - INFO - Completed processing callback for node 68d75e52a6a7b6615d4c4f04 INFO: 172.21.0.1:38026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52822 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:35:56,049 - lava_callback - INFO - Received callback for node 68d81c361fd44e101337f7be INFO: 172.21.0.1:53758 - "POST /node/68d81c361fd44e101337f7be HTTP/1.0" 202 Accepted 2025-09-27 17:35:56,056 - lava_callback - INFO - Starting async job submit for node 68d81c361fd44e101337f7be 2025-09-27 17:35:56,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:35:56,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c361fd44e101337f7be HTTP/1.1" 200 None 2025-09-27 17:35:56,119 - lava_callback - DEBUG - Processing node 68d81c361fd44e101337f7be: baseline-x86 INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:35:56,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:35:56,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:35:56,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c361fd44e101337f7be/log.txt.gz 2025-09-27 17:35:56,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:35:57,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:35:57,079 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c361fd44e101337f7be/lava_callback.json.gz DEBUG: Setup failed for 68d81c361fd44e101337f7be. Transitting job node result: incomplete -> fail 2025-09-27 17:35:57,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:35:57,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c361fd44e101337f7be HTTP/1.1" 200 None 2025-09-27 17:35:57,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:35:57,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f681fd44e101337efbf HTTP/1.1" 200 None 2025-09-27 17:35:57,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:35:57,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81c361fd44e101337f7be HTTP/1.1" 200 None 2025-09-27 17:35:57,219 - lava_callback - INFO - Completed processing callback for node 68d81c361fd44e101337f7be INFO: 172.21.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:37:30,723 - lava_callback - INFO - Received callback for node 68d81cb71fd44e101337f7df INFO: 172.21.0.1:37598 - "POST /node/68d81cb71fd44e101337f7df HTTP/1.0" 202 Accepted 2025-09-27 17:37:30,730 - lava_callback - INFO - Starting async job submit for node 68d81cb71fd44e101337f7df 2025-09-27 17:37:30,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:30,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81cb71fd44e101337f7df HTTP/1.1" 200 None 2025-09-27 17:37:30,894 - lava_callback - DEBUG - Processing node 68d81cb71fd44e101337f7df: ltp-smoketest 2025-09-27 17:37:31,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:37:31,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:37:31,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d81cb71fd44e101337f7df/log.txt.gz 2025-09-27 17:37:31,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:37:31,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:37:31,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d81cb71fd44e101337f7df/lava_callback.json.gz 2025-09-27 17:37:31,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:31,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81cb71fd44e101337f7df HTTP/1.1" 200 None 2025-09-27 17:37:31,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:31,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f471fd44e101337efa7 HTTP/1.1" 200 None 2025-09-27 17:37:31,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:31,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81cb71fd44e101337f7df HTTP/1.1" 200 None 2025-09-27 17:37:31,843 - lava_callback - INFO - Completed processing callback for node 68d81cb71fd44e101337f7df 2025-09-27 17:37:36,046 - lava_callback - INFO - Received callback for node 68d75e52a6a7b6615d4c4f07 INFO: 172.21.0.1:37606 - "POST /node/68d75e52a6a7b6615d4c4f07 HTTP/1.0" 202 Accepted 2025-09-27 17:37:36,052 - lava_callback - INFO - Starting async job submit for node 68d75e52a6a7b6615d4c4f07 2025-09-27 17:37:36,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:36,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e52a6a7b6615d4c4f07 HTTP/1.1" 200 None 2025-09-27 17:37:36,086 - lava_callback - DEBUG - Processing node 68d75e52a6a7b6615d4c4f07: baseline-arm 2025-09-27 17:37:36,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:37:36,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:37:36,446 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e52a6a7b6615d4c4f07/log.txt.gz 2025-09-27 17:37:36,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:37:36,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:37:36,621 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e52a6a7b6615d4c4f07/lava_callback.json.gz 2025-09-27 17:37:36,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:36,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e52a6a7b6615d4c4f07 HTTP/1.1" 200 None 2025-09-27 17:37:36,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:36,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:37:36,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:36,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e52a6a7b6615d4c4f07 HTTP/1.1" 200 None 2025-09-27 17:37:36,708 - lava_callback - INFO - Completed processing callback for node 68d75e52a6a7b6615d4c4f07 INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:37:51,093 - lava_callback - INFO - Received callback for node 68d589f72be2da4660699b9a INFO: 172.21.0.1:53626 - "POST /node/68d589f72be2da4660699b9a HTTP/1.0" 202 Accepted 2025-09-27 17:37:51,100 - lava_callback - INFO - Starting async job submit for node 68d589f72be2da4660699b9a 2025-09-27 17:37:51,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:37:51,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589f72be2da4660699b9a HTTP/1.1" 200 None 2025-09-27 17:37:51,184 - lava_callback - DEBUG - Processing node 68d589f72be2da4660699b9a: ltp-pty 2025-09-27 17:37:51,585 - lava_callback - ERROR - Error processing callback for node 68d589f72be2da4660699b9a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:38:07,184 - lava_callback - INFO - Received callback for node 68d589f82be2da4660699b9d INFO: 172.21.0.1:52668 - "POST /node/68d589f82be2da4660699b9d HTTP/1.0" 202 Accepted 2025-09-27 17:38:07,192 - lava_callback - INFO - Starting async job submit for node 68d589f82be2da4660699b9d 2025-09-27 17:38:07,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:38:07,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589f82be2da4660699b9d HTTP/1.1" 200 None 2025-09-27 17:38:07,238 - lava_callback - DEBUG - Processing node 68d589f82be2da4660699b9d: ltp-sched 2025-09-27 17:38:07,751 - lava_callback - ERROR - Error processing callback for node 68d589f82be2da4660699b9d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:38:31,686 - lava_callback - INFO - Received callback for node 68d81cba1fd44e101337f7e5 INFO: 172.21.0.1:59592 - "POST /node/68d81cba1fd44e101337f7e5 HTTP/1.0" 202 Accepted 2025-09-27 17:38:31,692 - lava_callback - INFO - Starting async job submit for node 68d81cba1fd44e101337f7e5 2025-09-27 17:38:31,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:38:31,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81cba1fd44e101337f7e5 HTTP/1.1" 200 None 2025-09-27 17:38:31,747 - lava_callback - DEBUG - Processing node 68d81cba1fd44e101337f7e5: baseline-arm 2025-09-27 17:38:32,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:38:32,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:38:32,206 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d81cba1fd44e101337f7e5/log.txt.gz 2025-09-27 17:38:32,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:38:32,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:38:32,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d81cba1fd44e101337f7e5/lava_callback.json.gz DEBUG: Setup failed for 68d81cba1fd44e101337f7e5. Transitting job node result: incomplete -> fail 2025-09-27 17:38:32,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:38:32,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81cba1fd44e101337f7e5 HTTP/1.1" 200 None 2025-09-27 17:38:32,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:38:32,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 17:38:32,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:38:32,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81cba1fd44e101337f7e5 HTTP/1.1" 200 None 2025-09-27 17:38:32,595 - lava_callback - INFO - Completed processing callback for node 68d81cba1fd44e101337f7e5 INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:39:59,255 - lava_callback - INFO - Received callback for node 68d75e54a6a7b6615d4c4f0a INFO: 172.21.0.1:56232 - "POST /node/68d75e54a6a7b6615d4c4f0a HTTP/1.0" 202 Accepted 2025-09-27 17:39:59,261 - lava_callback - INFO - Starting async job submit for node 68d75e54a6a7b6615d4c4f0a 2025-09-27 17:39:59,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:39:59,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e54a6a7b6615d4c4f0a HTTP/1.1" 200 None 2025-09-27 17:39:59,296 - lava_callback - DEBUG - Processing node 68d75e54a6a7b6615d4c4f0a: baseline-arm 2025-09-27 17:39:59,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:39:59,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:39:59,696 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e54a6a7b6615d4c4f0a/log.txt.gz 2025-09-27 17:39:59,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:39:59,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:39:59,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e54a6a7b6615d4c4f0a/lava_callback.json.gz 2025-09-27 17:39:59,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:39:59,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e54a6a7b6615d4c4f0a HTTP/1.1" 200 None 2025-09-27 17:39:59,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:39:59,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:39:59,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:39:59,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e54a6a7b6615d4c4f0a HTTP/1.1" 200 None 2025-09-27 17:39:59,922 - lava_callback - INFO - Completed processing callback for node 68d75e54a6a7b6615d4c4f0a INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:42:14,177 - lava_callback - INFO - Received callback for node 68d75e54a6a7b6615d4c4f0d INFO: 172.21.0.1:44734 - "POST /node/68d75e54a6a7b6615d4c4f0d HTTP/1.0" 202 Accepted 2025-09-27 17:42:14,183 - lava_callback - INFO - Starting async job submit for node 68d75e54a6a7b6615d4c4f0d 2025-09-27 17:42:14,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:42:14,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e54a6a7b6615d4c4f0d HTTP/1.1" 200 None 2025-09-27 17:42:14,223 - lava_callback - DEBUG - Processing node 68d75e54a6a7b6615d4c4f0d: baseline-arm 2025-09-27 17:42:14,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:42:14,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:42:14,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e54a6a7b6615d4c4f0d/log.txt.gz 2025-09-27 17:42:14,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:42:14,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:42:14,787 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e54a6a7b6615d4c4f0d/lava_callback.json.gz 2025-09-27 17:42:14,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:42:14,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e54a6a7b6615d4c4f0d HTTP/1.1" 200 None 2025-09-27 17:42:14,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:42:14,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:42:14,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:42:14,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e54a6a7b6615d4c4f0d HTTP/1.1" 200 None 2025-09-27 17:42:14,882 - lava_callback - INFO - Completed processing callback for node 68d75e54a6a7b6615d4c4f0d INFO: 172.21.0.1:44748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:43:37,106 - lava_callback - INFO - Received callback for node 68d732e6a6a7b6615d4c45bd INFO: 172.21.0.1:46602 - "POST /node/68d732e6a6a7b6615d4c45bd HTTP/1.0" 202 Accepted 2025-09-27 17:43:37,113 - lava_callback - INFO - Starting async job submit for node 68d732e6a6a7b6615d4c45bd 2025-09-27 17:43:37,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:43:37,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732e6a6a7b6615d4c45bd HTTP/1.1" 200 None 2025-09-27 17:43:37,173 - lava_callback - DEBUG - Processing node 68d732e6a6a7b6615d4c45bd: baseline-arm64 2025-09-27 17:43:38,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:43:38,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:43:38,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732e6a6a7b6615d4c45bd/log.txt.gz 2025-09-27 17:43:38,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:43:38,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:43:38,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732e6a6a7b6615d4c45bd/lava_callback.json.gz DEBUG: Setup failed for 68d732e6a6a7b6615d4c45bd. Transitting job node result: incomplete -> fail 2025-09-27 17:43:38,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:43:38,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732e6a6a7b6615d4c45bd HTTP/1.1" 200 None 2025-09-27 17:43:38,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:43:38,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:43:38,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:43:38,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732e6a6a7b6615d4c45bd HTTP/1.1" 200 None 2025-09-27 17:43:38,538 - lava_callback - INFO - Completed processing callback for node 68d732e6a6a7b6615d4c45bd INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39644 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:44:06,921 - lava_callback - INFO - Received callback for node 68d732eaa6a7b6615d4c45c0 INFO: 172.21.0.1:39660 - "POST /node/68d732eaa6a7b6615d4c45c0 HTTP/1.0" 202 Accepted 2025-09-27 17:44:06,928 - lava_callback - INFO - Starting async job submit for node 68d732eaa6a7b6615d4c45c0 2025-09-27 17:44:06,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:06,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732eaa6a7b6615d4c45c0 HTTP/1.1" 200 None 2025-09-27 17:44:06,982 - lava_callback - DEBUG - Processing node 68d732eaa6a7b6615d4c45c0: baseline-arm64 2025-09-27 17:44:07,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:44:07,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:44:07,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732eaa6a7b6615d4c45c0/log.txt.gz 2025-09-27 17:44:07,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:44:08,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:44:08,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732eaa6a7b6615d4c45c0/lava_callback.json.gz DEBUG: Setup failed for 68d732eaa6a7b6615d4c45c0. Transitting job node result: incomplete -> fail 2025-09-27 17:44:08,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:08,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732eaa6a7b6615d4c45c0 HTTP/1.1" 200 None 2025-09-27 17:44:08,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:08,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:44:08,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:08,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732eaa6a7b6615d4c45c0 HTTP/1.1" 200 None 2025-09-27 17:44:08,304 - lava_callback - INFO - Completed processing callback for node 68d732eaa6a7b6615d4c45c0 INFO: 172.21.0.1:48548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48370 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:44:27,615 - lava_callback - INFO - Received callback for node 68d732eba6a7b6615d4c45c3 INFO: 172.21.0.1:48372 - "POST /node/68d732eba6a7b6615d4c45c3 HTTP/1.0" 202 Accepted 2025-09-27 17:44:27,622 - lava_callback - INFO - Starting async job submit for node 68d732eba6a7b6615d4c45c3 2025-09-27 17:44:27,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:27,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732eba6a7b6615d4c45c3 HTTP/1.1" 200 None 2025-09-27 17:44:27,676 - lava_callback - DEBUG - Processing node 68d732eba6a7b6615d4c45c3: baseline-arm64 2025-09-27 17:44:28,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:44:28,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:44:28,700 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732eba6a7b6615d4c45c3/log.txt.gz 2025-09-27 17:44:28,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:44:28,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:44:28,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732eba6a7b6615d4c45c3/lava_callback.json.gz DEBUG: Setup failed for 68d732eba6a7b6615d4c45c3. Transitting job node result: incomplete -> fail 2025-09-27 17:44:28,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:28,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732eba6a7b6615d4c45c3 HTTP/1.1" 200 None 2025-09-27 17:44:28,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:29,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:44:29,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:29,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732eba6a7b6615d4c45c3 HTTP/1.1" 200 None 2025-09-27 17:44:29,028 - lava_callback - INFO - Completed processing callback for node 68d732eba6a7b6615d4c45c3 INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:44:38,783 - lava_callback - INFO - Received callback for node 68d75e56a6a7b6615d4c4f10 INFO: 172.21.0.1:46824 - "POST /node/68d75e56a6a7b6615d4c4f10 HTTP/1.0" 202 Accepted 2025-09-27 17:44:38,789 - lava_callback - INFO - Starting async job submit for node 68d75e56a6a7b6615d4c4f10 2025-09-27 17:44:38,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:38,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e56a6a7b6615d4c4f10 HTTP/1.1" 200 None 2025-09-27 17:44:38,846 - lava_callback - DEBUG - Processing node 68d75e56a6a7b6615d4c4f10: baseline-arm 2025-09-27 17:44:39,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:44:39,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:44:39,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e56a6a7b6615d4c4f10/log.txt.gz 2025-09-27 17:44:39,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:44:39,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:44:39,368 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e56a6a7b6615d4c4f10/lava_callback.json.gz 2025-09-27 17:44:39,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:39,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e56a6a7b6615d4c4f10 HTTP/1.1" 200 None 2025-09-27 17:44:39,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:39,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:44:39,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:44:39,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e56a6a7b6615d4c4f10 HTTP/1.1" 200 None 2025-09-27 17:44:39,461 - lava_callback - INFO - Completed processing callback for node 68d75e56a6a7b6615d4c4f10 INFO: 172.21.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:46:52,395 - lava_callback - INFO - Received callback for node 68d81dfb1fd44e101337f800 INFO: 172.21.0.1:59644 - "POST /node/68d81dfb1fd44e101337f800 HTTP/1.0" 202 Accepted 2025-09-27 17:46:52,400 - lava_callback - INFO - Starting async job submit for node 68d81dfb1fd44e101337f800 2025-09-27 17:46:52,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:46:52,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81dfb1fd44e101337f800 HTTP/1.1" 200 None 2025-09-27 17:46:52,471 - lava_callback - DEBUG - Processing node 68d81dfb1fd44e101337f800: baseline-x86-kcidebug-intel 2025-09-27 17:46:52,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:46:52,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:46:52,877 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d81dfb1fd44e101337f800/log.txt.gz 2025-09-27 17:46:52,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:46:53,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:46:53,030 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d81dfb1fd44e101337f800/lava_callback.json.gz DEBUG: Setup failed for 68d81dfb1fd44e101337f800. Transitting job node result: incomplete -> fail 2025-09-27 17:46:53,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:46:53,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81dfb1fd44e101337f800 HTTP/1.1" 200 None 2025-09-27 17:46:53,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:46:53,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b758dd6b39fd1aeb993 HTTP/1.1" 200 None 2025-09-27 17:46:53,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:46:53,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81dfb1fd44e101337f800 HTTP/1.1" 200 None 2025-09-27 17:46:53,146 - lava_callback - INFO - Completed processing callback for node 68d81dfb1fd44e101337f800 2025-09-27 17:46:56,385 - lava_callback - INFO - Received callback for node 68d75e56a6a7b6615d4c4f13 INFO: 172.21.0.1:59646 - "POST /node/68d75e56a6a7b6615d4c4f13 HTTP/1.0" 202 Accepted 2025-09-27 17:46:56,391 - lava_callback - INFO - Starting async job submit for node 68d75e56a6a7b6615d4c4f13 2025-09-27 17:46:56,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:46:56,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e56a6a7b6615d4c4f13 HTTP/1.1" 200 None 2025-09-27 17:46:56,425 - lava_callback - DEBUG - Processing node 68d75e56a6a7b6615d4c4f13: baseline-arm INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:46:56,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:46:56,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:46:56,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e56a6a7b6615d4c4f13/log.txt.gz 2025-09-27 17:46:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:46:56,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:46:56,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e56a6a7b6615d4c4f13/lava_callback.json.gz 2025-09-27 17:46:56,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:46:56,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e56a6a7b6615d4c4f13 HTTP/1.1" 200 None 2025-09-27 17:46:56,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:46:56,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:46:56,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:46:57,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e56a6a7b6615d4c4f13 HTTP/1.1" 200 None 2025-09-27 17:46:57,010 - lava_callback - INFO - Completed processing callback for node 68d75e56a6a7b6615d4c4f13 INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 17:49:16,129 - lava_callback - INFO - Received callback for node 68d75e58a6a7b6615d4c4f16 INFO: 172.21.0.1:48372 - "POST /node/68d75e58a6a7b6615d4c4f16 HTTP/1.0" 202 Accepted 2025-09-27 17:49:16,140 - lava_callback - INFO - Starting async job submit for node 68d75e58a6a7b6615d4c4f16 2025-09-27 17:49:16,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:16,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e58a6a7b6615d4c4f16 HTTP/1.1" 200 None 2025-09-27 17:49:16,179 - lava_callback - DEBUG - Processing node 68d75e58a6a7b6615d4c4f16: baseline-arm INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:49:16,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:49:16,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:49:16,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e58a6a7b6615d4c4f16/log.txt.gz 2025-09-27 17:49:16,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:49:17,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:49:17,114 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e58a6a7b6615d4c4f16/lava_callback.json.gz 2025-09-27 17:49:17,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:17,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e58a6a7b6615d4c4f16 HTTP/1.1" 200 None 2025-09-27 17:49:17,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:17,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:49:17,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:17,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e58a6a7b6615d4c4f16 HTTP/1.1" 200 None 2025-09-27 17:49:17,273 - lava_callback - INFO - Completed processing callback for node 68d75e58a6a7b6615d4c4f16 2025-09-27 17:49:21,200 - lava_callback - INFO - Received callback for node 68d81c271fd44e101337f7bb INFO: 172.21.0.1:44534 - "POST /node/68d81c271fd44e101337f7bb HTTP/1.0" 202 Accepted 2025-09-27 17:49:21,251 - lava_callback - INFO - Starting async job submit for node 68d81c271fd44e101337f7bb 2025-09-27 17:49:21,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:21,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c271fd44e101337f7bb HTTP/1.1" 200 None 2025-09-27 17:49:21,307 - lava_callback - DEBUG - Processing node 68d81c271fd44e101337f7bb: baseline-x86 2025-09-27 17:49:21,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:49:21,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:49:21,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c271fd44e101337f7bb/log.txt.gz 2025-09-27 17:49:21,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:49:21,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:49:21,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d81c271fd44e101337f7bb/lava_callback.json.gz 2025-09-27 17:49:21,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:22,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81c271fd44e101337f7bb HTTP/1.1" 200 None 2025-09-27 17:49:22,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:22,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f681fd44e101337efbf HTTP/1.1" 200 None 2025-09-27 17:49:22,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:22,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81c271fd44e101337f7bb HTTP/1.1" 200 None 2025-09-27 17:49:22,059 - lava_callback - INFO - Completed processing callback for node 68d81c271fd44e101337f7bb INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:49:28,851 - lava_callback - INFO - Received callback for node 68d589fb2be2da4660699ba3 INFO: 172.21.0.1:44550 - "POST /node/68d589fb2be2da4660699ba3 HTTP/1.0" 202 Accepted 2025-09-27 17:49:28,880 - lava_callback - INFO - Starting async job submit for node 68d589fb2be2da4660699ba3 2025-09-27 17:49:31,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:31,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589fb2be2da4660699ba3 HTTP/1.1" 200 None 2025-09-27 17:49:31,061 - lava_callback - DEBUG - Processing node 68d589fb2be2da4660699ba3: ltp-syscalls 2025-09-27 17:49:31,250 - lava_callback - INFO - Received callback for node 68d589fa2be2da4660699ba0 INFO: 172.21.0.1:42166 - "POST /node/68d589fa2be2da4660699ba0 HTTP/1.0" 202 Accepted 2025-09-27 17:49:31,289 - lava_callback - INFO - Starting async job submit for node 68d589fa2be2da4660699ba0 2025-09-27 17:49:31,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:49:31,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589fa2be2da4660699ba0 HTTP/1.1" 200 None 2025-09-27 17:49:31,497 - lava_callback - DEBUG - Processing node 68d589fa2be2da4660699ba0: ltp-smoketest 2025-09-27 17:49:33,163 - lava_callback - ERROR - Error processing callback for node 68d589fa2be2da4660699ba0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:49:42,835 - lava_callback - ERROR - Error processing callback for node 68d589fb2be2da4660699ba3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:50:47,661 - lava_callback - INFO - Received callback for node 68d5a5ee2be2da466069a1a3 INFO: 172.21.0.1:47954 - "POST /node/68d5a5ee2be2da466069a1a3 HTTP/1.0" 202 Accepted 2025-09-27 17:50:47,667 - lava_callback - INFO - Starting async job submit for node 68d5a5ee2be2da466069a1a3 2025-09-27 17:50:47,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:50:47,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5ee2be2da466069a1a3 HTTP/1.1" 200 None 2025-09-27 17:50:47,705 - lava_callback - DEBUG - Processing node 68d5a5ee2be2da466069a1a3: baseline-arm-broonie 2025-09-27 17:50:47,928 - lava_callback - ERROR - Error processing callback for node 68d5a5ee2be2da466069a1a3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 17:50:55,263 - lava_callback - INFO - Received callback for node 68d81f9c1fd44e101337f81d INFO: 172.21.0.1:46880 - "POST /node/68d81f9c1fd44e101337f81d HTTP/1.0" 202 Accepted 2025-09-27 17:50:55,269 - lava_callback - INFO - Starting async job submit for node 68d81f9c1fd44e101337f81d 2025-09-27 17:50:55,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:50:55,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81f9c1fd44e101337f81d HTTP/1.1" 200 None 2025-09-27 17:50:55,347 - lava_callback - DEBUG - Processing node 68d81f9c1fd44e101337f81d: baseline-arm 2025-09-27 17:50:55,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:50:55,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:50:55,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d81f9c1fd44e101337f81d/log.txt.gz 2025-09-27 17:50:55,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:50:55,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:50:55,962 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d81f9c1fd44e101337f81d/lava_callback.json.gz DEBUG: Setup failed for 68d81f9c1fd44e101337f81d. Transitting job node result: incomplete -> fail 2025-09-27 17:50:56,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:50:56,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d81f9c1fd44e101337f81d HTTP/1.1" 200 None 2025-09-27 17:50:56,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:50:56,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 17:50:56,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:50:56,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d81f9c1fd44e101337f81d HTTP/1.1" 200 None 2025-09-27 17:50:56,084 - lava_callback - INFO - Completed processing callback for node 68d81f9c1fd44e101337f81d INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:51:08,029 - lava_callback - INFO - Received callback for node 68d589ff2be2da4660699ba9 INFO: 172.21.0.1:52934 - "POST /node/68d589ff2be2da4660699ba9 HTTP/1.0" 202 Accepted 2025-09-27 17:51:08,036 - lava_callback - INFO - Starting async job submit for node 68d589ff2be2da4660699ba9 2025-09-27 17:51:08,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:08,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589ff2be2da4660699ba9 HTTP/1.1" 200 None 2025-09-27 17:51:08,079 - lava_callback - DEBUG - Processing node 68d589ff2be2da4660699ba9: ltp-timers 2025-09-27 17:51:08,412 - lava_callback - ERROR - Error processing callback for node 68d589ff2be2da4660699ba9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:51:32,100 - lava_callback - INFO - Received callback for node 68d73315a6a7b6615d4c45db INFO: 172.21.0.1:50994 - "POST /node/68d73315a6a7b6615d4c45db HTTP/1.0" 202 Accepted 2025-09-27 17:51:32,106 - lava_callback - INFO - Starting async job submit for node 68d73315a6a7b6615d4c45db 2025-09-27 17:51:32,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:32,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73315a6a7b6615d4c45db HTTP/1.1" 200 None 2025-09-27 17:51:32,159 - lava_callback - DEBUG - Processing node 68d73315a6a7b6615d4c45db: baseline-arm64-broonie 2025-09-27 17:51:32,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:51:32,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:51:32,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73315a6a7b6615d4c45db/log.txt.gz 2025-09-27 17:51:32,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:51:32,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:51:32,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73315a6a7b6615d4c45db/lava_callback.json.gz 2025-09-27 17:51:32,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:32,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73315a6a7b6615d4c45db HTTP/1.1" 200 None 2025-09-27 17:51:32,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:32,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 17:51:32,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:32,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73315a6a7b6615d4c45db HTTP/1.1" 200 None 2025-09-27 17:51:32,882 - lava_callback - INFO - Completed processing callback for node 68d73315a6a7b6615d4c45db INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:51:36,534 - lava_callback - INFO - Received callback for node 68d75e59a6a7b6615d4c4f19 INFO: 172.21.0.1:51020 - "POST /node/68d75e59a6a7b6615d4c4f19 HTTP/1.0" 202 Accepted 2025-09-27 17:51:36,539 - lava_callback - INFO - Starting async job submit for node 68d75e59a6a7b6615d4c4f19 2025-09-27 17:51:36,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:36,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e59a6a7b6615d4c4f19 HTTP/1.1" 200 None 2025-09-27 17:51:36,573 - lava_callback - DEBUG - Processing node 68d75e59a6a7b6615d4c4f19: baseline-arm 2025-09-27 17:51:36,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:51:36,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:51:36,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e59a6a7b6615d4c4f19/log.txt.gz 2025-09-27 17:51:36,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:51:37,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:51:37,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d75e59a6a7b6615d4c4f19/lava_callback.json.gz 2025-09-27 17:51:37,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:37,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75e59a6a7b6615d4c4f19 HTTP/1.1" 200 None 2025-09-27 17:51:37,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:37,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-27 17:51:37,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:51:37,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75e59a6a7b6615d4c4f19 HTTP/1.1" 200 None 2025-09-27 17:51:37,102 - lava_callback - INFO - Completed processing callback for node 68d75e59a6a7b6615d4c4f19 INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:52:47,736 - lava_callback - INFO - Received callback for node 68d5a5e82be2da466069a19a INFO: 172.21.0.1:43730 - "POST /node/68d5a5e82be2da466069a19a HTTP/1.0" 202 Accepted 2025-09-27 17:52:47,742 - lava_callback - INFO - Starting async job submit for node 68d5a5e82be2da466069a19a 2025-09-27 17:52:47,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:52:47,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5e82be2da466069a19a HTTP/1.1" 200 None 2025-09-27 17:52:47,777 - lava_callback - DEBUG - Processing node 68d5a5e82be2da466069a19a: baseline-arm-broonie 2025-09-27 17:52:47,992 - lava_callback - ERROR - Error processing callback for node 68d5a5e82be2da466069a19a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:53:39,053 - lava_callback - INFO - Received callback for node 68d589682be2da4660699aad INFO: 172.21.0.1:58878 - "POST /node/68d589682be2da4660699aad HTTP/1.0" 202 Accepted 2025-09-27 17:53:39,059 - lava_callback - INFO - Starting async job submit for node 68d589682be2da4660699aad 2025-09-27 17:53:39,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:53:39,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589682be2da4660699aad HTTP/1.1" 200 None 2025-09-27 17:53:39,121 - lava_callback - DEBUG - Processing node 68d589682be2da4660699aad: baseline-arm 2025-09-27 17:53:39,390 - lava_callback - ERROR - Error processing callback for node 68d589682be2da4660699aad: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34290 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:53:53,537 - lava_callback - INFO - Received callback for node 68d58a002be2da4660699bac INFO: 172.21.0.1:38758 - "POST /node/68d58a002be2da4660699bac HTTP/1.0" 202 Accepted 2025-09-27 17:53:53,544 - lava_callback - INFO - Starting async job submit for node 68d58a002be2da4660699bac 2025-09-27 17:53:53,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:53:53,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d58a002be2da4660699bac HTTP/1.1" 200 None 2025-09-27 17:53:53,592 - lava_callback - DEBUG - Processing node 68d58a002be2da4660699bac: ltp-watchqueue 2025-09-27 17:53:53,978 - lava_callback - ERROR - Error processing callback for node 68d58a002be2da4660699bac: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:54:20,293 - lava_callback - INFO - Received callback for node 68d736eba6a7b6615d4c47ef INFO: 172.21.0.1:51926 - "POST /node/68d736eba6a7b6615d4c47ef HTTP/1.0" 202 Accepted 2025-09-27 17:54:20,299 - lava_callback - INFO - Starting async job submit for node 68d736eba6a7b6615d4c47ef 2025-09-27 17:54:20,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:54:20,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eba6a7b6615d4c47ef HTTP/1.1" 200 None 2025-09-27 17:54:20,329 - lava_callback - DEBUG - Processing node 68d736eba6a7b6615d4c47ef: baseline-arm64-broonie 2025-09-27 17:54:20,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:54:20,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:54:20,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eba6a7b6615d4c47ef/log.txt.gz 2025-09-27 17:54:20,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:54:20,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:54:20,950 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d736eba6a7b6615d4c47ef/lava_callback.json.gz 2025-09-27 17:54:20,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:54:20,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736eba6a7b6615d4c47ef HTTP/1.1" 200 None 2025-09-27 17:54:20,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:54:20,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 17:54:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:54:21,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736eba6a7b6615d4c47ef HTTP/1.1" 200 None 2025-09-27 17:54:21,030 - lava_callback - INFO - Completed processing callback for node 68d736eba6a7b6615d4c47ef INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:54:25,397 - lava_callback - INFO - Received callback for node 68d820a61fd44e101337f830 INFO: 172.21.0.1:51948 - "POST /node/68d820a61fd44e101337f830 HTTP/1.0" 202 Accepted 2025-09-27 17:54:25,403 - lava_callback - INFO - Starting async job submit for node 68d820a61fd44e101337f830 2025-09-27 17:54:25,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:54:25,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d820a61fd44e101337f830 HTTP/1.1" 200 None 2025-09-27 17:54:25,460 - lava_callback - DEBUG - Processing node 68d820a61fd44e101337f830: baseline-x86 2025-09-27 17:54:26,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:54:26,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:54:26,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d820a61fd44e101337f830/log.txt.gz 2025-09-27 17:54:26,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:54:26,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:54:26,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d820a61fd44e101337f830/lava_callback.json.gz INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 68d820a61fd44e101337f830. Transitting job node result: incomplete -> fail 2025-09-27 17:54:26,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:54:26,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d820a61fd44e101337f830 HTTP/1.1" 200 None 2025-09-27 17:54:26,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:54:26,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f681fd44e101337efbf HTTP/1.1" 200 None 2025-09-27 17:54:26,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:54:26,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d820a61fd44e101337f830 HTTP/1.1" 200 None 2025-09-27 17:54:26,599 - lava_callback - INFO - Completed processing callback for node 68d820a61fd44e101337f830 INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:55:31,365 - lava_callback - INFO - Received callback for node 68d820db1fd44e101337f837 INFO: 172.21.0.1:39376 - "POST /node/68d820db1fd44e101337f837 HTTP/1.0" 202 Accepted 2025-09-27 17:55:31,372 - lava_callback - INFO - Starting async job submit for node 68d820db1fd44e101337f837 2025-09-27 17:55:31,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:55:31,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d820db1fd44e101337f837 HTTP/1.1" 200 None 2025-09-27 17:55:31,455 - lava_callback - DEBUG - Processing node 68d820db1fd44e101337f837: ltp-smoketest 2025-09-27 17:55:31,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:55:32,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:55:32,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d820db1fd44e101337f837/log.txt.gz 2025-09-27 17:55:32,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:55:32,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:55:32,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d820db1fd44e101337f837/lava_callback.json.gz 2025-09-27 17:55:32,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:55:32,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d820db1fd44e101337f837 HTTP/1.1" 200 None 2025-09-27 17:55:32,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:55:32,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f471fd44e101337efa7 HTTP/1.1" 200 None 2025-09-27 17:55:32,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:55:32,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d820db1fd44e101337f837 HTTP/1.1" 200 None 2025-09-27 17:55:32,444 - lava_callback - INFO - Completed processing callback for node 68d820db1fd44e101337f837 INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49544 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:57:08,388 - lava_callback - INFO - Received callback for node 68d589fd2be2da4660699ba6 INFO: 172.21.0.1:49546 - "POST /node/68d589fd2be2da4660699ba6 HTTP/1.0" 202 Accepted 2025-09-27 17:57:08,396 - lava_callback - INFO - Starting async job submit for node 68d589fd2be2da4660699ba6 2025-09-27 17:57:08,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:57:08,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589fd2be2da4660699ba6 HTTP/1.1" 200 None 2025-09-27 17:57:08,440 - lava_callback - DEBUG - Processing node 68d589fd2be2da4660699ba6: ltp-syscalls-ipc 2025-09-27 17:57:09,366 - lava_callback - ERROR - Error processing callback for node 68d589fd2be2da4660699ba6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:57:31,555 - lava_callback - INFO - Received callback for node 68d73707a6a7b6615d4c4886 INFO: 172.21.0.1:59856 - "POST /node/68d73707a6a7b6615d4c4886 HTTP/1.0" 202 Accepted 2025-09-27 17:57:31,562 - lava_callback - INFO - Starting async job submit for node 68d73707a6a7b6615d4c4886 2025-09-27 17:57:31,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:57:31,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73707a6a7b6615d4c4886 HTTP/1.1" 200 None 2025-09-27 17:57:31,592 - lava_callback - DEBUG - Processing node 68d73707a6a7b6615d4c4886: baseline-arm64-broonie 2025-09-27 17:57:31,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:57:32,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:57:32,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73707a6a7b6615d4c4886/log.txt.gz 2025-09-27 17:57:32,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:57:32,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:57:32,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73707a6a7b6615d4c4886/lava_callback.json.gz 2025-09-27 17:57:32,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:57:32,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73707a6a7b6615d4c4886 HTTP/1.1" 200 None 2025-09-27 17:57:32,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:57:32,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 17:57:32,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:57:32,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73707a6a7b6615d4c4886 HTTP/1.1" 200 None 2025-09-27 17:57:32,272 - lava_callback - INFO - Completed processing callback for node 68d73707a6a7b6615d4c4886 INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK 2025-09-27 17:58:52,151 - lava_callback - INFO - Received callback for node 68d767eba6a7b6615d4c4ff0 INFO: 172.21.0.1:45114 - "POST /node/68d767eba6a7b6615d4c4ff0 HTTP/1.0" 202 Accepted 2025-09-27 17:58:52,157 - lava_callback - INFO - Starting async job submit for node 68d767eba6a7b6615d4c4ff0 2025-09-27 17:58:52,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:58:52,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767eba6a7b6615d4c4ff0 HTTP/1.1" 200 None 2025-09-27 17:58:52,219 - lava_callback - DEBUG - Processing node 68d767eba6a7b6615d4c4ff0: baseline-arm 2025-09-27 17:58:52,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:58:52,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:58:52,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d767eba6a7b6615d4c4ff0/log.txt.gz 2025-09-27 17:58:52,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 17:58:52,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 17:58:52,759 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d767eba6a7b6615d4c4ff0/lava_callback.json.gz 2025-09-27 17:58:52,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:58:52,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767eba6a7b6615d4c4ff0 HTTP/1.1" 200 None 2025-09-27 17:58:52,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:58:52,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 17:58:52,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 17:58:52,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d767eba6a7b6615d4c4ff0 HTTP/1.1" 200 None 2025-09-27 17:58:52,838 - lava_callback - INFO - Completed processing callback for node 68d767eba6a7b6615d4c4ff0 INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:00:32,303 - lava_callback - INFO - Received callback for node 68d73de9a6a7b6615d4c4a80 INFO: 172.21.0.1:36982 - "POST /node/68d73de9a6a7b6615d4c4a80 HTTP/1.0" 202 Accepted 2025-09-27 18:00:32,309 - lava_callback - INFO - Starting async job submit for node 68d73de9a6a7b6615d4c4a80 2025-09-27 18:00:32,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:00:32,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73de9a6a7b6615d4c4a80 HTTP/1.1" 200 None 2025-09-27 18:00:32,361 - lava_callback - DEBUG - Processing node 68d73de9a6a7b6615d4c4a80: baseline-arm64-broonie 2025-09-27 18:00:32,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:00:32,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:00:32,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73de9a6a7b6615d4c4a80/log.txt.gz 2025-09-27 18:00:32,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:00:32,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:00:32,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d73de9a6a7b6615d4c4a80/lava_callback.json.gz 2025-09-27 18:00:33,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:00:33,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73de9a6a7b6615d4c4a80 HTTP/1.1" 200 None 2025-09-27 18:00:33,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:00:33,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:00:33,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:00:33,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73de9a6a7b6615d4c4a80 HTTP/1.1" 200 None 2025-09-27 18:00:33,088 - lava_callback - INFO - Completed processing callback for node 68d73de9a6a7b6615d4c4a80 INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:01:16,676 - lava_callback - INFO - Received callback for node 68d767eca6a7b6615d4c4ff4 INFO: 172.21.0.1:59486 - "POST /node/68d767eca6a7b6615d4c4ff4 HTTP/1.0" 202 Accepted 2025-09-27 18:01:16,684 - lava_callback - INFO - Starting async job submit for node 68d767eca6a7b6615d4c4ff4 2025-09-27 18:01:16,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:01:16,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767eca6a7b6615d4c4ff4 HTTP/1.1" 200 None 2025-09-27 18:01:16,728 - lava_callback - DEBUG - Processing node 68d767eca6a7b6615d4c4ff4: baseline-arm 2025-09-27 18:01:17,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:01:17,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:01:17,356 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d767eca6a7b6615d4c4ff4/log.txt.gz 2025-09-27 18:01:17,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:01:17,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:01:17,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d767eca6a7b6615d4c4ff4/lava_callback.json.gz 2025-09-27 18:01:17,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:01:17,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767eca6a7b6615d4c4ff4 HTTP/1.1" 200 None 2025-09-27 18:01:17,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:01:17,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 18:01:17,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:01:17,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d767eca6a7b6615d4c4ff4 HTTP/1.1" 200 None 2025-09-27 18:01:17,680 - lava_callback - INFO - Completed processing callback for node 68d767eca6a7b6615d4c4ff4 INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:01:28,430 - lava_callback - INFO - Received callback for node 68d5a5f82be2da466069a1b5 INFO: 172.21.0.1:48740 - "POST /node/68d5a5f82be2da466069a1b5 HTTP/1.0" 202 Accepted 2025-09-27 18:01:28,441 - lava_callback - INFO - Starting async job submit for node 68d5a5f82be2da466069a1b5 2025-09-27 18:01:28,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:01:28,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5f82be2da466069a1b5 HTTP/1.1" 200 None 2025-09-27 18:01:28,498 - lava_callback - DEBUG - Processing node 68d5a5f82be2da466069a1b5: ltp-cap-bounds 2025-09-27 18:01:29,083 - lava_callback - ERROR - Error processing callback for node 68d5a5f82be2da466069a1b5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:03:08,475 - lava_callback - INFO - Received callback for node 68d5a5fa2be2da466069a1b8 INFO: 172.21.0.1:46528 - "POST /node/68d5a5fa2be2da466069a1b8 HTTP/1.0" 202 Accepted 2025-09-27 18:03:08,483 - lava_callback - INFO - Starting async job submit for node 68d5a5fa2be2da466069a1b8 2025-09-27 18:03:08,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:08,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5fa2be2da466069a1b8 HTTP/1.1" 200 None 2025-09-27 18:03:08,633 - lava_callback - DEBUG - Processing node 68d5a5fa2be2da466069a1b8: ltp-containers 2025-09-27 18:03:09,482 - lava_callback - ERROR - Error processing callback for node 68d5a5fa2be2da466069a1b8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:03:37,862 - lava_callback - INFO - Received callback for node 68d767eda6a7b6615d4c4ff7 INFO: 172.21.0.1:60300 - "POST /node/68d767eda6a7b6615d4c4ff7 HTTP/1.0" 202 Accepted 2025-09-27 18:03:37,873 - lava_callback - INFO - Starting async job submit for node 68d767eda6a7b6615d4c4ff7 2025-09-27 18:03:37,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:37,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767eda6a7b6615d4c4ff7 HTTP/1.1" 200 None 2025-09-27 18:03:37,925 - lava_callback - DEBUG - Processing node 68d767eda6a7b6615d4c4ff7: baseline-arm 2025-09-27 18:03:38,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:03:38,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:03:38,506 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d767eda6a7b6615d4c4ff7/log.txt.gz 2025-09-27 18:03:38,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:03:38,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:03:38,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d767eda6a7b6615d4c4ff7/lava_callback.json.gz 2025-09-27 18:03:38,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:38,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767eda6a7b6615d4c4ff7 HTTP/1.1" 200 None 2025-09-27 18:03:38,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:38,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 18:03:38,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:38,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d767eda6a7b6615d4c4ff7 HTTP/1.1" 200 None 2025-09-27 18:03:38,819 - lava_callback - INFO - Completed processing callback for node 68d767eda6a7b6615d4c4ff7 INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:03:53,800 - lava_callback - INFO - Received callback for node 68d75070a6a7b6615d4c4d1f INFO: 172.21.0.1:38024 - "POST /node/68d75070a6a7b6615d4c4d1f HTTP/1.0" 202 Accepted 2025-09-27 18:03:53,811 - lava_callback - INFO - Starting async job submit for node 68d75070a6a7b6615d4c4d1f 2025-09-27 18:03:53,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:53,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75070a6a7b6615d4c4d1f HTTP/1.1" 200 None 2025-09-27 18:03:53,868 - lava_callback - DEBUG - Processing node 68d75070a6a7b6615d4c4d1f: baseline-arm64-broonie 2025-09-27 18:03:54,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:03:54,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:03:54,504 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d75070a6a7b6615d4c4d1f/log.txt.gz 2025-09-27 18:03:54,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:03:54,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:03:54,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d75070a6a7b6615d4c4d1f/lava_callback.json.gz 2025-09-27 18:03:54,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:54,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75070a6a7b6615d4c4d1f HTTP/1.1" 200 None 2025-09-27 18:03:54,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:54,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:03:54,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:54,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75070a6a7b6615d4c4d1f HTTP/1.1" 200 None 2025-09-27 18:03:54,822 - lava_callback - INFO - Completed processing callback for node 68d75070a6a7b6615d4c4d1f INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:03:58,520 - lava_callback - INFO - Received callback for node 68d732efa6a7b6615d4c45c6 INFO: 172.21.0.1:38046 - "POST /node/68d732efa6a7b6615d4c45c6 HTTP/1.0" 202 Accepted 2025-09-27 18:03:58,531 - lava_callback - INFO - Starting async job submit for node 68d732efa6a7b6615d4c45c6 2025-09-27 18:03:58,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:03:58,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732efa6a7b6615d4c45c6 HTTP/1.1" 200 None 2025-09-27 18:03:58,634 - lava_callback - DEBUG - Processing node 68d732efa6a7b6615d4c45c6: baseline-arm64 2025-09-27 18:04:00,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:04:00,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:04:00,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732efa6a7b6615d4c45c6/log.txt.gz 2025-09-27 18:04:00,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:04:00,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:04:00,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732efa6a7b6615d4c45c6/lava_callback.json.gz DEBUG: Setup failed for 68d732efa6a7b6615d4c45c6. Transitting job node result: incomplete -> fail 2025-09-27 18:04:00,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:00,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732efa6a7b6615d4c45c6 HTTP/1.1" 200 None 2025-09-27 18:04:00,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:00,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 18:04:00,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:00,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732efa6a7b6615d4c45c6 HTTP/1.1" 200 None 2025-09-27 18:04:00,701 - lava_callback - INFO - Completed processing callback for node 68d732efa6a7b6615d4c45c6 INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:04:47,032 - lava_callback - INFO - Received callback for node 68d732f0a6a7b6615d4c45c9 INFO: 172.21.0.1:59410 - "POST /node/68d732f0a6a7b6615d4c45c9 HTTP/1.0" 202 Accepted 2025-09-27 18:04:47,039 - lava_callback - INFO - Starting async job submit for node 68d732f0a6a7b6615d4c45c9 2025-09-27 18:04:47,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:47,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732f0a6a7b6615d4c45c9 HTTP/1.1" 200 None 2025-09-27 18:04:47,092 - lava_callback - DEBUG - Processing node 68d732f0a6a7b6615d4c45c9: baseline-arm64 2025-09-27 18:04:47,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:04:48,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:04:48,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732f0a6a7b6615d4c45c9/log.txt.gz 2025-09-27 18:04:48,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:04:48,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:04:48,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732f0a6a7b6615d4c45c9/lava_callback.json.gz DEBUG: Setup failed for 68d732f0a6a7b6615d4c45c9. Transitting job node result: incomplete -> fail 2025-09-27 18:04:48,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:48,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732f0a6a7b6615d4c45c9 HTTP/1.1" 200 None 2025-09-27 18:04:48,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:48,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 18:04:48,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:48,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732f0a6a7b6615d4c45c9 HTTP/1.1" 200 None 2025-09-27 18:04:48,504 - lava_callback - INFO - Completed processing callback for node 68d732f0a6a7b6615d4c45c9 2025-09-27 18:04:51,374 - lava_callback - INFO - Received callback for node 68d827041fd44e101337f97a INFO: 172.21.0.1:37748 - "POST /node/68d827041fd44e101337f97a HTTP/1.0" 202 Accepted 2025-09-27 18:04:51,382 - lava_callback - INFO - Starting async job submit for node 68d827041fd44e101337f97a 2025-09-27 18:04:51,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:51,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827041fd44e101337f97a HTTP/1.1" 200 None 2025-09-27 18:04:51,425 - lava_callback - DEBUG - Processing node 68d827041fd44e101337f97a: baseline-arm64-foundriesio 2025-09-27 18:04:51,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:04:51,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:04:51,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d827041fd44e101337f97a/log.txt.gz 2025-09-27 18:04:51,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:04:52,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:04:52,035 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d827041fd44e101337f97a/lava_callback.json.gz 2025-09-27 18:04:52,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:52,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827041fd44e101337f97a HTTP/1.1" 200 None 2025-09-27 18:04:52,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:52,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:04:52,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:52,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827041fd44e101337f97a HTTP/1.1" 200 None 2025-09-27 18:04:52,155 - lava_callback - INFO - Completed processing callback for node 68d827041fd44e101337f97a INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:04:58,372 - lava_callback - INFO - Received callback for node 68d827031fd44e101337f977 INFO: 172.21.0.1:37776 - "POST /node/68d827031fd44e101337f977 HTTP/1.0" 202 Accepted 2025-09-27 18:04:58,378 - lava_callback - INFO - Starting async job submit for node 68d827031fd44e101337f977 2025-09-27 18:04:58,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:58,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827031fd44e101337f977 HTTP/1.1" 200 None 2025-09-27 18:04:58,411 - lava_callback - DEBUG - Processing node 68d827031fd44e101337f977: baseline-arm64-foundriesio 2025-09-27 18:04:58,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:04:58,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:04:58,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d827031fd44e101337f977/log.txt.gz 2025-09-27 18:04:58,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:04:58,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:04:58,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d827031fd44e101337f977/lava_callback.json.gz 2025-09-27 18:04:58,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:58,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827031fd44e101337f977 HTTP/1.1" 200 None 2025-09-27 18:04:58,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:58,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:04:58,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:04:58,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827031fd44e101337f977 HTTP/1.1" 200 None 2025-09-27 18:04:58,935 - lava_callback - INFO - Completed processing callback for node 68d827031fd44e101337f977 2025-09-27 18:05:02,863 - lava_callback - INFO - Received callback for node 68d827031fd44e101337f974 INFO: 172.21.0.1:36400 - "POST /node/68d827031fd44e101337f974 HTTP/1.0" 202 Accepted 2025-09-27 18:05:02,871 - lava_callback - INFO - Starting async job submit for node 68d827031fd44e101337f974 2025-09-27 18:05:02,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:02,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827031fd44e101337f974 HTTP/1.1" 200 None 2025-09-27 18:05:02,904 - lava_callback - DEBUG - Processing node 68d827031fd44e101337f974: baseline-arm64-pengutronix 2025-09-27 18:05:03,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:03,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:03,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d827031fd44e101337f974/log.txt.gz 2025-09-27 18:05:03,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:03,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:03,326 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d827031fd44e101337f974/lava_callback.json.gz 2025-09-27 18:05:03,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:03,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827031fd44e101337f974 HTTP/1.1" 200 None 2025-09-27 18:05:03,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:03,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:03,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:03,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827031fd44e101337f974 HTTP/1.1" 200 None 2025-09-27 18:05:03,413 - lava_callback - INFO - Completed processing callback for node 68d827031fd44e101337f974 INFO: 172.21.0.1:36416 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:05:06,717 - lava_callback - INFO - Received callback for node 68d732f5a6a7b6615d4c45cc INFO: 172.21.0.1:36432 - "POST /node/68d732f5a6a7b6615d4c45cc HTTP/1.0" 202 Accepted 2025-09-27 18:05:06,724 - lava_callback - INFO - Starting async job submit for node 68d732f5a6a7b6615d4c45cc 2025-09-27 18:05:06,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:06,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732f5a6a7b6615d4c45cc HTTP/1.1" 200 None 2025-09-27 18:05:06,779 - lava_callback - DEBUG - Processing node 68d732f5a6a7b6615d4c45cc: baseline-arm64 2025-09-27 18:05:07,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:07,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:07,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732f5a6a7b6615d4c45cc/log.txt.gz 2025-09-27 18:05:07,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:08,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:08,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732f5a6a7b6615d4c45cc/lava_callback.json.gz DEBUG: Setup failed for 68d732f5a6a7b6615d4c45cc. Transitting job node result: incomplete -> fail 2025-09-27 18:05:08,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:08,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732f5a6a7b6615d4c45cc HTTP/1.1" 200 None 2025-09-27 18:05:08,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:08,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 18:05:08,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:08,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732f5a6a7b6615d4c45cc HTTP/1.1" 200 None 2025-09-27 18:05:08,158 - lava_callback - INFO - Completed processing callback for node 68d732f5a6a7b6615d4c45cc 2025-09-27 18:05:08,179 - lava_callback - INFO - Received callback for node 68d826f91fd44e101337f93d INFO: 172.21.0.1:36446 - "POST /node/68d826f91fd44e101337f93d HTTP/1.0" 202 Accepted 2025-09-27 18:05:08,190 - lava_callback - INFO - Starting async job submit for node 68d826f91fd44e101337f93d 2025-09-27 18:05:08,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:08,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f91fd44e101337f93d HTTP/1.1" 200 None 2025-09-27 18:05:08,235 - lava_callback - DEBUG - Processing node 68d826f91fd44e101337f93d: baseline-arm64-broonie 2025-09-27 18:05:08,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:08,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:08,646 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f91fd44e101337f93d/log.txt.gz 2025-09-27 18:05:08,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:08,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:08,785 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f91fd44e101337f93d/lava_callback.json.gz 2025-09-27 18:05:08,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:08,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f91fd44e101337f93d HTTP/1.1" 200 None 2025-09-27 18:05:08,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:08,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:08,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:08,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f91fd44e101337f93d HTTP/1.1" 200 None 2025-09-27 18:05:08,874 - lava_callback - INFO - Completed processing callback for node 68d826f91fd44e101337f93d 2025-09-27 18:05:10,162 - lava_callback - INFO - Received callback for node 68d826ec1fd44e101337f8e6 INFO: 172.21.0.1:35084 - "POST /node/68d826ec1fd44e101337f8e6 HTTP/1.0" 202 Accepted 2025-09-27 18:05:10,172 - lava_callback - INFO - Starting async job submit for node 68d826ec1fd44e101337f8e6 2025-09-27 18:05:10,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:10,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ec1fd44e101337f8e6 HTTP/1.1" 200 None 2025-09-27 18:05:10,218 - lava_callback - DEBUG - Processing node 68d826ec1fd44e101337f8e6: baseline-arm64 2025-09-27 18:05:10,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:10,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:10,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ec1fd44e101337f8e6/log.txt.gz 2025-09-27 18:05:10,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:10,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:10,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ec1fd44e101337f8e6/lava_callback.json.gz 2025-09-27 18:05:10,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:10,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ec1fd44e101337f8e6 HTTP/1.1" 200 None 2025-09-27 18:05:10,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:10,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:10,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:10,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ec1fd44e101337f8e6 HTTP/1.1" 200 None 2025-09-27 18:05:10,872 - lava_callback - INFO - Completed processing callback for node 68d826ec1fd44e101337f8e6 2025-09-27 18:05:14,583 - lava_callback - INFO - Received callback for node 68d826ed1fd44e101337f8ef INFO: 172.21.0.1:35092 - "POST /node/68d826ed1fd44e101337f8ef HTTP/1.0" 202 Accepted 2025-09-27 18:05:14,589 - lava_callback - INFO - Starting async job submit for node 68d826ed1fd44e101337f8ef 2025-09-27 18:05:14,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:14,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ed1fd44e101337f8ef HTTP/1.1" 200 None 2025-09-27 18:05:14,623 - lava_callback - DEBUG - Processing node 68d826ed1fd44e101337f8ef: baseline-arm64 2025-09-27 18:05:14,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:14,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:14,986 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ed1fd44e101337f8ef/log.txt.gz 2025-09-27 18:05:14,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:15,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:15,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ed1fd44e101337f8ef/lava_callback.json.gz 2025-09-27 18:05:15,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:15,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ed1fd44e101337f8ef HTTP/1.1" 200 None 2025-09-27 18:05:15,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:15,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:15,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35102 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 18:05:15,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ed1fd44e101337f8ef HTTP/1.1" 200 None 2025-09-27 18:05:15,175 - lava_callback - INFO - Completed processing callback for node 68d826ed1fd44e101337f8ef 2025-09-27 18:05:15,492 - lava_callback - INFO - Received callback for node 68d827011fd44e101337f968 INFO: 172.21.0.1:35112 - "POST /node/68d827011fd44e101337f968 HTTP/1.0" 202 Accepted 2025-09-27 18:05:15,498 - lava_callback - INFO - Starting async job submit for node 68d827011fd44e101337f968 2025-09-27 18:05:15,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:15,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827011fd44e101337f968 HTTP/1.1" 200 None 2025-09-27 18:05:15,532 - lava_callback - DEBUG - Processing node 68d827011fd44e101337f968: baseline-arm64-kontron 2025-09-27 18:05:15,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:15,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:15,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d827011fd44e101337f968/log.txt.gz 2025-09-27 18:05:15,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:16,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:16,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d827011fd44e101337f968/lava_callback.json.gz 2025-09-27 18:05:16,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:16,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827011fd44e101337f968 HTTP/1.1" 200 None 2025-09-27 18:05:16,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:16,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:16,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:16,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827011fd44e101337f968 HTTP/1.1" 200 None 2025-09-27 18:05:16,119 - lava_callback - INFO - Completed processing callback for node 68d827011fd44e101337f968 INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:05:17,356 - lava_callback - INFO - Received callback for node 68d826e91fd44e101337f8d1 INFO: 172.21.0.1:35128 - "POST /node/68d826e91fd44e101337f8d1 HTTP/1.0" 202 Accepted 2025-09-27 18:05:17,362 - lava_callback - INFO - Starting async job submit for node 68d826e91fd44e101337f8d1 2025-09-27 18:05:17,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:17,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e91fd44e101337f8d1 HTTP/1.1" 200 None 2025-09-27 18:05:17,397 - lava_callback - DEBUG - Processing node 68d826e91fd44e101337f8d1: baseline-arm64 2025-09-27 18:05:17,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:17,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:17,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e91fd44e101337f8d1/log.txt.gz 2025-09-27 18:05:17,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:17,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:17,953 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e91fd44e101337f8d1/lava_callback.json.gz 2025-09-27 18:05:17,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:17,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e91fd44e101337f8d1 HTTP/1.1" 200 None 2025-09-27 18:05:17,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:18,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:18,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:18,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826e91fd44e101337f8d1 HTTP/1.1" 200 None 2025-09-27 18:05:18,030 - lava_callback - INFO - Completed processing callback for node 68d826e91fd44e101337f8d1 2025-09-27 18:05:25,583 - lava_callback - INFO - Received callback for node 68d826ed1fd44e101337f8ec INFO: 172.21.0.1:56872 - "POST /node/68d826ed1fd44e101337f8ec HTTP/1.0" 202 Accepted 2025-09-27 18:05:25,589 - lava_callback - INFO - Starting async job submit for node 68d826ed1fd44e101337f8ec 2025-09-27 18:05:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:25,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ed1fd44e101337f8ec HTTP/1.1" 200 None 2025-09-27 18:05:25,623 - lava_callback - DEBUG - Processing node 68d826ed1fd44e101337f8ec: baseline-arm64 2025-09-27 18:05:25,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:26,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:26,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ed1fd44e101337f8ec/log.txt.gz 2025-09-27 18:05:26,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:26,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:26,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ed1fd44e101337f8ec/lava_callback.json.gz 2025-09-27 18:05:26,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:26,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ed1fd44e101337f8ec HTTP/1.1" 200 None 2025-09-27 18:05:26,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:26,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:26,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:26,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ed1fd44e101337f8ec HTTP/1.1" 200 None 2025-09-27 18:05:26,266 - lava_callback - INFO - Completed processing callback for node 68d826ed1fd44e101337f8ec INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:05:27,310 - lava_callback - INFO - Received callback for node 68d826ff1fd44e101337f962 INFO: 172.21.0.1:56880 - "POST /node/68d826ff1fd44e101337f962 HTTP/1.0" 202 Accepted 2025-09-27 18:05:27,316 - lava_callback - INFO - Starting async job submit for node 68d826ff1fd44e101337f962 2025-09-27 18:05:27,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:27,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ff1fd44e101337f962 HTTP/1.1" 200 None 2025-09-27 18:05:27,350 - lava_callback - DEBUG - Processing node 68d826ff1fd44e101337f962: baseline-arm64-clabbe 2025-09-27 18:05:27,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:27,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:27,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d826ff1fd44e101337f962/log.txt.gz 2025-09-27 18:05:27,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:27,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:27,785 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d826ff1fd44e101337f962/lava_callback.json.gz 2025-09-27 18:05:27,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:27,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ff1fd44e101337f962 HTTP/1.1" 200 None 2025-09-27 18:05:27,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:27,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:27,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:27,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ff1fd44e101337f962 HTTP/1.1" 200 None 2025-09-27 18:05:27,881 - lava_callback - INFO - Completed processing callback for node 68d826ff1fd44e101337f962 INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:05:28,257 - lava_callback - INFO - Received callback for node 68d826f51fd44e101337f922 INFO: 172.21.0.1:56906 - "POST /node/68d826f51fd44e101337f922 HTTP/1.0" 202 Accepted 2025-09-27 18:05:28,263 - lava_callback - INFO - Starting async job submit for node 68d826f51fd44e101337f922 2025-09-27 18:05:28,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:28,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f51fd44e101337f922 HTTP/1.1" 200 None 2025-09-27 18:05:28,298 - lava_callback - DEBUG - Processing node 68d826f51fd44e101337f922: baseline-arm64-broonie 2025-09-27 18:05:28,431 - lava_callback - INFO - Received callback for node 68d826e81fd44e101337f8c8 INFO: 172.21.0.1:56914 - "POST /node/68d826e81fd44e101337f8c8 HTTP/1.0" 202 Accepted 2025-09-27 18:05:28,452 - lava_callback - INFO - Starting async job submit for node 68d826e81fd44e101337f8c8 2025-09-27 18:05:28,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:28,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e81fd44e101337f8c8 HTTP/1.1" 200 None 2025-09-27 18:05:28,565 - lava_callback - DEBUG - Processing node 68d826e81fd44e101337f8c8: baseline-arm64 2025-09-27 18:05:28,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:28,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:28,917 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f51fd44e101337f922/log.txt.gz 2025-09-27 18:05:28,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:29,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:29,140 - lava_callback - INFO - Received callback for node 68d826e61fd44e101337f8bf INFO: 172.21.0.1:56928 - "POST /node/68d826e61fd44e101337f8bf HTTP/1.0" 202 Accepted 2025-09-27 18:05:29,147 - lava_callback - INFO - Starting async job submit for node 68d826e61fd44e101337f8bf 2025-09-27 18:05:29,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:29,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f51fd44e101337f922/lava_callback.json.gz 2025-09-27 18:05:29,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e61fd44e101337f8bf HTTP/1.1" 200 None 2025-09-27 18:05:29,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,209 - lava_callback - DEBUG - Processing node 68d826e61fd44e101337f8bf: baseline-arm64 2025-09-27 18:05:29,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:29,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e81fd44e101337f8c8/log.txt.gz 2025-09-27 18:05:29,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f51fd44e101337f922 HTTP/1.1" 200 None 2025-09-27 18:05:29,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:29,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:29,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:29,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f51fd44e101337f922 HTTP/1.1" 200 None 2025-09-27 18:05:29,518 - lava_callback - INFO - Completed processing callback for node 68d826f51fd44e101337f922 2025-09-27 18:05:29,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:29,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e81fd44e101337f8c8/lava_callback.json.gz 2025-09-27 18:05:29,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e81fd44e101337f8c8 HTTP/1.1" 200 None 2025-09-27 18:05:29,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:29,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e61fd44e101337f8bf/log.txt.gz 2025-09-27 18:05:29,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:29,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:29,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826e81fd44e101337f8c8 HTTP/1.1" 200 None 2025-09-27 18:05:29,706 - lava_callback - INFO - Completed processing callback for node 68d826e81fd44e101337f8c8 2025-09-27 18:05:29,791 - lava_callback - INFO - Received callback for node 68d826ea1fd44e101337f8da INFO: 172.21.0.1:58040 - "POST /node/68d826ea1fd44e101337f8da HTTP/1.0" 202 Accepted 2025-09-27 18:05:29,800 - lava_callback - INFO - Starting async job submit for node 68d826ea1fd44e101337f8da 2025-09-27 18:05:29,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,833 - lava_callback - INFO - Received callback for node 68d826f51fd44e101337f925 INFO: 172.21.0.1:58042 - "POST /node/68d826f51fd44e101337f925 HTTP/1.0" 202 Accepted 2025-09-27 18:05:29,841 - lava_callback - INFO - Starting async job submit for node 68d826f51fd44e101337f925 2025-09-27 18:05:29,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:29,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,874 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e61fd44e101337f8bf/lava_callback.json.gz 2025-09-27 18:05:29,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ea1fd44e101337f8da HTTP/1.1" 200 None 2025-09-27 18:05:29,889 - lava_callback - DEBUG - Processing node 68d826ea1fd44e101337f8da: baseline-arm64 2025-09-27 18:05:29,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:29,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f51fd44e101337f925 HTTP/1.1" 200 None 2025-09-27 18:05:29,972 - lava_callback - DEBUG - Processing node 68d826f51fd44e101337f925: baseline-arm64-broonie 2025-09-27 18:05:30,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e61fd44e101337f8bf HTTP/1.1" 200 None 2025-09-27 18:05:30,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:30,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:30,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:30,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:30,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:30,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826e61fd44e101337f8bf HTTP/1.1" 200 None 2025-09-27 18:05:30,511 - lava_callback - INFO - Completed processing callback for node 68d826e61fd44e101337f8bf 2025-09-27 18:05:30,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:30,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ea1fd44e101337f8da/log.txt.gz 2025-09-27 18:05:30,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:30,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:30,647 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f51fd44e101337f925/log.txt.gz 2025-09-27 18:05:30,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:30,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:30,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:30,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f51fd44e101337f925/lava_callback.json.gz 2025-09-27 18:05:30,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ea1fd44e101337f8da/lava_callback.json.gz 2025-09-27 18:05:30,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:30,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:30,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f51fd44e101337f925 HTTP/1.1" 200 None 2025-09-27 18:05:30,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:30,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ea1fd44e101337f8da HTTP/1.1" 200 None 2025-09-27 18:05:30,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:30,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:30,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:30,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:30,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:30,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ea1fd44e101337f8da HTTP/1.1" 200 None 2025-09-27 18:05:30,911 - lava_callback - INFO - Completed processing callback for node 68d826ea1fd44e101337f8da 2025-09-27 18:05:30,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f51fd44e101337f925 HTTP/1.1" 200 None 2025-09-27 18:05:30,912 - lava_callback - INFO - Completed processing callback for node 68d826f51fd44e101337f925 2025-09-27 18:05:31,285 - lava_callback - INFO - Received callback for node 68d826f81fd44e101337f934 INFO: 172.21.0.1:58054 - "POST /node/68d826f81fd44e101337f934 HTTP/1.0" 202 Accepted 2025-09-27 18:05:31,294 - lava_callback - INFO - Starting async job submit for node 68d826f81fd44e101337f934 2025-09-27 18:05:31,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:31,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f81fd44e101337f934 HTTP/1.1" 200 None 2025-09-27 18:05:31,332 - lava_callback - DEBUG - Processing node 68d826f81fd44e101337f934: baseline-arm64-broonie 2025-09-27 18:05:31,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:31,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:31,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f81fd44e101337f934/log.txt.gz 2025-09-27 18:05:31,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:31,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:31,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f81fd44e101337f934/lava_callback.json.gz 2025-09-27 18:05:31,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:31,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f81fd44e101337f934 HTTP/1.1" 200 None 2025-09-27 18:05:31,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:31,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:31,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:31,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f81fd44e101337f934 HTTP/1.1" 200 None 2025-09-27 18:05:31,919 - lava_callback - INFO - Completed processing callback for node 68d826f81fd44e101337f934 2025-09-27 18:05:35,491 - lava_callback - INFO - Received callback for node 68d826e71fd44e101337f8c2 INFO: 172.21.0.1:58068 - "POST /node/68d826e71fd44e101337f8c2 HTTP/1.0" 202 Accepted 2025-09-27 18:05:35,497 - lava_callback - INFO - Starting async job submit for node 68d826e71fd44e101337f8c2 2025-09-27 18:05:35,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:35,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e71fd44e101337f8c2 HTTP/1.1" 200 None 2025-09-27 18:05:35,543 - lava_callback - DEBUG - Processing node 68d826e71fd44e101337f8c2: baseline-arm64 2025-09-27 18:05:35,751 - lava_callback - INFO - Received callback for node 68d827001fd44e101337f965 INFO: 172.21.0.1:58074 - "POST /node/68d827001fd44e101337f965 HTTP/1.0" 202 Accepted 2025-09-27 18:05:35,807 - lava_callback - INFO - Starting async job submit for node 68d827001fd44e101337f965 2025-09-27 18:05:35,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:35,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827001fd44e101337f965 HTTP/1.1" 200 None 2025-09-27 18:05:35,973 - lava_callback - DEBUG - Processing node 68d827001fd44e101337f965: baseline-arm64-kontron 2025-09-27 18:05:36,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:36,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:36,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:36,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e71fd44e101337f8c2/log.txt.gz 2025-09-27 18:05:36,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:36,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:36,405 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d827001fd44e101337f965/log.txt.gz 2025-09-27 18:05:36,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:36,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:36,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e71fd44e101337f8c2/lava_callback.json.gz 2025-09-27 18:05:36,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e71fd44e101337f8c2 HTTP/1.1" 200 None 2025-09-27 18:05:36,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:36,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:36,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:36,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826e71fd44e101337f8c2 HTTP/1.1" 200 None 2025-09-27 18:05:36,511 - lava_callback - INFO - Completed processing callback for node 68d826e71fd44e101337f8c2 INFO: 172.21.0.1:58084 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:05:36,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:36,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d827001fd44e101337f965/lava_callback.json.gz 2025-09-27 18:05:36,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:36,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827001fd44e101337f965 HTTP/1.1" 200 None 2025-09-27 18:05:36,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:36,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:36,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:36,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827001fd44e101337f965 HTTP/1.1" 200 None 2025-09-27 18:05:36,669 - lava_callback - INFO - Completed processing callback for node 68d827001fd44e101337f965 2025-09-27 18:05:36,795 - lava_callback - INFO - Received callback for node 68d826eb1fd44e101337f8dd INFO: 172.21.0.1:58096 - "POST /node/68d826eb1fd44e101337f8dd HTTP/1.0" 202 Accepted 2025-09-27 18:05:36,804 - lava_callback - INFO - Starting async job submit for node 68d826eb1fd44e101337f8dd 2025-09-27 18:05:36,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:36,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826eb1fd44e101337f8dd HTTP/1.1" 200 None 2025-09-27 18:05:36,844 - lava_callback - DEBUG - Processing node 68d826eb1fd44e101337f8dd: baseline-arm64 2025-09-27 18:05:37,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:37,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:37,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826eb1fd44e101337f8dd/log.txt.gz 2025-09-27 18:05:37,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:37,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:37,605 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826eb1fd44e101337f8dd/lava_callback.json.gz 2025-09-27 18:05:37,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:37,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826eb1fd44e101337f8dd HTTP/1.1" 200 None 2025-09-27 18:05:37,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:37,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:37,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:37,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826eb1fd44e101337f8dd HTTP/1.1" 200 None 2025-09-27 18:05:37,722 - lava_callback - INFO - Completed processing callback for node 68d826eb1fd44e101337f8dd 2025-09-27 18:05:39,933 - lava_callback - INFO - Received callback for node 68d826e51fd44e101337f8bc INFO: 172.21.0.1:35068 - "POST /node/68d826e51fd44e101337f8bc HTTP/1.0" 202 Accepted 2025-09-27 18:05:39,941 - lava_callback - INFO - Starting async job submit for node 68d826e51fd44e101337f8bc 2025-09-27 18:05:39,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:40,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e51fd44e101337f8bc HTTP/1.1" 200 None 2025-09-27 18:05:40,016 - lava_callback - DEBUG - Processing node 68d826e51fd44e101337f8bc: baseline-arm64 2025-09-27 18:05:40,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:40,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:40,409 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e51fd44e101337f8bc/log.txt.gz 2025-09-27 18:05:40,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:40,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:40,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e51fd44e101337f8bc/lava_callback.json.gz 2025-09-27 18:05:40,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:40,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e51fd44e101337f8bc HTTP/1.1" 200 None 2025-09-27 18:05:40,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:40,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:40,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:40,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826e51fd44e101337f8bc HTTP/1.1" 200 None 2025-09-27 18:05:40,608 - lava_callback - INFO - Completed processing callback for node 68d826e51fd44e101337f8bc 2025-09-27 18:05:40,770 - lava_callback - INFO - Received callback for node 68d826f81fd44e101337f937 INFO: 172.21.0.1:35078 - "POST /node/68d826f81fd44e101337f937 HTTP/1.0" 202 Accepted 2025-09-27 18:05:40,777 - lava_callback - INFO - Starting async job submit for node 68d826f81fd44e101337f937 2025-09-27 18:05:40,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:40,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f81fd44e101337f937 HTTP/1.1" 200 None 2025-09-27 18:05:40,813 - lava_callback - DEBUG - Processing node 68d826f81fd44e101337f937: baseline-arm64-broonie 2025-09-27 18:05:41,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:41,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:41,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f81fd44e101337f937/log.txt.gz 2025-09-27 18:05:41,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:41,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:41,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f81fd44e101337f937/lava_callback.json.gz 2025-09-27 18:05:41,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:41,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f81fd44e101337f937 HTTP/1.1" 200 None 2025-09-27 18:05:41,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:41,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:41,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:41,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f81fd44e101337f937 HTTP/1.1" 200 None 2025-09-27 18:05:41,440 - lava_callback - INFO - Completed processing callback for node 68d826f81fd44e101337f937 2025-09-27 18:05:42,458 - lava_callback - INFO - Received callback for node 68d826e81fd44e101337f8cb INFO: 172.21.0.1:35086 - "POST /node/68d826e81fd44e101337f8cb HTTP/1.0" 202 Accepted 2025-09-27 18:05:42,465 - lava_callback - INFO - Starting async job submit for node 68d826e81fd44e101337f8cb 2025-09-27 18:05:42,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:42,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e81fd44e101337f8cb HTTP/1.1" 200 None 2025-09-27 18:05:42,496 - lava_callback - DEBUG - Processing node 68d826e81fd44e101337f8cb: baseline-arm64 2025-09-27 18:05:42,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:42,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:42,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e81fd44e101337f8cb/log.txt.gz 2025-09-27 18:05:42,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:43,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:43,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e81fd44e101337f8cb/lava_callback.json.gz 2025-09-27 18:05:43,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:43,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e81fd44e101337f8cb HTTP/1.1" 200 None 2025-09-27 18:05:43,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:43,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:43,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:43,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826e81fd44e101337f8cb HTTP/1.1" 200 None 2025-09-27 18:05:43,189 - lava_callback - INFO - Completed processing callback for node 68d826e81fd44e101337f8cb 2025-09-27 18:05:43,382 - lava_callback - INFO - Received callback for node 68d827011fd44e101337f971 INFO: 172.21.0.1:35094 - "POST /node/68d827011fd44e101337f971 HTTP/1.0" 202 Accepted 2025-09-27 18:05:43,389 - lava_callback - INFO - Starting async job submit for node 68d827011fd44e101337f971 2025-09-27 18:05:43,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:43,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827011fd44e101337f971 HTTP/1.1" 200 None 2025-09-27 18:05:43,424 - lava_callback - DEBUG - Processing node 68d827011fd44e101337f971: baseline-arm64-pengutronix 2025-09-27 18:05:43,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:43,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:43,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d827011fd44e101337f971/log.txt.gz 2025-09-27 18:05:43,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:43,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:43,834 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d827011fd44e101337f971/lava_callback.json.gz 2025-09-27 18:05:43,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:43,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827011fd44e101337f971 HTTP/1.1" 200 None 2025-09-27 18:05:43,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:43,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:43,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:43,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827011fd44e101337f971 HTTP/1.1" 200 None 2025-09-27 18:05:43,938 - lava_callback - INFO - Completed processing callback for node 68d827011fd44e101337f971 INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:05:48,376 - lava_callback - INFO - Received callback for node 68d826fa1fd44e101337f940 INFO: 172.21.0.1:35116 - "POST /node/68d826fa1fd44e101337f940 HTTP/1.0" 202 Accepted 2025-09-27 18:05:48,382 - lava_callback - INFO - Starting async job submit for node 68d826fa1fd44e101337f940 2025-09-27 18:05:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:48,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826fa1fd44e101337f940 HTTP/1.1" 200 None 2025-09-27 18:05:48,416 - lava_callback - DEBUG - Processing node 68d826fa1fd44e101337f940: baseline-arm64-broonie 2025-09-27 18:05:48,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:48,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:48,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826fa1fd44e101337f940/log.txt.gz 2025-09-27 18:05:48,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:48,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:48,963 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826fa1fd44e101337f940/lava_callback.json.gz 2025-09-27 18:05:48,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:48,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826fa1fd44e101337f940 HTTP/1.1" 200 None 2025-09-27 18:05:48,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:49,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:49,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:49,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826fa1fd44e101337f940 HTTP/1.1" 200 None 2025-09-27 18:05:49,043 - lava_callback - INFO - Completed processing callback for node 68d826fa1fd44e101337f940 2025-09-27 18:05:51,318 - lava_callback - INFO - Received callback for node 68d826ec1fd44e101337f8e9 INFO: 172.21.0.1:51538 - "POST /node/68d826ec1fd44e101337f8e9 HTTP/1.0" 202 Accepted 2025-09-27 18:05:51,324 - lava_callback - INFO - Starting async job submit for node 68d826ec1fd44e101337f8e9 2025-09-27 18:05:51,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:51,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ec1fd44e101337f8e9 HTTP/1.1" 200 None 2025-09-27 18:05:51,362 - lava_callback - DEBUG - Processing node 68d826ec1fd44e101337f8e9: baseline-arm64 2025-09-27 18:05:51,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:51,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:51,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ec1fd44e101337f8e9/log.txt.gz 2025-09-27 18:05:51,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:51,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:51,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ec1fd44e101337f8e9/lava_callback.json.gz 2025-09-27 18:05:51,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:51,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ec1fd44e101337f8e9 HTTP/1.1" 200 None 2025-09-27 18:05:51,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:51,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:51,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:51,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ec1fd44e101337f8e9 HTTP/1.1" 200 None 2025-09-27 18:05:51,958 - lava_callback - INFO - Completed processing callback for node 68d826ec1fd44e101337f8e9 2025-09-27 18:05:55,579 - lava_callback - INFO - Received callback for node 68d826ea1fd44e101337f8d7 INFO: 172.21.0.1:51546 - "POST /node/68d826ea1fd44e101337f8d7 HTTP/1.0" 202 Accepted 2025-09-27 18:05:55,585 - lava_callback - INFO - Starting async job submit for node 68d826ea1fd44e101337f8d7 2025-09-27 18:05:55,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:55,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ea1fd44e101337f8d7 HTTP/1.1" 200 None 2025-09-27 18:05:55,619 - lava_callback - DEBUG - Processing node 68d826ea1fd44e101337f8d7: baseline-arm64 2025-09-27 18:05:55,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:56,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:56,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ea1fd44e101337f8d7/log.txt.gz 2025-09-27 18:05:56,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:05:56,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:05:56,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826ea1fd44e101337f8d7/lava_callback.json.gz 2025-09-27 18:05:56,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:56,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ea1fd44e101337f8d7 HTTP/1.1" 200 None 2025-09-27 18:05:56,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:56,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:05:56,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:05:56,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ea1fd44e101337f8d7 HTTP/1.1" 200 None 2025-09-27 18:05:56,322 - lava_callback - INFO - Completed processing callback for node 68d826ea1fd44e101337f8d7 INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:06:02,535 - lava_callback - INFO - Received callback for node 68d826fc1fd44e101337f94d INFO: 172.21.0.1:59334 - "POST /node/68d826fc1fd44e101337f94d HTTP/1.0" 202 Accepted 2025-09-27 18:06:02,541 - lava_callback - INFO - Starting async job submit for node 68d826fc1fd44e101337f94d 2025-09-27 18:06:02,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:02,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826fc1fd44e101337f94d HTTP/1.1" 200 None 2025-09-27 18:06:02,575 - lava_callback - DEBUG - Processing node 68d826fc1fd44e101337f94d: baseline-arm64-clabbe 2025-09-27 18:06:02,726 - lava_callback - INFO - Received callback for node 68d767eea6a7b6615d4c4ffa INFO: 172.21.0.1:59342 - "POST /node/68d767eea6a7b6615d4c4ffa HTTP/1.0" 202 Accepted 2025-09-27 18:06:02,752 - lava_callback - INFO - Starting async job submit for node 68d767eea6a7b6615d4c4ffa 2025-09-27 18:06:02,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:02,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767eea6a7b6615d4c4ffa HTTP/1.1" 200 None 2025-09-27 18:06:02,871 - lava_callback - DEBUG - Processing node 68d767eea6a7b6615d4c4ffa: baseline-arm 2025-09-27 18:06:03,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:03,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:03,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:03,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d826fc1fd44e101337f94d/log.txt.gz 2025-09-27 18:06:03,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:03,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:03,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d767eea6a7b6615d4c4ffa/log.txt.gz 2025-09-27 18:06:03,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:03,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:03,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d826fc1fd44e101337f94d/lava_callback.json.gz 2025-09-27 18:06:03,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:03,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826fc1fd44e101337f94d HTTP/1.1" 200 None 2025-09-27 18:06:03,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:03,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:06:03,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:03,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826fc1fd44e101337f94d HTTP/1.1" 200 None 2025-09-27 18:06:03,477 - lava_callback - INFO - Completed processing callback for node 68d826fc1fd44e101337f94d 2025-09-27 18:06:03,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:03,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d767eea6a7b6615d4c4ffa/lava_callback.json.gz 2025-09-27 18:06:03,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:03,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767eea6a7b6615d4c4ffa HTTP/1.1" 200 None 2025-09-27 18:06:03,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:03,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 18:06:03,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:03,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d767eea6a7b6615d4c4ffa HTTP/1.1" 200 None 2025-09-27 18:06:03,612 - lava_callback - INFO - Completed processing callback for node 68d767eea6a7b6615d4c4ffa INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:06:12,807 - lava_callback - INFO - Received callback for node 68d75163a6a7b6615d4c4d6b INFO: 172.21.0.1:48034 - "POST /node/68d75163a6a7b6615d4c4d6b HTTP/1.0" 202 Accepted 2025-09-27 18:06:12,813 - lava_callback - INFO - Starting async job submit for node 68d75163a6a7b6615d4c4d6b 2025-09-27 18:06:12,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:12,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75163a6a7b6615d4c4d6b HTTP/1.1" 200 None 2025-09-27 18:06:12,843 - lava_callback - DEBUG - Processing node 68d75163a6a7b6615d4c4d6b: baseline-arm64-broonie 2025-09-27 18:06:13,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:13,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:13,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d75163a6a7b6615d4c4d6b/log.txt.gz 2025-09-27 18:06:13,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:13,381 - lava_callback - INFO - Received callback for node 68d736dea6a7b6615d4c4793 INFO: 172.21.0.1:48046 - "POST /node/68d736dea6a7b6615d4c4793 HTTP/1.0" 202 Accepted 2025-09-27 18:06:13,388 - lava_callback - INFO - Starting async job submit for node 68d736dea6a7b6615d4c4793 2025-09-27 18:06:13,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:13,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:13,410 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d75163a6a7b6615d4c4d6b/lava_callback.json.gz 2025-09-27 18:06:13,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:13,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dea6a7b6615d4c4793 HTTP/1.1" 200 None 2025-09-27 18:06:13,438 - lava_callback - DEBUG - Processing node 68d736dea6a7b6615d4c4793: baseline-arm64 2025-09-27 18:06:13,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75163a6a7b6615d4c4d6b HTTP/1.1" 200 None 2025-09-27 18:06:13,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:13,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:06:13,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:13,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75163a6a7b6615d4c4d6b HTTP/1.1" 200 None 2025-09-27 18:06:13,741 - lava_callback - INFO - Completed processing callback for node 68d75163a6a7b6615d4c4d6b 2025-09-27 18:06:13,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:13,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:13,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dea6a7b6615d4c4793/log.txt.gz 2025-09-27 18:06:13,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:14,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:14,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736dea6a7b6615d4c4793/lava_callback.json.gz 2025-09-27 18:06:14,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:14,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736dea6a7b6615d4c4793 HTTP/1.1" 200 None 2025-09-27 18:06:14,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:14,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 18:06:14,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:14,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736dea6a7b6615d4c4793 HTTP/1.1" 200 None 2025-09-27 18:06:14,185 - lava_callback - INFO - Completed processing callback for node 68d736dea6a7b6615d4c4793 INFO: 172.21.0.1:48058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:06:18,303 - lava_callback - INFO - Received callback for node 68d826f31fd44e101337f916 INFO: 172.21.0.1:48066 - "POST /node/68d826f31fd44e101337f916 HTTP/1.0" 202 Accepted 2025-09-27 18:06:18,309 - lava_callback - INFO - Starting async job submit for node 68d826f31fd44e101337f916 2025-09-27 18:06:18,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:18,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f31fd44e101337f916 HTTP/1.1" 200 None 2025-09-27 18:06:18,343 - lava_callback - DEBUG - Processing node 68d826f31fd44e101337f916: baseline-arm64-broonie 2025-09-27 18:06:18,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:18,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:18,670 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f31fd44e101337f916/log.txt.gz 2025-09-27 18:06:18,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:18,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:18,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f31fd44e101337f916/lava_callback.json.gz 2025-09-27 18:06:18,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:18,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f31fd44e101337f916 HTTP/1.1" 200 None 2025-09-27 18:06:18,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:18,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:06:18,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:18,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f31fd44e101337f916 HTTP/1.1" 200 None 2025-09-27 18:06:18,868 - lava_callback - INFO - Completed processing callback for node 68d826f31fd44e101337f916 INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:06:30,585 - lava_callback - INFO - Received callback for node 68d827781fd44e101337f9e6 INFO: 172.21.0.1:39886 - "POST /node/68d827781fd44e101337f9e6 HTTP/1.0" 202 Accepted 2025-09-27 18:06:30,591 - lava_callback - INFO - Starting async job submit for node 68d827781fd44e101337f9e6 2025-09-27 18:06:30,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:30,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827781fd44e101337f9e6 HTTP/1.1" 200 None 2025-09-27 18:06:30,628 - lava_callback - DEBUG - Processing node 68d827781fd44e101337f9e6: baseline-arm64-pengutronix 2025-09-27 18:06:30,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:30,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:30,937 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d827781fd44e101337f9e6/log.txt.gz 2025-09-27 18:06:30,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:31,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:31,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d827781fd44e101337f9e6/lava_callback.json.gz 2025-09-27 18:06:31,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:31,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827781fd44e101337f9e6 HTTP/1.1" 200 None 2025-09-27 18:06:31,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:31,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:06:31,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:31,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827781fd44e101337f9e6 HTTP/1.1" 200 None 2025-09-27 18:06:31,156 - lava_callback - INFO - Completed processing callback for node 68d827781fd44e101337f9e6 2025-09-27 18:06:34,374 - lava_callback - INFO - Received callback for node 68d736e3a6a7b6615d4c47b0 INFO: 172.21.0.1:39890 - "POST /node/68d736e3a6a7b6615d4c47b0 HTTP/1.0" 202 Accepted 2025-09-27 18:06:34,381 - lava_callback - INFO - Starting async job submit for node 68d736e3a6a7b6615d4c47b0 2025-09-27 18:06:34,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:34,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e3a6a7b6615d4c47b0 HTTP/1.1" 200 None 2025-09-27 18:06:34,423 - lava_callback - DEBUG - Processing node 68d736e3a6a7b6615d4c47b0: baseline-arm64 2025-09-27 18:06:34,497 - lava_callback - INFO - Received callback for node 68d826f41fd44e101337f91b INFO: 172.21.0.1:39904 - "POST /node/68d826f41fd44e101337f91b HTTP/1.0" 202 Accepted 2025-09-27 18:06:34,519 - lava_callback - INFO - Starting async job submit for node 68d826f41fd44e101337f91b 2025-09-27 18:06:34,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:34,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f41fd44e101337f91b HTTP/1.1" 200 None 2025-09-27 18:06:34,653 - lava_callback - DEBUG - Processing node 68d826f41fd44e101337f91b: baseline-arm64-broonie 2025-09-27 18:06:35,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:35,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:35,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:35,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f41fd44e101337f91b/log.txt.gz 2025-09-27 18:06:35,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:35,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:35,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e3a6a7b6615d4c47b0/log.txt.gz 2025-09-27 18:06:35,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:35,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:35,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f41fd44e101337f91b/lava_callback.json.gz 2025-09-27 18:06:35,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:35,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f41fd44e101337f91b HTTP/1.1" 200 None 2025-09-27 18:06:35,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:35,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:06:35,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:35,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f41fd44e101337f91b HTTP/1.1" 200 None 2025-09-27 18:06:35,966 - lava_callback - INFO - Completed processing callback for node 68d826f41fd44e101337f91b 2025-09-27 18:06:36,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:36,012 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736e3a6a7b6615d4c47b0/lava_callback.json.gz 2025-09-27 18:06:36,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:36,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736e3a6a7b6615d4c47b0 HTTP/1.1" 200 None 2025-09-27 18:06:36,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:36,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 18:06:36,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:36,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736e3a6a7b6615d4c47b0 HTTP/1.1" 200 None 2025-09-27 18:06:36,189 - lava_callback - INFO - Completed processing callback for node 68d736e3a6a7b6615d4c47b0 INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:06:41,557 - lava_callback - INFO - Received callback for node 68d826f71fd44e101337f92e INFO: 172.21.0.1:44928 - "POST /node/68d826f71fd44e101337f92e HTTP/1.0" 202 Accepted 2025-09-27 18:06:41,567 - lava_callback - INFO - Starting async job submit for node 68d826f71fd44e101337f92e 2025-09-27 18:06:41,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:41,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f71fd44e101337f92e HTTP/1.1" 200 None 2025-09-27 18:06:41,665 - lava_callback - DEBUG - Processing node 68d826f71fd44e101337f92e: baseline-arm64-broonie 2025-09-27 18:06:42,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:42,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:42,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f71fd44e101337f92e/log.txt.gz 2025-09-27 18:06:42,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:42,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:42,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f71fd44e101337f92e/lava_callback.json.gz 2025-09-27 18:06:42,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:42,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f71fd44e101337f92e HTTP/1.1" 200 None 2025-09-27 18:06:42,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:42,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:06:42,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:42,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f71fd44e101337f92e HTTP/1.1" 200 None 2025-09-27 18:06:42,667 - lava_callback - INFO - Completed processing callback for node 68d826f71fd44e101337f92e 2025-09-27 18:06:46,321 - lava_callback - INFO - Received callback for node 68d826f11fd44e101337f906 INFO: 172.21.0.1:44938 - "POST /node/68d826f11fd44e101337f906 HTTP/1.0" 202 Accepted 2025-09-27 18:06:46,327 - lava_callback - INFO - Starting async job submit for node 68d826f11fd44e101337f906 2025-09-27 18:06:46,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:46,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f11fd44e101337f906 HTTP/1.1" 200 None 2025-09-27 18:06:46,371 - lava_callback - DEBUG - Processing node 68d826f11fd44e101337f906: baseline-arm64-baylibre INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:06:46,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:46,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:46,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826f11fd44e101337f906/log.txt.gz 2025-09-27 18:06:46,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:47,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:47,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826f11fd44e101337f906/lava_callback.json.gz 2025-09-27 18:06:47,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:47,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f11fd44e101337f906 HTTP/1.1" 200 None 2025-09-27 18:06:47,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:47,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:06:47,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:47,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f11fd44e101337f906 HTTP/1.1" 200 None 2025-09-27 18:06:47,202 - lava_callback - INFO - Completed processing callback for node 68d826f11fd44e101337f906 2025-09-27 18:06:51,699 - lava_callback - INFO - Received callback for node 68d826f61fd44e101337f92b INFO: 172.21.0.1:58894 - "POST /node/68d826f61fd44e101337f92b HTTP/1.0" 202 Accepted 2025-09-27 18:06:51,709 - lava_callback - INFO - Starting async job submit for node 68d826f61fd44e101337f92b 2025-09-27 18:06:51,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:51,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f61fd44e101337f92b HTTP/1.1" 200 None 2025-09-27 18:06:51,763 - lava_callback - DEBUG - Processing node 68d826f61fd44e101337f92b: baseline-arm64-broonie 2025-09-27 18:06:52,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:52,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:52,277 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f61fd44e101337f92b/log.txt.gz 2025-09-27 18:06:52,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:06:52,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:06:52,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f61fd44e101337f92b/lava_callback.json.gz 2025-09-27 18:06:52,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:52,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f61fd44e101337f92b HTTP/1.1" 200 None 2025-09-27 18:06:52,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:52,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:06:52,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:06:52,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f61fd44e101337f92b HTTP/1.1" 200 None 2025-09-27 18:06:52,616 - lava_callback - INFO - Completed processing callback for node 68d826f61fd44e101337f92b INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:07:07,735 - lava_callback - INFO - Received callback for node 68d826f21fd44e101337f910 INFO: 172.21.0.1:39742 - "POST /node/68d826f21fd44e101337f910 HTTP/1.0" 202 Accepted 2025-09-27 18:07:07,746 - lava_callback - INFO - Starting async job submit for node 68d826f21fd44e101337f910 2025-09-27 18:07:07,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:07,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f21fd44e101337f910 HTTP/1.1" 200 None 2025-09-27 18:07:07,790 - lava_callback - DEBUG - Processing node 68d826f21fd44e101337f910: baseline-arm64-baylibre 2025-09-27 18:07:08,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:08,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:08,364 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826f21fd44e101337f910/log.txt.gz 2025-09-27 18:07:08,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:08,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:08,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826f21fd44e101337f910/lava_callback.json.gz 2025-09-27 18:07:08,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:08,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f21fd44e101337f910 HTTP/1.1" 200 None 2025-09-27 18:07:08,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:08,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:07:08,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:08,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f21fd44e101337f910 HTTP/1.1" 200 None 2025-09-27 18:07:08,675 - lava_callback - INFO - Completed processing callback for node 68d826f21fd44e101337f910 INFO: 172.21.0.1:49538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:07:35,037 - lava_callback - INFO - Received callback for node 68d736ffa6a7b6615d4c4852 INFO: 172.21.0.1:41410 - "POST /node/68d736ffa6a7b6615d4c4852 HTTP/1.0" 202 Accepted 2025-09-27 18:07:35,045 - lava_callback - INFO - Starting async job submit for node 68d736ffa6a7b6615d4c4852 2025-09-27 18:07:35,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:35,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736ffa6a7b6615d4c4852 HTTP/1.1" 200 None 2025-09-27 18:07:35,083 - lava_callback - DEBUG - Processing node 68d736ffa6a7b6615d4c4852: baseline-arm64 2025-09-27 18:07:35,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:35,729 - lava_callback - INFO - Received callback for node 68d827711fd44e101337f9cf INFO: 172.21.0.1:41424 - "POST /node/68d827711fd44e101337f9cf HTTP/1.0" 202 Accepted 2025-09-27 18:07:35,740 - lava_callback - INFO - Starting async job submit for node 68d827711fd44e101337f9cf 2025-09-27 18:07:35,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:35,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827711fd44e101337f9cf HTTP/1.1" 200 None 2025-09-27 18:07:35,829 - lava_callback - DEBUG - Processing node 68d827711fd44e101337f9cf: baseline-arm64-kontron 2025-09-27 18:07:35,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:35,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736ffa6a7b6615d4c4852/log.txt.gz 2025-09-27 18:07:35,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:36,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:36,206 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d736ffa6a7b6615d4c4852/lava_callback.json.gz 2025-09-27 18:07:36,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:36,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:36,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d736ffa6a7b6615d4c4852 HTTP/1.1" 200 None 2025-09-27 18:07:36,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:36,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 18:07:36,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:36,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d736ffa6a7b6615d4c4852 HTTP/1.1" 200 None 2025-09-27 18:07:36,387 - lava_callback - INFO - Completed processing callback for node 68d736ffa6a7b6615d4c4852 INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:07:36,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:36,698 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d827711fd44e101337f9cf/log.txt.gz 2025-09-27 18:07:36,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:36,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:36,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d827711fd44e101337f9cf/lava_callback.json.gz 2025-09-27 18:07:36,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:37,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827711fd44e101337f9cf HTTP/1.1" 200 None 2025-09-27 18:07:37,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:37,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:07:37,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:37,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827711fd44e101337f9cf HTTP/1.1" 200 None 2025-09-27 18:07:37,055 - lava_callback - INFO - Completed processing callback for node 68d827711fd44e101337f9cf 2025-09-27 18:07:44,296 - lava_callback - INFO - Received callback for node 68d826ee1fd44e101337f8f5 INFO: 172.21.0.1:50932 - "POST /node/68d826ee1fd44e101337f8f5 HTTP/1.0" 202 Accepted 2025-09-27 18:07:44,306 - lava_callback - INFO - Starting async job submit for node 68d826ee1fd44e101337f8f5 2025-09-27 18:07:44,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:44,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ee1fd44e101337f8f5 HTTP/1.1" 200 None 2025-09-27 18:07:44,360 - lava_callback - DEBUG - Processing node 68d826ee1fd44e101337f8f5: baseline-arm64-baylibre 2025-09-27 18:07:44,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:44,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:44,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826ee1fd44e101337f8f5/log.txt.gz 2025-09-27 18:07:44,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:45,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:45,063 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826ee1fd44e101337f8f5/lava_callback.json.gz 2025-09-27 18:07:45,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:45,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ee1fd44e101337f8f5 HTTP/1.1" 200 None 2025-09-27 18:07:45,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:45,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:07:45,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:45,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ee1fd44e101337f8f5 HTTP/1.1" 200 None 2025-09-27 18:07:45,195 - lava_callback - INFO - Completed processing callback for node 68d826ee1fd44e101337f8f5 INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:07:52,272 - lava_callback - INFO - Received callback for node 68d826f61fd44e101337f928 INFO: 172.21.0.1:56692 - "POST /node/68d826f61fd44e101337f928 HTTP/1.0" 202 Accepted 2025-09-27 18:07:52,282 - lava_callback - INFO - Starting async job submit for node 68d826f61fd44e101337f928 2025-09-27 18:07:52,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:52,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f61fd44e101337f928 HTTP/1.1" 200 None 2025-09-27 18:07:52,339 - lava_callback - DEBUG - Processing node 68d826f61fd44e101337f928: baseline-arm64-broonie 2025-09-27 18:07:52,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:52,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:52,944 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f61fd44e101337f928/log.txt.gz 2025-09-27 18:07:52,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:07:53,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:07:53,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f61fd44e101337f928/lava_callback.json.gz 2025-09-27 18:07:53,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:53,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f61fd44e101337f928 HTTP/1.1" 200 None 2025-09-27 18:07:53,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:53,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:07:53,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:07:53,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f61fd44e101337f928 HTTP/1.1" 200 None 2025-09-27 18:07:53,217 - lava_callback - INFO - Completed processing callback for node 68d826f61fd44e101337f928 INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:08:02,120 - lava_callback - INFO - Received callback for node 68d73703a6a7b6615d4c486e INFO: 172.21.0.1:46956 - "POST /node/68d73703a6a7b6615d4c486e HTTP/1.0" 202 Accepted 2025-09-27 18:08:02,126 - lava_callback - INFO - Starting async job submit for node 68d73703a6a7b6615d4c486e 2025-09-27 18:08:02,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:02,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73703a6a7b6615d4c486e HTTP/1.1" 200 None 2025-09-27 18:08:02,164 - lava_callback - DEBUG - Processing node 68d73703a6a7b6615d4c486e: baseline-arm64 2025-09-27 18:08:02,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:02,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:02,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73703a6a7b6615d4c486e/log.txt.gz 2025-09-27 18:08:02,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:02,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:02,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73703a6a7b6615d4c486e/lava_callback.json.gz 2025-09-27 18:08:02,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:02,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73703a6a7b6615d4c486e HTTP/1.1" 200 None 2025-09-27 18:08:02,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:02,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 18:08:02,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:02,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73703a6a7b6615d4c486e HTTP/1.1" 200 None 2025-09-27 18:08:02,833 - lava_callback - INFO - Completed processing callback for node 68d73703a6a7b6615d4c486e 2025-09-27 18:08:05,988 - lava_callback - INFO - Received callback for node 68d826f01fd44e101337f901 INFO: 172.21.0.1:46968 - "POST /node/68d826f01fd44e101337f901 HTTP/1.0" 202 Accepted 2025-09-27 18:08:05,994 - lava_callback - INFO - Starting async job submit for node 68d826f01fd44e101337f901 2025-09-27 18:08:06,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:06,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f01fd44e101337f901 HTTP/1.1" 200 None 2025-09-27 18:08:06,029 - lava_callback - DEBUG - Processing node 68d826f01fd44e101337f901: baseline-arm64-baylibre 2025-09-27 18:08:06,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:06,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:06,415 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826f01fd44e101337f901/log.txt.gz 2025-09-27 18:08:06,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:08:06,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:06,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826f01fd44e101337f901/lava_callback.json.gz 2025-09-27 18:08:06,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:06,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f01fd44e101337f901 HTTP/1.1" 200 None 2025-09-27 18:08:06,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:06,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:08:06,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:06,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f01fd44e101337f901 HTTP/1.1" 200 None 2025-09-27 18:08:06,618 - lava_callback - INFO - Completed processing callback for node 68d826f01fd44e101337f901 2025-09-27 18:08:10,718 - lava_callback - INFO - Received callback for node 68d826ef1fd44e101337f8f8 INFO: 172.21.0.1:50290 - "POST /node/68d826ef1fd44e101337f8f8 HTTP/1.0" 202 Accepted 2025-09-27 18:08:10,724 - lava_callback - INFO - Starting async job submit for node 68d826ef1fd44e101337f8f8 2025-09-27 18:08:10,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:10,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ef1fd44e101337f8f8 HTTP/1.1" 200 None 2025-09-27 18:08:10,758 - lava_callback - DEBUG - Processing node 68d826ef1fd44e101337f8f8: baseline-arm64-baylibre 2025-09-27 18:08:11,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:11,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:11,156 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826ef1fd44e101337f8f8/log.txt.gz 2025-09-27 18:08:11,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:11,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:11,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826ef1fd44e101337f8f8/lava_callback.json.gz 2025-09-27 18:08:11,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:11,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ef1fd44e101337f8f8 HTTP/1.1" 200 None 2025-09-27 18:08:11,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:11,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:08:11,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:11,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ef1fd44e101337f8f8 HTTP/1.1" 200 None 2025-09-27 18:08:11,363 - lava_callback - INFO - Completed processing callback for node 68d826ef1fd44e101337f8f8 INFO: 172.21.0.1:50306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:08:16,694 - lava_callback - INFO - Received callback for node 68d767f3a6a7b6615d4c5009 INFO: 172.21.0.1:50310 - "POST /node/68d767f3a6a7b6615d4c5009 HTTP/1.0" 202 Accepted 2025-09-27 18:08:16,700 - lava_callback - INFO - Starting async job submit for node 68d767f3a6a7b6615d4c5009 2025-09-27 18:08:16,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:16,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767f3a6a7b6615d4c5009 HTTP/1.1" 200 None 2025-09-27 18:08:16,733 - lava_callback - DEBUG - Processing node 68d767f3a6a7b6615d4c5009: baseline-arm 2025-09-27 18:08:16,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:17,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:17,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d767f3a6a7b6615d4c5009/log.txt.gz 2025-09-27 18:08:17,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:17,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:17,220 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d767f3a6a7b6615d4c5009/lava_callback.json.gz 2025-09-27 18:08:17,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:17,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767f3a6a7b6615d4c5009 HTTP/1.1" 200 None 2025-09-27 18:08:17,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:17,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 18:08:17,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:17,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d767f3a6a7b6615d4c5009 HTTP/1.1" 200 None 2025-09-27 18:08:17,294 - lava_callback - INFO - Completed processing callback for node 68d767f3a6a7b6615d4c5009 INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:08:29,307 - lava_callback - INFO - Received callback for node 68d826ef1fd44e101337f8fb INFO: 172.21.0.1:41436 - "POST /node/68d826ef1fd44e101337f8fb HTTP/1.0" 202 Accepted 2025-09-27 18:08:29,313 - lava_callback - INFO - Starting async job submit for node 68d826ef1fd44e101337f8fb 2025-09-27 18:08:29,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:29,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ef1fd44e101337f8fb HTTP/1.1" 200 None 2025-09-27 18:08:29,347 - lava_callback - DEBUG - Processing node 68d826ef1fd44e101337f8fb: baseline-arm64-baylibre 2025-09-27 18:08:29,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:29,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:29,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826ef1fd44e101337f8fb/log.txt.gz 2025-09-27 18:08:29,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:29,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:29,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826ef1fd44e101337f8fb/lava_callback.json.gz 2025-09-27 18:08:29,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:29,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826ef1fd44e101337f8fb HTTP/1.1" 200 None 2025-09-27 18:08:29,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:29,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:08:29,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:29,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826ef1fd44e101337f8fb HTTP/1.1" 200 None 2025-09-27 18:08:29,983 - lava_callback - INFO - Completed processing callback for node 68d826ef1fd44e101337f8fb INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:08:46,894 - lava_callback - INFO - Received callback for node 68d826f11fd44e101337f90d INFO: 172.21.0.1:43206 - "POST /node/68d826f11fd44e101337f90d HTTP/1.0" 202 Accepted 2025-09-27 18:08:46,901 - lava_callback - INFO - Starting async job submit for node 68d826f11fd44e101337f90d 2025-09-27 18:08:46,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:46,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f11fd44e101337f90d HTTP/1.1" 200 None 2025-09-27 18:08:46,961 - lava_callback - DEBUG - Processing node 68d826f11fd44e101337f90d: baseline-arm64-baylibre 2025-09-27 18:08:47,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:47,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:47,393 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826f11fd44e101337f90d/log.txt.gz 2025-09-27 18:08:47,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:47,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:47,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d826f11fd44e101337f90d/lava_callback.json.gz 2025-09-27 18:08:47,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:47,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f11fd44e101337f90d HTTP/1.1" 200 None 2025-09-27 18:08:47,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:47,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:08:47,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:47,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f11fd44e101337f90d HTTP/1.1" 200 None 2025-09-27 18:08:47,589 - lava_callback - INFO - Completed processing callback for node 68d826f11fd44e101337f90d 2025-09-27 18:08:54,632 - lava_callback - INFO - Received callback for node 68d73d64a6a7b6615d4c4a41 INFO: 172.21.0.1:47608 - "POST /node/68d73d64a6a7b6615d4c4a41 HTTP/1.0" 202 Accepted 2025-09-27 18:08:54,639 - lava_callback - INFO - Starting async job submit for node 68d73d64a6a7b6615d4c4a41 2025-09-27 18:08:54,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:54,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d64a6a7b6615d4c4a41 HTTP/1.1" 200 None 2025-09-27 18:08:54,672 - lava_callback - DEBUG - Processing node 68d73d64a6a7b6615d4c4a41: baseline-arm64 2025-09-27 18:08:55,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:55,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:55,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73d64a6a7b6615d4c4a41/log.txt.gz 2025-09-27 18:08:55,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:08:55,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:08:55,314 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73d64a6a7b6615d4c4a41/lava_callback.json.gz 2025-09-27 18:08:55,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:55,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d64a6a7b6615d4c4a41 HTTP/1.1" 200 None 2025-09-27 18:08:55,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:55,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:08:55,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:08:55,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73d64a6a7b6615d4c4a41 HTTP/1.1" 200 None 2025-09-27 18:08:55,394 - lava_callback - INFO - Completed processing callback for node 68d73d64a6a7b6615d4c4a41 INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:09:13,894 - lava_callback - INFO - Received callback for node 68d73d65a6a7b6615d4c4a44 INFO: 172.21.0.1:49668 - "POST /node/68d73d65a6a7b6615d4c4a44 HTTP/1.0" 202 Accepted 2025-09-27 18:09:13,901 - lava_callback - INFO - Starting async job submit for node 68d73d65a6a7b6615d4c4a44 2025-09-27 18:09:13,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:13,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d65a6a7b6615d4c4a44 HTTP/1.1" 200 None 2025-09-27 18:09:13,935 - lava_callback - DEBUG - Processing node 68d73d65a6a7b6615d4c4a44: baseline-arm64 2025-09-27 18:09:14,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:14,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:14,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73d65a6a7b6615d4c4a44/log.txt.gz 2025-09-27 18:09:14,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:14,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:14,557 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73d65a6a7b6615d4c4a44/lava_callback.json.gz 2025-09-27 18:09:14,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:14,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d65a6a7b6615d4c4a44 HTTP/1.1" 200 None 2025-09-27 18:09:14,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:14,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:09:14,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:14,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73d65a6a7b6615d4c4a44 HTTP/1.1" 200 None 2025-09-27 18:09:14,674 - lava_callback - INFO - Completed processing callback for node 68d73d65a6a7b6615d4c4a44 INFO: 172.21.0.1:49684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:09:17,016 - lava_callback - INFO - Received callback for node 68d75742a6a7b6615d4c4dc9 INFO: 172.21.0.1:49708 - "POST /node/68d75742a6a7b6615d4c4dc9 HTTP/1.0" 202 Accepted 2025-09-27 18:09:17,022 - lava_callback - INFO - Starting async job submit for node 68d75742a6a7b6615d4c4dc9 2025-09-27 18:09:17,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:17,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75742a6a7b6615d4c4dc9 HTTP/1.1" 200 None 2025-09-27 18:09:17,052 - lava_callback - DEBUG - Processing node 68d75742a6a7b6615d4c4dc9: baseline-arm64-broonie 2025-09-27 18:09:17,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:17,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:17,473 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d75742a6a7b6615d4c4dc9/log.txt.gz 2025-09-27 18:09:17,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:17,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:17,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d75742a6a7b6615d4c4dc9/lava_callback.json.gz 2025-09-27 18:09:17,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:17,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75742a6a7b6615d4c4dc9 HTTP/1.1" 200 None 2025-09-27 18:09:17,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:17,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 18:09:17,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:17,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75742a6a7b6615d4c4dc9 HTTP/1.1" 200 None 2025-09-27 18:09:17,705 - lava_callback - INFO - Completed processing callback for node 68d75742a6a7b6615d4c4dc9 INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:09:32,301 - lava_callback - INFO - Received callback for node 68d826f91fd44e101337f93a INFO: 172.21.0.1:57530 - "POST /node/68d826f91fd44e101337f93a HTTP/1.0" 202 Accepted 2025-09-27 18:09:32,307 - lava_callback - INFO - Starting async job submit for node 68d826f91fd44e101337f93a 2025-09-27 18:09:32,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:32,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f91fd44e101337f93a HTTP/1.1" 200 None 2025-09-27 18:09:32,385 - lava_callback - DEBUG - Processing node 68d826f91fd44e101337f93a: baseline-arm64-broonie 2025-09-27 18:09:32,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:32,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:32,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f91fd44e101337f93a/log.txt.gz 2025-09-27 18:09:32,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:32,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:32,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f91fd44e101337f93a/lava_callback.json.gz 2025-09-27 18:09:32,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:32,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f91fd44e101337f93a HTTP/1.1" 200 None 2025-09-27 18:09:32,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:32,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:09:32,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:32,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f91fd44e101337f93a HTTP/1.1" 200 None 2025-09-27 18:09:32,940 - lava_callback - INFO - Completed processing callback for node 68d826f91fd44e101337f93a 2025-09-27 18:09:35,412 - lava_callback - INFO - Received callback for node 68d824001fd44e101337f871 INFO: 172.21.0.1:57544 - "POST /node/68d824001fd44e101337f871 HTTP/1.0" 202 Accepted 2025-09-27 18:09:35,420 - lava_callback - INFO - Starting async job submit for node 68d824001fd44e101337f871 2025-09-27 18:09:35,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:35,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d824001fd44e101337f871 HTTP/1.1" 200 None 2025-09-27 18:09:35,470 - lava_callback - DEBUG - Processing node 68d824001fd44e101337f871: baseline-arm 2025-09-27 18:09:35,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:35,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:35,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d824001fd44e101337f871/log.txt.gz 2025-09-27 18:09:35,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:36,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:36,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d824001fd44e101337f871/lava_callback.json.gz DEBUG: Setup failed for 68d824001fd44e101337f871. Transitting job node result: incomplete -> fail 2025-09-27 18:09:36,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:36,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d824001fd44e101337f871 HTTP/1.1" 200 None 2025-09-27 18:09:36,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:36,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 18:09:36,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:36,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d824001fd44e101337f871 HTTP/1.1" 200 None 2025-09-27 18:09:36,252 - lava_callback - INFO - Completed processing callback for node 68d824001fd44e101337f871 INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:09:55,708 - lava_callback - INFO - Received callback for node 68d827ea1fd44e101337fa2a INFO: 172.21.0.1:53282 - "POST /node/68d827ea1fd44e101337fa2a HTTP/1.0" 202 Accepted 2025-09-27 18:09:55,714 - lava_callback - INFO - Starting async job submit for node 68d827ea1fd44e101337fa2a 2025-09-27 18:09:55,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:55,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827ea1fd44e101337fa2a HTTP/1.1" 200 None 2025-09-27 18:09:55,764 - lava_callback - DEBUG - Processing node 68d827ea1fd44e101337fa2a: baseline-arm64-kontron 2025-09-27 18:09:56,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:56,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:56,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d827ea1fd44e101337fa2a/log.txt.gz 2025-09-27 18:09:56,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:09:56,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:09:56,296 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d827ea1fd44e101337fa2a/lava_callback.json.gz 2025-09-27 18:09:56,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:56,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d827ea1fd44e101337fa2a HTTP/1.1" 200 None 2025-09-27 18:09:56,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:56,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:09:56,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:09:56,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d827ea1fd44e101337fa2a HTTP/1.1" 200 None 2025-09-27 18:09:56,383 - lava_callback - INFO - Completed processing callback for node 68d827ea1fd44e101337fa2a INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:10:14,501 - lava_callback - INFO - Received callback for node 68d73d67a6a7b6615d4c4a47 INFO: 172.21.0.1:57510 - "POST /node/68d73d67a6a7b6615d4c4a47 HTTP/1.0" 202 Accepted 2025-09-27 18:10:14,508 - lava_callback - INFO - Starting async job submit for node 68d73d67a6a7b6615d4c4a47 2025-09-27 18:10:14,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:14,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d67a6a7b6615d4c4a47 HTTP/1.1" 200 None 2025-09-27 18:10:14,550 - lava_callback - DEBUG - Processing node 68d73d67a6a7b6615d4c4a47: baseline-arm64 2025-09-27 18:10:14,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:10:15,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:10:15,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73d67a6a7b6615d4c4a47/log.txt.gz 2025-09-27 18:10:15,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57518 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 18:10:15,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:10:15,196 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73d67a6a7b6615d4c4a47/lava_callback.json.gz 2025-09-27 18:10:15,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:15,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d67a6a7b6615d4c4a47 HTTP/1.1" 200 None 2025-09-27 18:10:15,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:15,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:10:15,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:15,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73d67a6a7b6615d4c4a47 HTTP/1.1" 200 None 2025-09-27 18:10:15,306 - lava_callback - INFO - Completed processing callback for node 68d73d67a6a7b6615d4c4a47 INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:10:34,064 - lava_callback - INFO - Received callback for node 68d73d68a6a7b6615d4c4a4a INFO: 172.21.0.1:40822 - "POST /node/68d73d68a6a7b6615d4c4a4a HTTP/1.0" 202 Accepted 2025-09-27 18:10:34,070 - lava_callback - INFO - Starting async job submit for node 68d73d68a6a7b6615d4c4a4a 2025-09-27 18:10:34,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:34,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d68a6a7b6615d4c4a4a HTTP/1.1" 200 None 2025-09-27 18:10:34,104 - lava_callback - DEBUG - Processing node 68d73d68a6a7b6615d4c4a4a: baseline-arm64 2025-09-27 18:10:34,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:10:34,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:10:34,615 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73d68a6a7b6615d4c4a4a/log.txt.gz 2025-09-27 18:10:34,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:10:34,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:10:34,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73d68a6a7b6615d4c4a4a/lava_callback.json.gz 2025-09-27 18:10:34,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:34,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73d68a6a7b6615d4c4a4a HTTP/1.1" 200 None 2025-09-27 18:10:34,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:34,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:10:34,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:34,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73d68a6a7b6615d4c4a4a HTTP/1.1" 200 None 2025-09-27 18:10:34,862 - lava_callback - INFO - Completed processing callback for node 68d73d68a6a7b6615d4c4a4a INFO: 172.21.0.1:40828 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:10:38,005 - lava_callback - INFO - Received callback for node 68d767f4a6a7b6615d4c500c INFO: 172.21.0.1:40830 - "POST /node/68d767f4a6a7b6615d4c500c HTTP/1.0" 202 Accepted 2025-09-27 18:10:38,011 - lava_callback - INFO - Starting async job submit for node 68d767f4a6a7b6615d4c500c 2025-09-27 18:10:38,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:38,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767f4a6a7b6615d4c500c HTTP/1.1" 200 None 2025-09-27 18:10:38,046 - lava_callback - DEBUG - Processing node 68d767f4a6a7b6615d4c500c: baseline-arm 2025-09-27 18:10:38,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:10:38,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:10:38,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d767f4a6a7b6615d4c500c/log.txt.gz 2025-09-27 18:10:38,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:10:38,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:10:38,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d767f4a6a7b6615d4c500c/lava_callback.json.gz 2025-09-27 18:10:38,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:38,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d767f4a6a7b6615d4c500c HTTP/1.1" 200 None 2025-09-27 18:10:38,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:38,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 18:10:38,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:10:38,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d767f4a6a7b6615d4c500c HTTP/1.1" 200 None 2025-09-27 18:10:38,622 - lava_callback - INFO - Completed processing callback for node 68d767f4a6a7b6615d4c500c INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:11:01,305 - lava_callback - INFO - Received callback for node 68d823c81fd44e101337f869 INFO: 172.21.0.1:32890 - "POST /node/68d823c81fd44e101337f869 HTTP/1.0" 202 Accepted 2025-09-27 18:11:01,351 - lava_callback - INFO - Starting async job submit for node 68d823c81fd44e101337f869 2025-09-27 18:11:01,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:01,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d823c81fd44e101337f869 HTTP/1.1" 200 None 2025-09-27 18:11:01,388 - lava_callback - DEBUG - Processing node 68d823c81fd44e101337f869: baseline-x86 2025-09-27 18:11:01,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:11:01,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:11:01,633 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d823c81fd44e101337f869/log.txt.gz 2025-09-27 18:11:01,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:11:01,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:11:01,782 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d823c81fd44e101337f869/lava_callback.json.gz 2025-09-27 18:11:01,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:01,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d823c81fd44e101337f869 HTTP/1.1" 200 None 2025-09-27 18:11:01,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:01,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f681fd44e101337efbf HTTP/1.1" 200 None 2025-09-27 18:11:01,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:01,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d823c81fd44e101337f869 HTTP/1.1" 200 None 2025-09-27 18:11:01,870 - lava_callback - INFO - Completed processing callback for node 68d823c81fd44e101337f869 INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:11:40,032 - lava_callback - INFO - Received callback for node 68d73da0a6a7b6615d4c4a51 INFO: 172.21.0.1:40952 - "POST /node/68d73da0a6a7b6615d4c4a51 HTTP/1.0" 202 Accepted 2025-09-27 18:11:40,038 - lava_callback - INFO - Starting async job submit for node 68d73da0a6a7b6615d4c4a51 2025-09-27 18:11:40,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:40,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da0a6a7b6615d4c4a51 HTTP/1.1" 200 None 2025-09-27 18:11:40,071 - lava_callback - DEBUG - Processing node 68d73da0a6a7b6615d4c4a51: baseline-arm64 2025-09-27 18:11:40,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:11:40,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:11:40,563 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da0a6a7b6615d4c4a51/log.txt.gz 2025-09-27 18:11:40,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:11:40,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:11:40,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da0a6a7b6615d4c4a51/lava_callback.json.gz 2025-09-27 18:11:40,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:40,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da0a6a7b6615d4c4a51 HTTP/1.1" 200 None 2025-09-27 18:11:40,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:40,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:11:40,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:40,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73da0a6a7b6615d4c4a51 HTTP/1.1" 200 None 2025-09-27 18:11:40,795 - lava_callback - INFO - Completed processing callback for node 68d73da0a6a7b6615d4c4a51 INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:11:53,420 - lava_callback - INFO - Received callback for node 68d826e91fd44e101337f8d4 INFO: 172.21.0.1:51084 - "POST /node/68d826e91fd44e101337f8d4 HTTP/1.0" 202 Accepted 2025-09-27 18:11:53,426 - lava_callback - INFO - Starting async job submit for node 68d826e91fd44e101337f8d4 2025-09-27 18:11:53,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:53,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e91fd44e101337f8d4 HTTP/1.1" 200 None 2025-09-27 18:11:53,491 - lava_callback - DEBUG - Processing node 68d826e91fd44e101337f8d4: baseline-arm64 2025-09-27 18:11:53,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:11:53,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:11:53,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e91fd44e101337f8d4/log.txt.gz 2025-09-27 18:11:53,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:11:54,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:11:54,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e91fd44e101337f8d4/lava_callback.json.gz 2025-09-27 18:11:54,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:54,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e91fd44e101337f8d4 HTTP/1.1" 200 None 2025-09-27 18:11:54,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:54,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:11:54,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:54,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826e91fd44e101337f8d4 HTTP/1.1" 200 None 2025-09-27 18:11:54,105 - lava_callback - INFO - Completed processing callback for node 68d826e91fd44e101337f8d4 2025-09-27 18:11:54,284 - lava_callback - INFO - Received callback for node 68d73da1a6a7b6615d4c4a54 INFO: 172.21.0.1:51092 - "POST /node/68d73da1a6a7b6615d4c4a54 HTTP/1.0" 202 Accepted 2025-09-27 18:11:54,291 - lava_callback - INFO - Starting async job submit for node 68d73da1a6a7b6615d4c4a54 2025-09-27 18:11:54,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:54,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da1a6a7b6615d4c4a54 HTTP/1.1" 200 None 2025-09-27 18:11:54,329 - lava_callback - DEBUG - Processing node 68d73da1a6a7b6615d4c4a54: baseline-arm64 2025-09-27 18:11:54,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:11:54,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:11:54,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da1a6a7b6615d4c4a54/log.txt.gz 2025-09-27 18:11:54,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:11:54,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:11:54,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da1a6a7b6615d4c4a54/lava_callback.json.gz 2025-09-27 18:11:54,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:54,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da1a6a7b6615d4c4a54 HTTP/1.1" 200 None 2025-09-27 18:11:54,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:54,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:11:55,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:11:55,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73da1a6a7b6615d4c4a54 HTTP/1.1" 200 None 2025-09-27 18:11:55,029 - lava_callback - INFO - Completed processing callback for node 68d73da1a6a7b6615d4c4a54 INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:12:14,279 - lava_callback - INFO - Received callback for node 68d826e81fd44e101337f8ce INFO: 172.21.0.1:42624 - "POST /node/68d826e81fd44e101337f8ce HTTP/1.0" 202 Accepted 2025-09-27 18:12:14,285 - lava_callback - INFO - Starting async job submit for node 68d826e81fd44e101337f8ce 2025-09-27 18:12:14,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:14,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e81fd44e101337f8ce HTTP/1.1" 200 None 2025-09-27 18:12:14,323 - lava_callback - DEBUG - Processing node 68d826e81fd44e101337f8ce: baseline-arm64 2025-09-27 18:12:14,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:12:14,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:12:14,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e81fd44e101337f8ce/log.txt.gz 2025-09-27 18:12:14,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:12:14,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:12:14,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826e81fd44e101337f8ce/lava_callback.json.gz 2025-09-27 18:12:14,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:14,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826e81fd44e101337f8ce HTTP/1.1" 200 None 2025-09-27 18:12:14,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:14,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:12:14,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:14,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826e81fd44e101337f8ce HTTP/1.1" 200 None 2025-09-27 18:12:14,992 - lava_callback - INFO - Completed processing callback for node 68d826e81fd44e101337f8ce INFO: 172.21.0.1:42628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:12:17,124 - lava_callback - INFO - Received callback for node 68d826eb1fd44e101337f8e3 INFO: 172.21.0.1:42636 - "POST /node/68d826eb1fd44e101337f8e3 HTTP/1.0" 202 Accepted 2025-09-27 18:12:17,131 - lava_callback - INFO - Starting async job submit for node 68d826eb1fd44e101337f8e3 2025-09-27 18:12:17,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:17,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826eb1fd44e101337f8e3 HTTP/1.1" 200 None 2025-09-27 18:12:17,173 - lava_callback - DEBUG - Processing node 68d826eb1fd44e101337f8e3: baseline-arm64 2025-09-27 18:12:17,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:12:18,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:12:18,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826eb1fd44e101337f8e3/log.txt.gz 2025-09-27 18:12:18,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:12:18,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:12:18,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d826eb1fd44e101337f8e3/lava_callback.json.gz DEBUG: 68d826eb1fd44e101337f8e3 Transitting job node result: pass -> incomplete 2025-09-27 18:12:18,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:18,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826eb1fd44e101337f8e3 HTTP/1.1" 200 None 2025-09-27 18:12:18,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:18,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:12:18,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:18,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826eb1fd44e101337f8e3 HTTP/1.1" 200 None 2025-09-27 18:12:18,228 - lava_callback - INFO - Completed processing callback for node 68d826eb1fd44e101337f8e3 INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:12:35,802 - lava_callback - INFO - Received callback for node 68d828751fd44e101337fa63 INFO: 172.21.0.1:37722 - "POST /node/68d828751fd44e101337fa63 HTTP/1.0" 202 Accepted 2025-09-27 18:12:35,807 - lava_callback - INFO - Starting async job submit for node 68d828751fd44e101337fa63 2025-09-27 18:12:35,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:35,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d828751fd44e101337fa63 HTTP/1.1" 200 None 2025-09-27 18:12:35,854 - lava_callback - DEBUG - Processing node 68d828751fd44e101337fa63: baseline-arm64-kontron 2025-09-27 18:12:36,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:12:36,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:12:36,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d828751fd44e101337fa63/log.txt.gz 2025-09-27 18:12:36,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:12:36,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:12:36,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d828751fd44e101337fa63/lava_callback.json.gz 2025-09-27 18:12:36,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:36,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d828751fd44e101337fa63 HTTP/1.1" 200 None 2025-09-27 18:12:36,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:36,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:12:36,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:36,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d828751fd44e101337fa63 HTTP/1.1" 200 None 2025-09-27 18:12:36,455 - lava_callback - INFO - Completed processing callback for node 68d828751fd44e101337fa63 INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:12:58,314 - lava_callback - INFO - Received callback for node 68d76827a6a7b6615d4c5013 INFO: 172.21.0.1:34706 - "POST /node/68d76827a6a7b6615d4c5013 HTTP/1.0" 202 Accepted 2025-09-27 18:12:58,320 - lava_callback - INFO - Starting async job submit for node 68d76827a6a7b6615d4c5013 2025-09-27 18:12:58,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:58,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76827a6a7b6615d4c5013 HTTP/1.1" 200 None 2025-09-27 18:12:58,353 - lava_callback - DEBUG - Processing node 68d76827a6a7b6615d4c5013: baseline-arm 2025-09-27 18:12:58,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:12:58,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:12:58,727 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76827a6a7b6615d4c5013/log.txt.gz 2025-09-27 18:12:58,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:12:58,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:12:58,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76827a6a7b6615d4c5013/lava_callback.json.gz 2025-09-27 18:12:58,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:58,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76827a6a7b6615d4c5013 HTTP/1.1" 200 None 2025-09-27 18:12:58,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:58,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 18:12:58,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:12:58,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76827a6a7b6615d4c5013 HTTP/1.1" 200 None 2025-09-27 18:12:58,977 - lava_callback - INFO - Completed processing callback for node 68d76827a6a7b6615d4c5013 2025-09-27 18:13:00,064 - lava_callback - INFO - Received callback for node 68d73da4a6a7b6615d4c4a57 INFO: 172.21.0.1:45252 - "POST /node/68d73da4a6a7b6615d4c4a57 HTTP/1.0" 202 Accepted 2025-09-27 18:13:00,072 - lava_callback - INFO - Starting async job submit for node 68d73da4a6a7b6615d4c4a57 2025-09-27 18:13:00,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:00,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da4a6a7b6615d4c4a57 HTTP/1.1" 200 None 2025-09-27 18:13:00,116 - lava_callback - DEBUG - Processing node 68d73da4a6a7b6615d4c4a57: baseline-arm64 2025-09-27 18:13:00,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:13:00,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:13:00,595 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da4a6a7b6615d4c4a57/log.txt.gz 2025-09-27 18:13:00,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:13:00,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:13:00,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da4a6a7b6615d4c4a57/lava_callback.json.gz 2025-09-27 18:13:00,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:00,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da4a6a7b6615d4c4a57 HTTP/1.1" 200 None 2025-09-27 18:13:00,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:00,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:13:00,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:00,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73da4a6a7b6615d4c4a57 HTTP/1.1" 200 None 2025-09-27 18:13:00,821 - lava_callback - INFO - Completed processing callback for node 68d73da4a6a7b6615d4c4a57 INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 18:13:15,296 - lava_callback - INFO - Received callback for node 68d73da4a6a7b6615d4c4a5a INFO: 172.21.0.1:45144 - "POST /node/68d73da4a6a7b6615d4c4a5a HTTP/1.0" 202 Accepted 2025-09-27 18:13:15,302 - lava_callback - INFO - Starting async job submit for node 68d73da4a6a7b6615d4c4a5a 2025-09-27 18:13:15,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:15,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da4a6a7b6615d4c4a5a HTTP/1.1" 200 None 2025-09-27 18:13:15,360 - lava_callback - DEBUG - Processing node 68d73da4a6a7b6615d4c4a5a: baseline-arm64 2025-09-27 18:13:15,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:13:15,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:13:15,846 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da4a6a7b6615d4c4a5a/log.txt.gz 2025-09-27 18:13:15,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:13:15,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:13:15,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da4a6a7b6615d4c4a5a/lava_callback.json.gz 2025-09-27 18:13:15,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:16,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da4a6a7b6615d4c4a5a HTTP/1.1" 200 None 2025-09-27 18:13:16,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:16,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:13:16,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:16,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73da4a6a7b6615d4c4a5a HTTP/1.1" 200 None 2025-09-27 18:13:16,052 - lava_callback - INFO - Completed processing callback for node 68d73da4a6a7b6615d4c4a5a INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:13:20,472 - lava_callback - INFO - Received callback for node 68d589692be2da4660699ab0 INFO: 172.21.0.1:55326 - "POST /node/68d589692be2da4660699ab0 HTTP/1.0" 202 Accepted 2025-09-27 18:13:20,478 - lava_callback - INFO - Starting async job submit for node 68d589692be2da4660699ab0 2025-09-27 18:13:20,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:20,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589692be2da4660699ab0 HTTP/1.1" 200 None 2025-09-27 18:13:20,522 - lava_callback - DEBUG - Processing node 68d589692be2da4660699ab0: baseline-arm 2025-09-27 18:13:20,815 - lava_callback - ERROR - Error processing callback for node 68d589692be2da4660699ab0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:13:36,122 - lava_callback - INFO - Received callback for node 68d829021fd44e101337fa8b INFO: 172.21.0.1:43958 - "POST /node/68d829021fd44e101337fa8b HTTP/1.0" 202 Accepted 2025-09-27 18:13:36,128 - lava_callback - INFO - Starting async job submit for node 68d829021fd44e101337fa8b 2025-09-27 18:13:36,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:36,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d829021fd44e101337fa8b HTTP/1.1" 200 None 2025-09-27 18:13:36,166 - lava_callback - DEBUG - Processing node 68d829021fd44e101337fa8b: baseline-arm64 INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:13:36,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:13:36,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:13:36,688 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d829021fd44e101337fa8b/log.txt.gz 2025-09-27 18:13:36,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:13:36,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:13:36,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d829021fd44e101337fa8b/lava_callback.json.gz 2025-09-27 18:13:36,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:36,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d829021fd44e101337fa8b HTTP/1.1" 200 None 2025-09-27 18:13:36,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:36,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:13:36,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:36,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d829021fd44e101337fa8b HTTP/1.1" 200 None 2025-09-27 18:13:36,891 - lava_callback - INFO - Completed processing callback for node 68d829021fd44e101337fa8b INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:13:49,051 - lava_callback - INFO - Received callback for node 68d829031fd44e101337fa8e INFO: 172.21.0.1:48036 - "POST /node/68d829031fd44e101337fa8e HTTP/1.0" 202 Accepted 2025-09-27 18:13:49,057 - lava_callback - INFO - Starting async job submit for node 68d829031fd44e101337fa8e 2025-09-27 18:13:49,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:49,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d829031fd44e101337fa8e HTTP/1.1" 200 None 2025-09-27 18:13:49,091 - lava_callback - DEBUG - Processing node 68d829031fd44e101337fa8e: baseline-arm64 2025-09-27 18:13:49,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:13:49,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:13:49,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d829031fd44e101337fa8e/log.txt.gz 2025-09-27 18:13:49,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:13:49,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:13:49,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d829031fd44e101337fa8e/lava_callback.json.gz 2025-09-27 18:13:49,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:49,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d829031fd44e101337fa8e HTTP/1.1" 200 None 2025-09-27 18:13:49,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:49,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:13:49,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:13:49,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d829031fd44e101337fa8e HTTP/1.1" 200 None 2025-09-27 18:13:49,860 - lava_callback - INFO - Completed processing callback for node 68d829031fd44e101337fa8e INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:14:12,002 - lava_callback - INFO - Received callback for node 68d825141fd44e101337f88c INFO: 172.21.0.1:33994 - "POST /node/68d825141fd44e101337f88c HTTP/1.0" 202 Accepted 2025-09-27 18:14:12,009 - lava_callback - INFO - Starting async job submit for node 68d825141fd44e101337f88c 2025-09-27 18:14:12,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:12,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d825141fd44e101337f88c HTTP/1.1" 200 None 2025-09-27 18:14:12,085 - lava_callback - DEBUG - Processing node 68d825141fd44e101337f88c: ltp-smoketest 2025-09-27 18:14:12,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:14:12,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:14:12,698 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d825141fd44e101337f88c/log.txt.gz 2025-09-27 18:14:12,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:14:12,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:14:12,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d825141fd44e101337f88c/lava_callback.json.gz 2025-09-27 18:14:12,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:12,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d825141fd44e101337f88c HTTP/1.1" 200 None 2025-09-27 18:14:12,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:12,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f471fd44e101337efa7 HTTP/1.1" 200 None 2025-09-27 18:14:12,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:13,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d825141fd44e101337f88c HTTP/1.1" 200 None 2025-09-27 18:14:13,021 - lava_callback - INFO - Completed processing callback for node 68d825141fd44e101337f88c INFO: 172.21.0.1:34008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:14:19,431 - lava_callback - INFO - Received callback for node 68d73da7a6a7b6615d4c4a5d INFO: 172.21.0.1:58338 - "POST /node/68d73da7a6a7b6615d4c4a5d HTTP/1.0" 202 Accepted 2025-09-27 18:14:19,438 - lava_callback - INFO - Starting async job submit for node 68d73da7a6a7b6615d4c4a5d 2025-09-27 18:14:19,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:19,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da7a6a7b6615d4c4a5d HTTP/1.1" 200 None 2025-09-27 18:14:19,472 - lava_callback - DEBUG - Processing node 68d73da7a6a7b6615d4c4a5d: baseline-arm64 2025-09-27 18:14:19,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:14:19,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:14:19,973 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da7a6a7b6615d4c4a5d/log.txt.gz 2025-09-27 18:14:19,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:14:20,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:14:20,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da7a6a7b6615d4c4a5d/lava_callback.json.gz 2025-09-27 18:14:20,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:20,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da7a6a7b6615d4c4a5d HTTP/1.1" 200 None 2025-09-27 18:14:20,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:20,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:14:20,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:20,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73da7a6a7b6615d4c4a5d HTTP/1.1" 200 None 2025-09-27 18:14:20,243 - lava_callback - INFO - Completed processing callback for node 68d73da7a6a7b6615d4c4a5d INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:14:33,903 - lava_callback - INFO - Received callback for node 68d73da7a6a7b6615d4c4a60 INFO: 172.21.0.1:52152 - "POST /node/68d73da7a6a7b6615d4c4a60 HTTP/1.0" 202 Accepted 2025-09-27 18:14:33,909 - lava_callback - INFO - Starting async job submit for node 68d73da7a6a7b6615d4c4a60 2025-09-27 18:14:33,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:33,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da7a6a7b6615d4c4a60 HTTP/1.1" 200 None 2025-09-27 18:14:33,948 - lava_callback - DEBUG - Processing node 68d73da7a6a7b6615d4c4a60: baseline-arm64 2025-09-27 18:14:34,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:14:34,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:14:34,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da7a6a7b6615d4c4a60/log.txt.gz 2025-09-27 18:14:34,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:14:34,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:14:34,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73da7a6a7b6615d4c4a60/lava_callback.json.gz 2025-09-27 18:14:34,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:34,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73da7a6a7b6615d4c4a60 HTTP/1.1" 200 None 2025-09-27 18:14:34,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:34,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:14:34,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:34,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73da7a6a7b6615d4c4a60 HTTP/1.1" 200 None 2025-09-27 18:14:34,645 - lava_callback - INFO - Completed processing callback for node 68d73da7a6a7b6615d4c4a60 INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44086 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:14:52,691 - lava_callback - INFO - Received callback for node 68d8285d1fd44e101337fa5c INFO: 172.21.0.1:42310 - "POST /node/68d8285d1fd44e101337fa5c HTTP/1.0" 202 Accepted 2025-09-27 18:14:52,696 - lava_callback - INFO - Starting async job submit for node 68d8285d1fd44e101337fa5c 2025-09-27 18:14:52,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:52,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8285d1fd44e101337fa5c HTTP/1.1" 200 None 2025-09-27 18:14:52,744 - lava_callback - DEBUG - Processing node 68d8285d1fd44e101337fa5c: baseline-arm64-broonie 2025-09-27 18:14:52,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:14:53,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:14:53,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8285d1fd44e101337fa5c/log.txt.gz 2025-09-27 18:14:53,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:14:53,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:14:53,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8285d1fd44e101337fa5c/lava_callback.json.gz 2025-09-27 18:14:53,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:53,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8285d1fd44e101337fa5c HTTP/1.1" 200 None 2025-09-27 18:14:53,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:53,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:14:53,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:14:53,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8285d1fd44e101337fa5c HTTP/1.1" 200 None 2025-09-27 18:14:53,301 - lava_callback - INFO - Completed processing callback for node 68d8285d1fd44e101337fa5c INFO: 172.21.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 18:15:15,559 - lava_callback - INFO - Received callback for node 68d76828a6a7b6615d4c5021 INFO: 172.21.0.1:57180 - "POST /node/68d76828a6a7b6615d4c5021 HTTP/1.0" 202 Accepted 2025-09-27 18:15:15,565 - lava_callback - INFO - Starting async job submit for node 68d76828a6a7b6615d4c5021 2025-09-27 18:15:15,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:15:15,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76828a6a7b6615d4c5021 HTTP/1.1" 200 None 2025-09-27 18:15:15,598 - lava_callback - DEBUG - Processing node 68d76828a6a7b6615d4c5021: baseline-arm 2025-09-27 18:15:15,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:15:15,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:15:15,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76828a6a7b6615d4c5021/log.txt.gz 2025-09-27 18:15:15,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:15:16,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:15:16,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76828a6a7b6615d4c5021/lava_callback.json.gz 2025-09-27 18:15:16,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:15:16,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76828a6a7b6615d4c5021 HTTP/1.1" 200 None 2025-09-27 18:15:16,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:15:16,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 18:15:16,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:15:16,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76828a6a7b6615d4c5021 HTTP/1.1" 200 None 2025-09-27 18:15:16,146 - lava_callback - INFO - Completed processing callback for node 68d76828a6a7b6615d4c5021 INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:15:34,618 - lava_callback - INFO - Received callback for node 68d73daaa6a7b6615d4c4a63 INFO: 172.21.0.1:42826 - "POST /node/68d73daaa6a7b6615d4c4a63 HTTP/1.0" 202 Accepted 2025-09-27 18:15:34,625 - lava_callback - INFO - Starting async job submit for node 68d73daaa6a7b6615d4c4a63 2025-09-27 18:15:34,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:15:34,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73daaa6a7b6615d4c4a63 HTTP/1.1" 200 None 2025-09-27 18:15:34,671 - lava_callback - DEBUG - Processing node 68d73daaa6a7b6615d4c4a63: baseline-arm64 2025-09-27 18:15:35,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:15:35,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:15:35,141 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73daaa6a7b6615d4c4a63/log.txt.gz 2025-09-27 18:15:35,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:15:35,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:15:35,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73daaa6a7b6615d4c4a63/lava_callback.json.gz 2025-09-27 18:15:35,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:15:35,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73daaa6a7b6615d4c4a63 HTTP/1.1" 200 None 2025-09-27 18:15:35,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:15:35,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:15:35,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:15:35,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73daaa6a7b6615d4c4a63 HTTP/1.1" 200 None 2025-09-27 18:15:35,331 - lava_callback - INFO - Completed processing callback for node 68d73daaa6a7b6615d4c4a63 INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:16:23,653 - lava_callback - INFO - Received callback for node 68d73daaa6a7b6615d4c4a66 INFO: 172.21.0.1:58470 - "POST /node/68d73daaa6a7b6615d4c4a66 HTTP/1.0" 202 Accepted 2025-09-27 18:16:23,659 - lava_callback - INFO - Starting async job submit for node 68d73daaa6a7b6615d4c4a66 2025-09-27 18:16:23,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:16:23,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73daaa6a7b6615d4c4a66 HTTP/1.1" 200 None 2025-09-27 18:16:23,704 - lava_callback - DEBUG - Processing node 68d73daaa6a7b6615d4c4a66: baseline-arm64 2025-09-27 18:16:24,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:16:24,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:16:24,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73daaa6a7b6615d4c4a66/log.txt.gz 2025-09-27 18:16:24,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:16:24,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:16:24,384 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73daaa6a7b6615d4c4a66/lava_callback.json.gz 2025-09-27 18:16:24,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:16:24,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73daaa6a7b6615d4c4a66 HTTP/1.1" 200 None 2025-09-27 18:16:24,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:16:24,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:16:24,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:16:24,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73daaa6a7b6615d4c4a66 HTTP/1.1" 200 None 2025-09-27 18:16:24,506 - lava_callback - INFO - Completed processing callback for node 68d73daaa6a7b6615d4c4a66 INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:17:02,582 - lava_callback - INFO - Received callback for node 68d73ddda6a7b6615d4c4a6e INFO: 172.21.0.1:50566 - "POST /node/68d73ddda6a7b6615d4c4a6e HTTP/1.0" 202 Accepted 2025-09-27 18:17:02,588 - lava_callback - INFO - Starting async job submit for node 68d73ddda6a7b6615d4c4a6e 2025-09-27 18:17:02,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:02,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73ddda6a7b6615d4c4a6e HTTP/1.1" 200 None 2025-09-27 18:17:02,625 - lava_callback - DEBUG - Processing node 68d73ddda6a7b6615d4c4a6e: baseline-arm64 2025-09-27 18:17:02,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:17:03,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:17:03,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73ddda6a7b6615d4c4a6e/log.txt.gz 2025-09-27 18:17:03,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:17:03,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:17:03,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73ddda6a7b6615d4c4a6e/lava_callback.json.gz 2025-09-27 18:17:03,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:03,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73ddda6a7b6615d4c4a6e HTTP/1.1" 200 None 2025-09-27 18:17:03,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:03,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:17:03,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:03,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73ddda6a7b6615d4c4a6e HTTP/1.1" 200 None 2025-09-27 18:17:03,337 - lava_callback - INFO - Completed processing callback for node 68d73ddda6a7b6615d4c4a6e INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:17:14,240 - lava_callback - INFO - Received callback for node 68d5a5fc2be2da466069a1bb INFO: 172.21.0.1:38400 - "POST /node/68d5a5fc2be2da466069a1bb HTTP/1.0" 202 Accepted 2025-09-27 18:17:14,251 - lava_callback - INFO - Starting async job submit for node 68d5a5fc2be2da466069a1bb 2025-09-27 18:17:14,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:14,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5fc2be2da466069a1bb HTTP/1.1" 200 None 2025-09-27 18:17:14,645 - lava_callback - DEBUG - Processing node 68d5a5fc2be2da466069a1bb: ltp-controllers INFO: 172.21.0.1:38408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:17:17,413 - lava_callback - ERROR - Error processing callback for node 68d5a5fc2be2da466069a1bb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:17:34,587 - lava_callback - INFO - Received callback for node 68d73ddda6a7b6615d4c4a71 INFO: 172.21.0.1:45396 - "POST /node/68d73ddda6a7b6615d4c4a71 HTTP/1.0" 202 Accepted 2025-09-27 18:17:34,596 - lava_callback - INFO - Starting async job submit for node 68d73ddda6a7b6615d4c4a71 2025-09-27 18:17:34,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:34,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73ddda6a7b6615d4c4a71 HTTP/1.1" 200 None 2025-09-27 18:17:34,650 - lava_callback - DEBUG - Processing node 68d73ddda6a7b6615d4c4a71: baseline-arm64 2025-09-27 18:17:35,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:17:35,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:17:35,178 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73ddda6a7b6615d4c4a71/log.txt.gz 2025-09-27 18:17:35,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:17:35,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:17:35,341 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73ddda6a7b6615d4c4a71/lava_callback.json.gz 2025-09-27 18:17:35,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:35,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73ddda6a7b6615d4c4a71 HTTP/1.1" 200 None 2025-09-27 18:17:35,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:35,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:17:35,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:35,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73ddda6a7b6615d4c4a71 HTTP/1.1" 200 None 2025-09-27 18:17:35,440 - lava_callback - INFO - Completed processing callback for node 68d73ddda6a7b6615d4c4a71 INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:17:37,928 - lava_callback - INFO - Received callback for node 68d76abda6a7b6615d4c5074 INFO: 172.21.0.1:45420 - "POST /node/68d76abda6a7b6615d4c5074 HTTP/1.0" 202 Accepted 2025-09-27 18:17:37,934 - lava_callback - INFO - Starting async job submit for node 68d76abda6a7b6615d4c5074 2025-09-27 18:17:37,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:37,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76abda6a7b6615d4c5074 HTTP/1.1" 200 None 2025-09-27 18:17:37,967 - lava_callback - DEBUG - Processing node 68d76abda6a7b6615d4c5074: baseline-arm 2025-09-27 18:17:38,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:17:38,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:17:38,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76abda6a7b6615d4c5074/log.txt.gz 2025-09-27 18:17:38,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:17:38,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:17:38,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76abda6a7b6615d4c5074/lava_callback.json.gz 2025-09-27 18:17:38,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:38,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76abda6a7b6615d4c5074 HTTP/1.1" 200 None 2025-09-27 18:17:38,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:38,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 18:17:38,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:17:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76abda6a7b6615d4c5074 HTTP/1.1" 200 None 2025-09-27 18:17:38,517 - lava_callback - INFO - Completed processing callback for node 68d76abda6a7b6615d4c5074 INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:18:14,738 - lava_callback - INFO - Received callback for node 68d73de0a6a7b6615d4c4a74 INFO: 172.21.0.1:34706 - "POST /node/68d73de0a6a7b6615d4c4a74 HTTP/1.0" 202 Accepted 2025-09-27 18:18:14,744 - lava_callback - INFO - Starting async job submit for node 68d73de0a6a7b6615d4c4a74 2025-09-27 18:18:14,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:18:14,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73de0a6a7b6615d4c4a74 HTTP/1.1" 200 None 2025-09-27 18:18:14,780 - lava_callback - DEBUG - Processing node 68d73de0a6a7b6615d4c4a74: baseline-arm64 2025-09-27 18:18:15,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34722 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 18:18:15,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:18:15,266 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73de0a6a7b6615d4c4a74/log.txt.gz 2025-09-27 18:18:15,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:18:15,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:18:15,408 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73de0a6a7b6615d4c4a74/lava_callback.json.gz 2025-09-27 18:18:15,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:18:15,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73de0a6a7b6615d4c4a74 HTTP/1.1" 200 None 2025-09-27 18:18:15,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:18:15,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:18:15,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:18:15,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73de0a6a7b6615d4c4a74 HTTP/1.1" 200 None 2025-09-27 18:18:15,487 - lava_callback - INFO - Completed processing callback for node 68d73de0a6a7b6615d4c4a74 INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:18:54,476 - lava_callback - INFO - Received callback for node 68d73de0a6a7b6615d4c4a77 INFO: 172.21.0.1:57794 - "POST /node/68d73de0a6a7b6615d4c4a77 HTTP/1.0" 202 Accepted 2025-09-27 18:18:54,482 - lava_callback - INFO - Starting async job submit for node 68d73de0a6a7b6615d4c4a77 2025-09-27 18:18:54,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:18:54,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73de0a6a7b6615d4c4a77 HTTP/1.1" 200 None 2025-09-27 18:18:54,515 - lava_callback - DEBUG - Processing node 68d73de0a6a7b6615d4c4a77: baseline-arm64 2025-09-27 18:18:54,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:18:55,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:18:55,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73de0a6a7b6615d4c4a77/log.txt.gz 2025-09-27 18:18:55,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:18:55,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:18:55,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d73de0a6a7b6615d4c4a77/lava_callback.json.gz 2025-09-27 18:18:55,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:18:55,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d73de0a6a7b6615d4c4a77 HTTP/1.1" 200 None 2025-09-27 18:18:55,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:18:55,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 18:18:55,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:18:55,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d73de0a6a7b6615d4c4a77 HTTP/1.1" 200 None 2025-09-27 18:18:55,265 - lava_callback - INFO - Completed processing callback for node 68d73de0a6a7b6615d4c4a77 INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:19:40,183 - lava_callback - INFO - Received callback for node 68d74ff3a6a7b6615d4c4ce9 INFO: 172.21.0.1:35242 - "POST /node/68d74ff3a6a7b6615d4c4ce9 HTTP/1.0" 202 Accepted 2025-09-27 18:19:40,189 - lava_callback - INFO - Starting async job submit for node 68d74ff3a6a7b6615d4c4ce9 2025-09-27 18:19:40,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:19:40,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ff3a6a7b6615d4c4ce9 HTTP/1.1" 200 None 2025-09-27 18:19:40,223 - lava_callback - DEBUG - Processing node 68d74ff3a6a7b6615d4c4ce9: baseline-arm64 2025-09-27 18:19:40,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:19:40,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:19:40,692 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ff3a6a7b6615d4c4ce9/log.txt.gz 2025-09-27 18:19:40,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:19:40,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:19:40,846 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ff3a6a7b6615d4c4ce9/lava_callback.json.gz 2025-09-27 18:19:40,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:19:40,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ff3a6a7b6615d4c4ce9 HTTP/1.1" 200 None 2025-09-27 18:19:40,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:19:40,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:19:40,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:19:40,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74ff3a6a7b6615d4c4ce9 HTTP/1.1" 200 None 2025-09-27 18:19:40,937 - lava_callback - INFO - Completed processing callback for node 68d74ff3a6a7b6615d4c4ce9 INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:19:56,828 - lava_callback - INFO - Received callback for node 68d76abea6a7b6615d4c5079 INFO: 172.21.0.1:44438 - "POST /node/68d76abea6a7b6615d4c5079 HTTP/1.0" 202 Accepted 2025-09-27 18:19:56,833 - lava_callback - INFO - Starting async job submit for node 68d76abea6a7b6615d4c5079 2025-09-27 18:19:56,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:19:56,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76abea6a7b6615d4c5079 HTTP/1.1" 200 None 2025-09-27 18:19:56,887 - lava_callback - DEBUG - Processing node 68d76abea6a7b6615d4c5079: baseline-arm 2025-09-27 18:19:57,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44440 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:19:57,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:19:57,283 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76abea6a7b6615d4c5079/log.txt.gz 2025-09-27 18:19:57,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:19:57,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:19:57,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76abea6a7b6615d4c5079/lava_callback.json.gz 2025-09-27 18:19:57,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:19:57,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76abea6a7b6615d4c5079 HTTP/1.1" 200 None 2025-09-27 18:19:57,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:19:57,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 18:19:57,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:19:57,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76abea6a7b6615d4c5079 HTTP/1.1" 200 None 2025-09-27 18:19:57,512 - lava_callback - INFO - Completed processing callback for node 68d76abea6a7b6615d4c5079 INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:20:19,071 - lava_callback - INFO - Received callback for node 68d74ff4a6a7b6615d4c4cec INFO: 172.21.0.1:48554 - "POST /node/68d74ff4a6a7b6615d4c4cec HTTP/1.0" 202 Accepted 2025-09-27 18:20:19,077 - lava_callback - INFO - Starting async job submit for node 68d74ff4a6a7b6615d4c4cec 2025-09-27 18:20:19,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:19,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ff4a6a7b6615d4c4cec HTTP/1.1" 200 None 2025-09-27 18:20:19,110 - lava_callback - DEBUG - Processing node 68d74ff4a6a7b6615d4c4cec: baseline-arm64 2025-09-27 18:20:19,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:20:19,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:20:19,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ff4a6a7b6615d4c4cec/log.txt.gz 2025-09-27 18:20:19,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:20:19,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:20:19,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ff4a6a7b6615d4c4cec/lava_callback.json.gz 2025-09-27 18:20:19,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:19,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ff4a6a7b6615d4c4cec HTTP/1.1" 200 None 2025-09-27 18:20:19,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:19,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:20:19,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:19,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74ff4a6a7b6615d4c4cec HTTP/1.1" 200 None 2025-09-27 18:20:19,821 - lava_callback - INFO - Completed processing callback for node 68d74ff4a6a7b6615d4c4cec INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55912 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:20:32,443 - lava_callback - INFO - Received callback for node 68d8299d1fd44e101337fab4 INFO: 172.21.0.1:55918 - "POST /node/68d8299d1fd44e101337fab4 HTTP/1.0" 202 Accepted 2025-09-27 18:20:32,449 - lava_callback - INFO - Starting async job submit for node 68d8299d1fd44e101337fab4 2025-09-27 18:20:32,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:32,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8299d1fd44e101337fab4 HTTP/1.1" 200 None 2025-09-27 18:20:32,504 - lava_callback - DEBUG - Processing node 68d8299d1fd44e101337fab4: baseline-arm64-broonie 2025-09-27 18:20:32,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:20:32,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:20:32,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8299d1fd44e101337fab4/log.txt.gz 2025-09-27 18:20:32,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:20:32,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:20:32,932 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8299d1fd44e101337fab4/lava_callback.json.gz 2025-09-27 18:20:32,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:32,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8299d1fd44e101337fab4 HTTP/1.1" 200 None 2025-09-27 18:20:32,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:32,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:20:32,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:33,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8299d1fd44e101337fab4 HTTP/1.1" 200 None 2025-09-27 18:20:33,050 - lava_callback - INFO - Completed processing callback for node 68d8299d1fd44e101337fab4 INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:20:54,719 - lava_callback - INFO - Received callback for node 68d74ff7a6a7b6615d4c4cef INFO: 172.21.0.1:50840 - "POST /node/68d74ff7a6a7b6615d4c4cef HTTP/1.0" 202 Accepted 2025-09-27 18:20:54,725 - lava_callback - INFO - Starting async job submit for node 68d74ff7a6a7b6615d4c4cef 2025-09-27 18:20:54,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:54,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ff7a6a7b6615d4c4cef HTTP/1.1" 200 None 2025-09-27 18:20:54,759 - lava_callback - DEBUG - Processing node 68d74ff7a6a7b6615d4c4cef: baseline-arm64 2025-09-27 18:20:55,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:20:55,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:20:55,236 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ff7a6a7b6615d4c4cef/log.txt.gz 2025-09-27 18:20:55,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:20:55,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:20:55,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ff7a6a7b6615d4c4cef/lava_callback.json.gz 2025-09-27 18:20:55,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:55,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ff7a6a7b6615d4c4cef HTTP/1.1" 200 None 2025-09-27 18:20:55,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:55,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:20:55,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:20:55,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74ff7a6a7b6615d4c4cef HTTP/1.1" 200 None 2025-09-27 18:20:55,467 - lava_callback - INFO - Completed processing callback for node 68d74ff7a6a7b6615d4c4cef INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:21:34,049 - lava_callback - INFO - Received callback for node 68d74ff7a6a7b6615d4c4cf2 INFO: 172.21.0.1:54060 - "POST /node/68d74ff7a6a7b6615d4c4cf2 HTTP/1.0" 202 Accepted 2025-09-27 18:21:34,055 - lava_callback - INFO - Starting async job submit for node 68d74ff7a6a7b6615d4c4cf2 2025-09-27 18:21:34,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:21:34,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ff7a6a7b6615d4c4cf2 HTTP/1.1" 200 None 2025-09-27 18:21:34,123 - lava_callback - DEBUG - Processing node 68d74ff7a6a7b6615d4c4cf2: baseline-arm64 2025-09-27 18:21:34,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:21:34,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:21:34,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ff7a6a7b6615d4c4cf2/log.txt.gz 2025-09-27 18:21:34,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:21:34,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:21:34,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ff7a6a7b6615d4c4cf2/lava_callback.json.gz 2025-09-27 18:21:34,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:21:34,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ff7a6a7b6615d4c4cf2 HTTP/1.1" 200 None 2025-09-27 18:21:34,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:21:34,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:21:34,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:21:34,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74ff7a6a7b6615d4c4cf2 HTTP/1.1" 200 None 2025-09-27 18:21:34,822 - lava_callback - INFO - Completed processing callback for node 68d74ff7a6a7b6615d4c4cf2 INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:22:13,800 - lava_callback - INFO - Received callback for node 68d74ffaa6a7b6615d4c4cf5 INFO: 172.21.0.1:33124 - "POST /node/68d74ffaa6a7b6615d4c4cf5 HTTP/1.0" 202 Accepted 2025-09-27 18:22:13,806 - lava_callback - INFO - Starting async job submit for node 68d74ffaa6a7b6615d4c4cf5 2025-09-27 18:22:13,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:22:13,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ffaa6a7b6615d4c4cf5 HTTP/1.1" 200 None 2025-09-27 18:22:13,844 - lava_callback - DEBUG - Processing node 68d74ffaa6a7b6615d4c4cf5: baseline-arm64 2025-09-27 18:22:14,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:22:14,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:22:14,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ffaa6a7b6615d4c4cf5/log.txt.gz 2025-09-27 18:22:14,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:22:14,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:22:14,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ffaa6a7b6615d4c4cf5/lava_callback.json.gz 2025-09-27 18:22:14,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:22:14,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ffaa6a7b6615d4c4cf5 HTTP/1.1" 200 None 2025-09-27 18:22:14,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:22:14,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:22:14,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:22:14,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74ffaa6a7b6615d4c4cf5 HTTP/1.1" 200 None 2025-09-27 18:22:14,594 - lava_callback - INFO - Completed processing callback for node 68d74ffaa6a7b6615d4c4cf5 INFO: 172.21.0.1:33136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:22:17,767 - lava_callback - INFO - Received callback for node 68d76ac0a6a7b6615d4c507c INFO: 172.21.0.1:33166 - "POST /node/68d76ac0a6a7b6615d4c507c HTTP/1.0" 202 Accepted 2025-09-27 18:22:17,773 - lava_callback - INFO - Starting async job submit for node 68d76ac0a6a7b6615d4c507c 2025-09-27 18:22:17,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:22:17,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac0a6a7b6615d4c507c HTTP/1.1" 200 None 2025-09-27 18:22:17,806 - lava_callback - DEBUG - Processing node 68d76ac0a6a7b6615d4c507c: baseline-arm 2025-09-27 18:22:18,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:22:18,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:22:18,156 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac0a6a7b6615d4c507c/log.txt.gz 2025-09-27 18:22:18,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:22:18,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:22:18,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac0a6a7b6615d4c507c/lava_callback.json.gz 2025-09-27 18:22:18,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:22:18,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac0a6a7b6615d4c507c HTTP/1.1" 200 None 2025-09-27 18:22:18,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:22:18,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 18:22:18,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:22:18,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76ac0a6a7b6615d4c507c HTTP/1.1" 200 None 2025-09-27 18:22:18,359 - lava_callback - INFO - Completed processing callback for node 68d76ac0a6a7b6615d4c507c INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:23:27,062 - lava_callback - INFO - Received callback for node 68d74ffaa6a7b6615d4c4cf8 INFO: 172.21.0.1:45822 - "POST /node/68d74ffaa6a7b6615d4c4cf8 HTTP/1.0" 202 Accepted 2025-09-27 18:23:27,068 - lava_callback - INFO - Starting async job submit for node 68d74ffaa6a7b6615d4c4cf8 2025-09-27 18:23:27,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:23:27,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ffaa6a7b6615d4c4cf8 HTTP/1.1" 200 None 2025-09-27 18:23:27,102 - lava_callback - DEBUG - Processing node 68d74ffaa6a7b6615d4c4cf8: baseline-arm64 2025-09-27 18:23:27,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:23:27,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:23:27,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ffaa6a7b6615d4c4cf8/log.txt.gz 2025-09-27 18:23:27,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:23:27,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:23:27,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d74ffaa6a7b6615d4c4cf8/lava_callback.json.gz 2025-09-27 18:23:27,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:23:27,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d74ffaa6a7b6615d4c4cf8 HTTP/1.1" 200 None 2025-09-27 18:23:27,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:23:27,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:23:27,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:23:27,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d74ffaa6a7b6615d4c4cf8 HTTP/1.1" 200 None 2025-09-27 18:23:27,855 - lava_callback - INFO - Completed processing callback for node 68d74ffaa6a7b6615d4c4cf8 INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:23:35,024 - lava_callback - INFO - Received callback for node 68d75030a6a7b6615d4c4cff INFO: 172.21.0.1:57292 - "POST /node/68d75030a6a7b6615d4c4cff HTTP/1.0" 202 Accepted 2025-09-27 18:23:35,030 - lava_callback - INFO - Starting async job submit for node 68d75030a6a7b6615d4c4cff 2025-09-27 18:23:35,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:23:35,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75030a6a7b6615d4c4cff HTTP/1.1" 200 None 2025-09-27 18:23:35,063 - lava_callback - DEBUG - Processing node 68d75030a6a7b6615d4c4cff: baseline-arm64 2025-09-27 18:23:35,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:23:35,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:23:35,567 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75030a6a7b6615d4c4cff/log.txt.gz 2025-09-27 18:23:35,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:23:35,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:23:35,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75030a6a7b6615d4c4cff/lava_callback.json.gz 2025-09-27 18:23:35,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:23:35,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75030a6a7b6615d4c4cff HTTP/1.1" 200 None 2025-09-27 18:23:35,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:23:35,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:23:35,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:23:35,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75030a6a7b6615d4c4cff HTTP/1.1" 200 None 2025-09-27 18:23:35,770 - lava_callback - INFO - Completed processing callback for node 68d75030a6a7b6615d4c4cff INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:24:38,092 - lava_callback - INFO - Received callback for node 68d732f6a6a7b6615d4c45cf INFO: 172.21.0.1:44186 - "POST /node/68d732f6a6a7b6615d4c45cf HTTP/1.0" 202 Accepted 2025-09-27 18:24:38,100 - lava_callback - INFO - Starting async job submit for node 68d732f6a6a7b6615d4c45cf 2025-09-27 18:24:38,140 - lava_callback - INFO - Received callback for node 68d76ac0a6a7b6615d4c507f 2025-09-27 18:24:38,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44192 - "POST /node/68d76ac0a6a7b6615d4c507f HTTP/1.0" 202 Accepted 2025-09-27 18:24:38,147 - lava_callback - INFO - Starting async job submit for node 68d76ac0a6a7b6615d4c507f 2025-09-27 18:24:38,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:24:38,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732f6a6a7b6615d4c45cf HTTP/1.1" 200 None 2025-09-27 18:24:38,179 - lava_callback - DEBUG - Processing node 68d732f6a6a7b6615d4c45cf: baseline-arm64 2025-09-27 18:24:38,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac0a6a7b6615d4c507f HTTP/1.1" 200 None 2025-09-27 18:24:38,249 - lava_callback - DEBUG - Processing node 68d76ac0a6a7b6615d4c507f: baseline-arm 2025-09-27 18:24:38,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:24:39,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:24:39,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac0a6a7b6615d4c507f/log.txt.gz 2025-09-27 18:24:39,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:24:39,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:24:39,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:24:39,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac0a6a7b6615d4c507f/lava_callback.json.gz 2025-09-27 18:24:39,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:24:39,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac0a6a7b6615d4c507f HTTP/1.1" 200 None 2025-09-27 18:24:39,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:24:39,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 18:24:39,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:24:39,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76ac0a6a7b6615d4c507f HTTP/1.1" 200 None 2025-09-27 18:24:39,470 - lava_callback - INFO - Completed processing callback for node 68d76ac0a6a7b6615d4c507f 2025-09-27 18:24:39,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:24:39,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732f6a6a7b6615d4c45cf/log.txt.gz 2025-09-27 18:24:39,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:24:39,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:24:39,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d732f6a6a7b6615d4c45cf/lava_callback.json.gz DEBUG: Setup failed for 68d732f6a6a7b6615d4c45cf. Transitting job node result: incomplete -> fail 2025-09-27 18:24:39,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:24:39,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d732f6a6a7b6615d4c45cf HTTP/1.1" 200 None 2025-09-27 18:24:39,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:24:39,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 18:24:39,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:24:39,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d732f6a6a7b6615d4c45cf HTTP/1.1" 200 None 2025-09-27 18:24:39,916 - lava_callback - INFO - Completed processing callback for node 68d732f6a6a7b6615d4c45cf INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:25:02,984 - lava_callback - INFO - Received callback for node 68d75030a6a7b6615d4c4d02 INFO: 172.21.0.1:39406 - "POST /node/68d75030a6a7b6615d4c4d02 HTTP/1.0" 202 Accepted 2025-09-27 18:25:02,991 - lava_callback - INFO - Starting async job submit for node 68d75030a6a7b6615d4c4d02 2025-09-27 18:25:03,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:03,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75030a6a7b6615d4c4d02 HTTP/1.1" 200 None 2025-09-27 18:25:03,040 - lava_callback - DEBUG - Processing node 68d75030a6a7b6615d4c4d02: baseline-arm64 2025-09-27 18:25:03,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:25:03,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:25:03,510 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75030a6a7b6615d4c4d02/log.txt.gz 2025-09-27 18:25:03,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:25:03,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:25:03,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75030a6a7b6615d4c4d02/lava_callback.json.gz 2025-09-27 18:25:03,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:03,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75030a6a7b6615d4c4d02 HTTP/1.1" 200 None 2025-09-27 18:25:03,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:03,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:25:03,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:03,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75030a6a7b6615d4c4d02 HTTP/1.1" 200 None 2025-09-27 18:25:03,701 - lava_callback - INFO - Completed processing callback for node 68d75030a6a7b6615d4c4d02 INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:25:32,074 - lava_callback - INFO - Received callback for node 68d75033a6a7b6615d4c4d05 INFO: 172.21.0.1:57348 - "POST /node/68d75033a6a7b6615d4c4d05 HTTP/1.0" 202 Accepted 2025-09-27 18:25:32,080 - lava_callback - INFO - Starting async job submit for node 68d75033a6a7b6615d4c4d05 2025-09-27 18:25:32,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:32,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75033a6a7b6615d4c4d05 HTTP/1.1" 200 None 2025-09-27 18:25:32,127 - lava_callback - DEBUG - Processing node 68d75033a6a7b6615d4c4d05: baseline-arm64 2025-09-27 18:25:32,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:25:32,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:25:32,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75033a6a7b6615d4c4d05/log.txt.gz 2025-09-27 18:25:32,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:25:32,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:25:32,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75033a6a7b6615d4c4d05/lava_callback.json.gz 2025-09-27 18:25:32,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:32,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75033a6a7b6615d4c4d05 HTTP/1.1" 200 None 2025-09-27 18:25:32,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:25:32,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:25:32,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:32,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75033a6a7b6615d4c4d05 HTTP/1.1" 200 None 2025-09-27 18:25:32,875 - lava_callback - INFO - Completed processing callback for node 68d75033a6a7b6615d4c4d05 INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:25:44,287 - lava_callback - INFO - Received callback for node 68d75033a6a7b6615d4c4d08 INFO: 172.21.0.1:45660 - "POST /node/68d75033a6a7b6615d4c4d08 HTTP/1.0" 202 Accepted 2025-09-27 18:25:44,294 - lava_callback - INFO - Starting async job submit for node 68d75033a6a7b6615d4c4d08 2025-09-27 18:25:44,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:44,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75033a6a7b6615d4c4d08 HTTP/1.1" 200 None 2025-09-27 18:25:44,375 - lava_callback - DEBUG - Processing node 68d75033a6a7b6615d4c4d08: baseline-arm64 2025-09-27 18:25:44,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:25:44,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:25:44,879 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75033a6a7b6615d4c4d08/log.txt.gz 2025-09-27 18:25:44,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:25:45,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:25:45,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75033a6a7b6615d4c4d08/lava_callback.json.gz 2025-09-27 18:25:45,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:45,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75033a6a7b6615d4c4d08 HTTP/1.1" 200 None 2025-09-27 18:25:45,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:45,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:25:45,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:45,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75033a6a7b6615d4c4d08 HTTP/1.1" 200 None 2025-09-27 18:25:45,122 - lava_callback - INFO - Completed processing callback for node 68d75033a6a7b6615d4c4d08 INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:25:54,428 - lava_callback - INFO - Received callback for node 68d82af11fd44e101337faea INFO: 172.21.0.1:35594 - "POST /node/68d82af11fd44e101337faea HTTP/1.0" 202 Accepted 2025-09-27 18:25:54,434 - lava_callback - INFO - Starting async job submit for node 68d82af11fd44e101337faea 2025-09-27 18:25:54,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:54,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82af11fd44e101337faea HTTP/1.1" 200 None 2025-09-27 18:25:54,488 - lava_callback - DEBUG - Processing node 68d82af11fd44e101337faea: baseline-arm64-broonie 2025-09-27 18:25:54,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:25:54,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:25:54,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d82af11fd44e101337faea/log.txt.gz 2025-09-27 18:25:54,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:25:54,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:25:54,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d82af11fd44e101337faea/lava_callback.json.gz 2025-09-27 18:25:54,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:54,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82af11fd44e101337faea HTTP/1.1" 200 None 2025-09-27 18:25:54,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:54,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 18:25:54,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:25:55,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82af11fd44e101337faea HTTP/1.1" 200 None 2025-09-27 18:25:55,013 - lava_callback - INFO - Completed processing callback for node 68d82af11fd44e101337faea INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:26:13,965 - lava_callback - INFO - Received callback for node 68d75036a6a7b6615d4c4d0b INFO: 172.21.0.1:42370 - "POST /node/68d75036a6a7b6615d4c4d0b HTTP/1.0" 202 Accepted 2025-09-27 18:26:13,971 - lava_callback - INFO - Starting async job submit for node 68d75036a6a7b6615d4c4d0b 2025-09-27 18:26:13,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:14,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75036a6a7b6615d4c4d0b HTTP/1.1" 200 None 2025-09-27 18:26:14,004 - lava_callback - DEBUG - Processing node 68d75036a6a7b6615d4c4d0b: baseline-arm64 2025-09-27 18:26:14,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:26:14,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:26:14,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75036a6a7b6615d4c4d0b/log.txt.gz 2025-09-27 18:26:14,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:26:14,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:26:14,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75036a6a7b6615d4c4d0b/lava_callback.json.gz 2025-09-27 18:26:14,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:14,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75036a6a7b6615d4c4d0b HTTP/1.1" 200 None 2025-09-27 18:26:14,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:14,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:26:14,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:14,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75036a6a7b6615d4c4d0b HTTP/1.1" 200 None 2025-09-27 18:26:14,720 - lava_callback - INFO - Completed processing callback for node 68d75036a6a7b6615d4c4d0b INFO: 172.21.0.1:42372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:26:53,648 - lava_callback - INFO - Received callback for node 68d76ac6a6a7b6615d4c508e INFO: 172.21.0.1:52282 - "POST /node/68d76ac6a6a7b6615d4c508e HTTP/1.0" 202 Accepted 2025-09-27 18:26:53,654 - lava_callback - INFO - Starting async job submit for node 68d76ac6a6a7b6615d4c508e 2025-09-27 18:26:53,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:53,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac6a6a7b6615d4c508e HTTP/1.1" 200 None 2025-09-27 18:26:53,708 - lava_callback - DEBUG - Processing node 68d76ac6a6a7b6615d4c508e: baseline-arm 2025-09-27 18:26:53,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:26:54,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:26:54,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac6a6a7b6615d4c508e/log.txt.gz 2025-09-27 18:26:54,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:26:54,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:26:54,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac6a6a7b6615d4c508e/lava_callback.json.gz 2025-09-27 18:26:54,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:54,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac6a6a7b6615d4c508e HTTP/1.1" 200 None 2025-09-27 18:26:54,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:54,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 18:26:54,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:54,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76ac6a6a7b6615d4c508e HTTP/1.1" 200 None 2025-09-27 18:26:54,317 - lava_callback - INFO - Completed processing callback for node 68d76ac6a6a7b6615d4c508e 2025-09-27 18:26:54,704 - lava_callback - INFO - Received callback for node 68d75039a6a7b6615d4c4d11 INFO: 172.21.0.1:52290 - "POST /node/68d75039a6a7b6615d4c4d11 HTTP/1.0" 202 Accepted 2025-09-27 18:26:54,710 - lava_callback - INFO - Starting async job submit for node 68d75039a6a7b6615d4c4d11 2025-09-27 18:26:54,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:54,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75039a6a7b6615d4c4d11 HTTP/1.1" 200 None 2025-09-27 18:26:54,749 - lava_callback - DEBUG - Processing node 68d75039a6a7b6615d4c4d11: baseline-arm64 2025-09-27 18:26:55,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:26:55,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:26:55,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75039a6a7b6615d4c4d11/log.txt.gz 2025-09-27 18:26:55,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:26:55,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:26:55,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75039a6a7b6615d4c4d11/lava_callback.json.gz 2025-09-27 18:26:55,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:55,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75039a6a7b6615d4c4d11 HTTP/1.1" 200 None 2025-09-27 18:26:55,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:55,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:26:55,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:26:55,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75039a6a7b6615d4c4d11 HTTP/1.1" 200 None 2025-09-27 18:26:55,427 - lava_callback - INFO - Completed processing callback for node 68d75039a6a7b6615d4c4d11 INFO: 172.21.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:27:08,215 - lava_callback - INFO - Received callback for node 68d5896b2be2da4660699ab6 INFO: 172.21.0.1:38708 - "POST /node/68d5896b2be2da4660699ab6 HTTP/1.0" 202 Accepted 2025-09-27 18:27:08,221 - lava_callback - INFO - Starting async job submit for node 68d5896b2be2da4660699ab6 2025-09-27 18:27:08,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:08,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5896b2be2da4660699ab6 HTTP/1.1" 200 None 2025-09-27 18:27:08,237 - lava_callback - DEBUG - Processing node 68d5896b2be2da4660699ab6: baseline-arm 2025-09-27 18:27:08,237 - lava_callback - ERROR - Error processing callback for node 68d5896b2be2da4660699ab6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:27:08,897 - lava_callback - INFO - Received callback for node 68d5896c2be2da4660699ab9 INFO: 172.21.0.1:38716 - "POST /node/68d5896c2be2da4660699ab9 HTTP/1.0" 202 Accepted 2025-09-27 18:27:08,903 - lava_callback - INFO - Starting async job submit for node 68d5896c2be2da4660699ab9 2025-09-27 18:27:08,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:08,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5896c2be2da4660699ab9 HTTP/1.1" 200 None 2025-09-27 18:27:08,916 - lava_callback - DEBUG - Processing node 68d5896c2be2da4660699ab9: baseline-arm 2025-09-27 18:27:08,916 - lava_callback - ERROR - Error processing callback for node 68d5896c2be2da4660699ab9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:27:09,574 - lava_callback - INFO - Received callback for node 68d5896d2be2da4660699abc INFO: 172.21.0.1:36718 - "POST /node/68d5896d2be2da4660699abc HTTP/1.0" 202 Accepted 2025-09-27 18:27:09,579 - lava_callback - INFO - Starting async job submit for node 68d5896d2be2da4660699abc 2025-09-27 18:27:09,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:09,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5896d2be2da4660699abc HTTP/1.1" 200 None 2025-09-27 18:27:09,618 - lava_callback - DEBUG - Processing node 68d5896d2be2da4660699abc: baseline-arm 2025-09-27 18:27:09,618 - lava_callback - ERROR - Error processing callback for node 68d5896d2be2da4660699abc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:36734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:27:36,716 - lava_callback - INFO - Received callback for node 68d75036a6a7b6615d4c4d0e INFO: 172.21.0.1:33672 - "POST /node/68d75036a6a7b6615d4c4d0e HTTP/1.0" 202 Accepted 2025-09-27 18:27:36,723 - lava_callback - INFO - Starting async job submit for node 68d75036a6a7b6615d4c4d0e 2025-09-27 18:27:36,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:36,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75036a6a7b6615d4c4d0e HTTP/1.1" 200 None 2025-09-27 18:27:36,767 - lava_callback - DEBUG - Processing node 68d75036a6a7b6615d4c4d0e: baseline-arm64 2025-09-27 18:27:37,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:27:37,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:27:37,342 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75036a6a7b6615d4c4d0e/log.txt.gz 2025-09-27 18:27:37,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:27:37,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:27:37,500 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75036a6a7b6615d4c4d0e/lava_callback.json.gz 2025-09-27 18:27:37,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:37,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75036a6a7b6615d4c4d0e HTTP/1.1" 200 None 2025-09-27 18:27:37,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:37,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:27:37,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:37,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75036a6a7b6615d4c4d0e HTTP/1.1" 200 None 2025-09-27 18:27:37,643 - lava_callback - INFO - Completed processing callback for node 68d75036a6a7b6615d4c4d0e 2025-09-27 18:27:43,263 - lava_callback - INFO - Received callback for node 68d7503aa6a7b6615d4c4d14 INFO: 172.21.0.1:58878 - "POST /node/68d7503aa6a7b6615d4c4d14 HTTP/1.0" 202 Accepted 2025-09-27 18:27:43,270 - lava_callback - INFO - Starting async job submit for node 68d7503aa6a7b6615d4c4d14 2025-09-27 18:27:43,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:43,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7503aa6a7b6615d4c4d14 HTTP/1.1" 200 None 2025-09-27 18:27:43,302 - lava_callback - DEBUG - Processing node 68d7503aa6a7b6615d4c4d14: baseline-arm64 2025-09-27 18:27:43,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:27:43,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:27:43,761 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7503aa6a7b6615d4c4d14/log.txt.gz 2025-09-27 18:27:43,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:27:43,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:27:43,879 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7503aa6a7b6615d4c4d14/lava_callback.json.gz 2025-09-27 18:27:43,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:43,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7503aa6a7b6615d4c4d14 HTTP/1.1" 200 None 2025-09-27 18:27:43,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:43,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:27:43,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:27:43,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7503aa6a7b6615d4c4d14 HTTP/1.1" 200 None 2025-09-27 18:27:43,955 - lava_callback - INFO - Completed processing callback for node 68d7503aa6a7b6615d4c4d14 INFO: 172.21.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:28:08,433 - lava_callback - INFO - Received callback for node 68d589ac2be2da4660699b18 INFO: 172.21.0.1:42504 - "POST /node/68d589ac2be2da4660699b18 HTTP/1.0" 202 Accepted 2025-09-27 18:28:08,444 - lava_callback - INFO - Starting async job submit for node 68d589ac2be2da4660699b18 2025-09-27 18:28:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:08,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589ac2be2da4660699b18 HTTP/1.1" 200 None 2025-09-27 18:28:08,465 - lava_callback - DEBUG - Processing node 68d589ac2be2da4660699b18: baseline-arm 2025-09-27 18:28:08,465 - lava_callback - ERROR - Error processing callback for node 68d589ac2be2da4660699b18: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:28:09,141 - lava_callback - INFO - Received callback for node 68d589ac2be2da4660699b1b INFO: 172.21.0.1:42520 - "POST /node/68d589ac2be2da4660699b1b HTTP/1.0" 202 Accepted 2025-09-27 18:28:09,146 - lava_callback - INFO - Starting async job submit for node 68d589ac2be2da4660699b1b 2025-09-27 18:28:09,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:09,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589ac2be2da4660699b1b HTTP/1.1" 200 None 2025-09-27 18:28:09,160 - lava_callback - DEBUG - Processing node 68d589ac2be2da4660699b1b: baseline-arm 2025-09-27 18:28:09,160 - lava_callback - ERROR - Error processing callback for node 68d589ac2be2da4660699b1b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:28:09,826 - lava_callback - INFO - Received callback for node 68d589ae2be2da4660699b1e INFO: 172.21.0.1:52590 - "POST /node/68d589ae2be2da4660699b1e HTTP/1.0" 202 Accepted 2025-09-27 18:28:09,832 - lava_callback - INFO - Starting async job submit for node 68d589ae2be2da4660699b1e 2025-09-27 18:28:09,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:09,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589ae2be2da4660699b1e HTTP/1.1" 200 None 2025-09-27 18:28:09,845 - lava_callback - DEBUG - Processing node 68d589ae2be2da4660699b1e: baseline-arm 2025-09-27 18:28:09,845 - lava_callback - ERROR - Error processing callback for node 68d589ae2be2da4660699b1e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:28:10,491 - lava_callback - INFO - Received callback for node 68d589ae2be2da4660699b21 INFO: 172.21.0.1:52598 - "POST /node/68d589ae2be2da4660699b21 HTTP/1.0" 202 Accepted 2025-09-27 18:28:10,498 - lava_callback - INFO - Starting async job submit for node 68d589ae2be2da4660699b21 2025-09-27 18:28:10,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:10,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589ae2be2da4660699b21 HTTP/1.1" 200 None 2025-09-27 18:28:10,511 - lava_callback - DEBUG - Processing node 68d589ae2be2da4660699b21: baseline-arm 2025-09-27 18:28:10,511 - lava_callback - ERROR - Error processing callback for node 68d589ae2be2da4660699b21: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:28:11,156 - lava_callback - INFO - Received callback for node 68d589b02be2da4660699b24 INFO: 172.21.0.1:52608 - "POST /node/68d589b02be2da4660699b24 HTTP/1.0" 202 Accepted 2025-09-27 18:28:11,165 - lava_callback - INFO - Starting async job submit for node 68d589b02be2da4660699b24 2025-09-27 18:28:11,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:11,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589b02be2da4660699b24 HTTP/1.1" 200 None 2025-09-27 18:28:11,180 - lava_callback - DEBUG - Processing node 68d589b02be2da4660699b24: baseline-arm 2025-09-27 18:28:11,180 - lava_callback - ERROR - Error processing callback for node 68d589b02be2da4660699b24: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:28:11,826 - lava_callback - INFO - Received callback for node 68d589b02be2da4660699b27 INFO: 172.21.0.1:52622 - "POST /node/68d589b02be2da4660699b27 HTTP/1.0" 202 Accepted 2025-09-27 18:28:11,833 - lava_callback - INFO - Starting async job submit for node 68d589b02be2da4660699b27 2025-09-27 18:28:11,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:11,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589b02be2da4660699b27 HTTP/1.1" 200 None 2025-09-27 18:28:11,868 - lava_callback - DEBUG - Processing node 68d589b02be2da4660699b27: baseline-arm 2025-09-27 18:28:11,868 - lava_callback - ERROR - Error processing callback for node 68d589b02be2da4660699b27: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:28:12,489 - lava_callback - INFO - Received callback for node 68d589b22be2da4660699b2a INFO: 172.21.0.1:52634 - "POST /node/68d589b22be2da4660699b2a HTTP/1.0" 202 Accepted 2025-09-27 18:28:12,495 - lava_callback - INFO - Starting async job submit for node 68d589b22be2da4660699b2a 2025-09-27 18:28:12,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:12,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589b22be2da4660699b2a HTTP/1.1" 200 None 2025-09-27 18:28:12,508 - lava_callback - DEBUG - Processing node 68d589b22be2da4660699b2a: baseline-arm 2025-09-27 18:28:12,508 - lava_callback - ERROR - Error processing callback for node 68d589b22be2da4660699b2a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 18:28:13,163 - lava_callback - INFO - Received callback for node 68d589b22be2da4660699b2d INFO: 172.21.0.1:52646 - "POST /node/68d589b22be2da4660699b2d HTTP/1.0" 202 Accepted 2025-09-27 18:28:13,169 - lava_callback - INFO - Starting async job submit for node 68d589b22be2da4660699b2d 2025-09-27 18:28:13,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:13,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d589b22be2da4660699b2d HTTP/1.1" 200 None 2025-09-27 18:28:13,183 - lava_callback - DEBUG - Processing node 68d589b22be2da4660699b2d: baseline-arm 2025-09-27 18:28:13,183 - lava_callback - ERROR - Error processing callback for node 68d589b22be2da4660699b2d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:52660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:28:43,307 - lava_callback - INFO - Received callback for node 68d7506ca6a7b6615d4c4d19 INFO: 172.21.0.1:48578 - "POST /node/68d7506ca6a7b6615d4c4d19 HTTP/1.0" 202 Accepted 2025-09-27 18:28:43,313 - lava_callback - INFO - Starting async job submit for node 68d7506ca6a7b6615d4c4d19 2025-09-27 18:28:43,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:43,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7506ca6a7b6615d4c4d19 HTTP/1.1" 200 None 2025-09-27 18:28:43,351 - lava_callback - DEBUG - Processing node 68d7506ca6a7b6615d4c4d19: baseline-arm64 2025-09-27 18:28:43,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:28:43,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:28:43,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7506ca6a7b6615d4c4d19/log.txt.gz 2025-09-27 18:28:43,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:28:43,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:28:43,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7506ca6a7b6615d4c4d19/lava_callback.json.gz 2025-09-27 18:28:44,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:44,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7506ca6a7b6615d4c4d19 HTTP/1.1" 200 None 2025-09-27 18:28:44,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:44,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:28:44,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:44,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7506ca6a7b6615d4c4d19 HTTP/1.1" 200 None 2025-09-27 18:28:44,091 - lava_callback - INFO - Completed processing callback for node 68d7506ca6a7b6615d4c4d19 INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:28:49,172 - lava_callback - INFO - Received callback for node 68d750e4a6a7b6615d4c4d2e INFO: 172.21.0.1:48592 - "POST /node/68d750e4a6a7b6615d4c4d2e HTTP/1.0" 202 Accepted 2025-09-27 18:28:49,178 - lava_callback - INFO - Starting async job submit for node 68d750e4a6a7b6615d4c4d2e 2025-09-27 18:28:49,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:49,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750e4a6a7b6615d4c4d2e HTTP/1.1" 200 None 2025-09-27 18:28:49,218 - lava_callback - DEBUG - Processing node 68d750e4a6a7b6615d4c4d2e: baseline-arm64 2025-09-27 18:28:49,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:28:49,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:28:49,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750e4a6a7b6615d4c4d2e/log.txt.gz 2025-09-27 18:28:49,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:28:49,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:28:49,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750e4a6a7b6615d4c4d2e/lava_callback.json.gz 2025-09-27 18:28:49,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:49,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750e4a6a7b6615d4c4d2e HTTP/1.1" 200 None 2025-09-27 18:28:49,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:49,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:28:49,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:49,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d750e4a6a7b6615d4c4d2e HTTP/1.1" 200 None 2025-09-27 18:28:49,855 - lava_callback - INFO - Completed processing callback for node 68d750e4a6a7b6615d4c4d2e 2025-09-27 18:28:54,876 - lava_callback - INFO - Received callback for node 68d7506ca6a7b6615d4c4d1c INFO: 172.21.0.1:43112 - "POST /node/68d7506ca6a7b6615d4c4d1c HTTP/1.0" 202 Accepted 2025-09-27 18:28:54,882 - lava_callback - INFO - Starting async job submit for node 68d7506ca6a7b6615d4c4d1c 2025-09-27 18:28:54,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:54,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7506ca6a7b6615d4c4d1c HTTP/1.1" 200 None 2025-09-27 18:28:54,921 - lava_callback - DEBUG - Processing node 68d7506ca6a7b6615d4c4d1c: baseline-arm64 2025-09-27 18:28:55,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:28:55,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:28:55,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7506ca6a7b6615d4c4d1c/log.txt.gz 2025-09-27 18:28:55,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:28:55,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:28:55,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7506ca6a7b6615d4c4d1c/lava_callback.json.gz 2025-09-27 18:28:55,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:55,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7506ca6a7b6615d4c4d1c HTTP/1.1" 200 None 2025-09-27 18:28:55,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:55,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 18:28:55,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:28:55,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7506ca6a7b6615d4c4d1c HTTP/1.1" 200 None 2025-09-27 18:28:55,617 - lava_callback - INFO - Completed processing callback for node 68d7506ca6a7b6615d4c4d1c INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:29:12,904 - lava_callback - INFO - Received callback for node 68d76ac7a6a7b6615d4c5091 INFO: 172.21.0.1:57430 - "POST /node/68d76ac7a6a7b6615d4c5091 HTTP/1.0" 202 Accepted 2025-09-27 18:29:12,911 - lava_callback - INFO - Starting async job submit for node 68d76ac7a6a7b6615d4c5091 2025-09-27 18:29:12,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:12,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac7a6a7b6615d4c5091 HTTP/1.1" 200 None 2025-09-27 18:29:12,948 - lava_callback - DEBUG - Processing node 68d76ac7a6a7b6615d4c5091: baseline-arm 2025-09-27 18:29:13,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:29:13,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:29:13,376 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac7a6a7b6615d4c5091/log.txt.gz 2025-09-27 18:29:13,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:29:13,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:29:13,518 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac7a6a7b6615d4c5091/lava_callback.json.gz 2025-09-27 18:29:13,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:13,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac7a6a7b6615d4c5091 HTTP/1.1" 200 None 2025-09-27 18:29:13,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:13,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 18:29:13,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:13,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76ac7a6a7b6615d4c5091 HTTP/1.1" 200 None 2025-09-27 18:29:13,600 - lava_callback - INFO - Completed processing callback for node 68d76ac7a6a7b6615d4c5091 INFO: 172.21.0.1:57434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:29:29,507 - lava_callback - INFO - Received callback for node 68d5a5fe2be2da466069a1be INFO: 172.21.0.1:40748 - "POST /node/68d5a5fe2be2da466069a1be HTTP/1.0" 202 Accepted 2025-09-27 18:29:29,516 - lava_callback - INFO - Starting async job submit for node 68d5a5fe2be2da466069a1be 2025-09-27 18:29:29,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:29,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5fe2be2da466069a1be HTTP/1.1" 200 None 2025-09-27 18:29:29,656 - lava_callback - DEBUG - Processing node 68d5a5fe2be2da466069a1be: ltp-cve 2025-09-27 18:29:30,608 - lava_callback - ERROR - Error processing callback for node 68d5a5fe2be2da466069a1be: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:29:57,328 - lava_callback - INFO - Received callback for node 68d750e5a6a7b6615d4c4d31 INFO: 172.21.0.1:47612 - "POST /node/68d750e5a6a7b6615d4c4d31 HTTP/1.0" 202 Accepted 2025-09-27 18:29:57,334 - lava_callback - INFO - Starting async job submit for node 68d750e5a6a7b6615d4c4d31 2025-09-27 18:29:57,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:57,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750e5a6a7b6615d4c4d31 HTTP/1.1" 200 None 2025-09-27 18:29:57,378 - lava_callback - DEBUG - Processing node 68d750e5a6a7b6615d4c4d31: baseline-arm64 INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:29:57,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:29:57,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:29:57,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750e5a6a7b6615d4c4d31/log.txt.gz 2025-09-27 18:29:57,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:29:57,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:29:57,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750e5a6a7b6615d4c4d31/lava_callback.json.gz 2025-09-27 18:29:58,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:58,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750e5a6a7b6615d4c4d31 HTTP/1.1" 200 None 2025-09-27 18:29:58,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:58,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:29:58,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:29:58,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d750e5a6a7b6615d4c4d31 HTTP/1.1" 200 None 2025-09-27 18:29:58,063 - lava_callback - INFO - Completed processing callback for node 68d750e5a6a7b6615d4c4d31 INFO: 172.21.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:30:17,865 - lava_callback - INFO - Received callback for node 68d750e8a6a7b6615d4c4d37 INFO: 172.21.0.1:33584 - "POST /node/68d750e8a6a7b6615d4c4d37 HTTP/1.0" 202 Accepted 2025-09-27 18:30:17,874 - lava_callback - INFO - Starting async job submit for node 68d750e8a6a7b6615d4c4d37 2025-09-27 18:30:17,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:30:17,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750e8a6a7b6615d4c4d37 HTTP/1.1" 200 None 2025-09-27 18:30:17,913 - lava_callback - DEBUG - Processing node 68d750e8a6a7b6615d4c4d37: baseline-arm64 2025-09-27 18:30:18,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:30:18,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:30:18,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750e8a6a7b6615d4c4d37/log.txt.gz 2025-09-27 18:30:18,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:30:18,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:30:18,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750e8a6a7b6615d4c4d37/lava_callback.json.gz 2025-09-27 18:30:18,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:30:18,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750e8a6a7b6615d4c4d37 HTTP/1.1" 200 None 2025-09-27 18:30:18,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:30:18,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:30:18,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:30:18,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d750e8a6a7b6615d4c4d37 HTTP/1.1" 200 None 2025-09-27 18:30:18,700 - lava_callback - INFO - Completed processing callback for node 68d750e8a6a7b6615d4c4d37 INFO: 172.21.0.1:39542 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:30:29,079 - lava_callback - INFO - Received callback for node 68d750e7a6a7b6615d4c4d34 INFO: 172.21.0.1:39558 - "POST /node/68d750e7a6a7b6615d4c4d34 HTTP/1.0" 202 Accepted 2025-09-27 18:30:29,085 - lava_callback - INFO - Starting async job submit for node 68d750e7a6a7b6615d4c4d34 2025-09-27 18:30:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:30:29,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750e7a6a7b6615d4c4d34 HTTP/1.1" 200 None 2025-09-27 18:30:29,118 - lava_callback - DEBUG - Processing node 68d750e7a6a7b6615d4c4d34: baseline-arm64 2025-09-27 18:30:29,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:30:29,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:30:29,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750e7a6a7b6615d4c4d34/log.txt.gz 2025-09-27 18:30:29,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:30:29,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:30:29,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750e7a6a7b6615d4c4d34/lava_callback.json.gz 2025-09-27 18:30:29,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:30:29,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750e7a6a7b6615d4c4d34 HTTP/1.1" 200 None 2025-09-27 18:30:29,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:30:29,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:30:29,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:30:29,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d750e7a6a7b6615d4c4d34 HTTP/1.1" 200 None 2025-09-27 18:30:29,778 - lava_callback - INFO - Completed processing callback for node 68d750e7a6a7b6615d4c4d34 INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 18:31:15,444 - lava_callback - INFO - Received callback for node 68d750eaa6a7b6615d4c4d3a INFO: 172.21.0.1:44410 - "POST /node/68d750eaa6a7b6615d4c4d3a HTTP/1.0" 202 Accepted 2025-09-27 18:31:15,450 - lava_callback - INFO - Starting async job submit for node 68d750eaa6a7b6615d4c4d3a 2025-09-27 18:31:15,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:15,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750eaa6a7b6615d4c4d3a HTTP/1.1" 200 None 2025-09-27 18:31:15,485 - lava_callback - DEBUG - Processing node 68d750eaa6a7b6615d4c4d3a: baseline-arm64 2025-09-27 18:31:15,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:31:16,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:31:16,007 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750eaa6a7b6615d4c4d3a/log.txt.gz 2025-09-27 18:31:16,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:31:16,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:31:16,150 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750eaa6a7b6615d4c4d3a/lava_callback.json.gz 2025-09-27 18:31:16,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:16,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750eaa6a7b6615d4c4d3a HTTP/1.1" 200 None 2025-09-27 18:31:16,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:16,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:31:16,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:16,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d750eaa6a7b6615d4c4d3a HTTP/1.1" 200 None 2025-09-27 18:31:16,246 - lava_callback - INFO - Completed processing callback for node 68d750eaa6a7b6615d4c4d3a INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:31:38,089 - lava_callback - INFO - Received callback for node 68d76ac8a6a7b6615d4c5094 INFO: 172.21.0.1:37672 - "POST /node/68d76ac8a6a7b6615d4c5094 HTTP/1.0" 202 Accepted 2025-09-27 18:31:38,095 - lava_callback - INFO - Starting async job submit for node 68d76ac8a6a7b6615d4c5094 2025-09-27 18:31:38,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:38,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac8a6a7b6615d4c5094 HTTP/1.1" 200 None 2025-09-27 18:31:38,130 - lava_callback - DEBUG - Processing node 68d76ac8a6a7b6615d4c5094: baseline-arm 2025-09-27 18:31:38,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:31:38,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:31:38,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac8a6a7b6615d4c5094/log.txt.gz 2025-09-27 18:31:38,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:31:38,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:31:38,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac8a6a7b6615d4c5094/lava_callback.json.gz 2025-09-27 18:31:38,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:38,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac8a6a7b6615d4c5094 HTTP/1.1" 200 None 2025-09-27 18:31:38,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:38,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 18:31:38,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:38,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76ac8a6a7b6615d4c5094 HTTP/1.1" 200 None 2025-09-27 18:31:38,725 - lava_callback - INFO - Completed processing callback for node 68d76ac8a6a7b6615d4c5094 2025-09-27 18:31:39,404 - lava_callback - INFO - Received callback for node 68d750eba6a7b6615d4c4d3d INFO: 172.21.0.1:40162 - "POST /node/68d750eba6a7b6615d4c4d3d HTTP/1.0" 202 Accepted 2025-09-27 18:31:39,410 - lava_callback - INFO - Starting async job submit for node 68d750eba6a7b6615d4c4d3d 2025-09-27 18:31:39,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:39,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750eba6a7b6615d4c4d3d HTTP/1.1" 200 None 2025-09-27 18:31:39,443 - lava_callback - DEBUG - Processing node 68d750eba6a7b6615d4c4d3d: baseline-arm64 2025-09-27 18:31:39,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:31:39,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:31:39,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750eba6a7b6615d4c4d3d/log.txt.gz 2025-09-27 18:31:39,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:31:40,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:31:40,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750eba6a7b6615d4c4d3d/lava_callback.json.gz 2025-09-27 18:31:40,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:40,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750eba6a7b6615d4c4d3d HTTP/1.1" 200 None 2025-09-27 18:31:40,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:40,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:31:40,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:40,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d750eba6a7b6615d4c4d3d HTTP/1.1" 200 None 2025-09-27 18:31:40,107 - lava_callback - INFO - Completed processing callback for node 68d750eba6a7b6615d4c4d3d 2025-09-27 18:31:45,813 - lava_callback - INFO - Received callback for node 68d750eea6a7b6615d4c4d40 INFO: 172.21.0.1:40168 - "POST /node/68d750eea6a7b6615d4c4d40 HTTP/1.0" 202 Accepted 2025-09-27 18:31:45,820 - lava_callback - INFO - Starting async job submit for node 68d750eea6a7b6615d4c4d40 2025-09-27 18:31:45,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:45,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750eea6a7b6615d4c4d40 HTTP/1.1" 200 None 2025-09-27 18:31:45,918 - lava_callback - DEBUG - Processing node 68d750eea6a7b6615d4c4d40: baseline-arm64 2025-09-27 18:31:46,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:31:46,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:31:46,616 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750eea6a7b6615d4c4d40/log.txt.gz 2025-09-27 18:31:46,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:31:46,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:31:46,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750eea6a7b6615d4c4d40/lava_callback.json.gz 2025-09-27 18:31:46,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:46,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750eea6a7b6615d4c4d40 HTTP/1.1" 200 None 2025-09-27 18:31:46,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:46,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:31:46,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:31:46,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d750eea6a7b6615d4c4d40 HTTP/1.1" 200 None 2025-09-27 18:31:46,919 - lava_callback - INFO - Completed processing callback for node 68d750eea6a7b6615d4c4d40 INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:32:09,457 - lava_callback - INFO - Received callback for node 68d5a6012be2da466069a1c4 INFO: 172.21.0.1:60118 - "POST /node/68d5a6012be2da466069a1c4 HTTP/1.0" 202 Accepted 2025-09-27 18:32:09,464 - lava_callback - INFO - Starting async job submit for node 68d5a6012be2da466069a1c4 2025-09-27 18:32:09,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:09,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a6012be2da466069a1c4 HTTP/1.1" 200 None 2025-09-27 18:32:09,585 - lava_callback - DEBUG - Processing node 68d5a6012be2da466069a1c4: ltp-fs-bind 2025-09-27 18:32:10,108 - lava_callback - ERROR - Error processing callback for node 68d5a6012be2da466069a1c4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:32:36,992 - lava_callback - INFO - Received callback for node 68d750eea6a7b6615d4c4d43 INFO: 172.21.0.1:50310 - "POST /node/68d750eea6a7b6615d4c4d43 HTTP/1.0" 202 Accepted 2025-09-27 18:32:36,998 - lava_callback - INFO - Starting async job submit for node 68d750eea6a7b6615d4c4d43 2025-09-27 18:32:37,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:37,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750eea6a7b6615d4c4d43 HTTP/1.1" 200 None 2025-09-27 18:32:37,054 - lava_callback - DEBUG - Processing node 68d750eea6a7b6615d4c4d43: baseline-arm64 2025-09-27 18:32:37,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:32:37,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:32:37,511 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750eea6a7b6615d4c4d43/log.txt.gz 2025-09-27 18:32:37,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:32:37,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:32:37,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d750eea6a7b6615d4c4d43/lava_callback.json.gz 2025-09-27 18:32:37,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:37,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d750eea6a7b6615d4c4d43 HTTP/1.1" 200 None 2025-09-27 18:32:37,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:37,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:32:37,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:37,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d750eea6a7b6615d4c4d43 HTTP/1.1" 200 None 2025-09-27 18:32:37,798 - lava_callback - INFO - Completed processing callback for node 68d750eea6a7b6615d4c4d43 INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:32:54,444 - lava_callback - INFO - Received callback for node 68d75121a6a7b6615d4c4d4d INFO: 172.21.0.1:38142 - "POST /node/68d75121a6a7b6615d4c4d4d HTTP/1.0" 202 Accepted 2025-09-27 18:32:54,450 - lava_callback - INFO - Starting async job submit for node 68d75121a6a7b6615d4c4d4d 2025-09-27 18:32:54,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:54,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75121a6a7b6615d4c4d4d HTTP/1.1" 200 None 2025-09-27 18:32:54,487 - lava_callback - DEBUG - Processing node 68d75121a6a7b6615d4c4d4d: baseline-arm64 2025-09-27 18:32:54,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:32:54,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:32:54,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75121a6a7b6615d4c4d4d/log.txt.gz 2025-09-27 18:32:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:32:55,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:32:55,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75121a6a7b6615d4c4d4d/lava_callback.json.gz 2025-09-27 18:32:55,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:55,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75121a6a7b6615d4c4d4d HTTP/1.1" 200 None 2025-09-27 18:32:55,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:55,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:32:55,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:32:55,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75121a6a7b6615d4c4d4d HTTP/1.1" 200 None 2025-09-27 18:32:55,236 - lava_callback - INFO - Completed processing callback for node 68d75121a6a7b6615d4c4d4d INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:33:01,096 - lava_callback - INFO - Received callback for node 68d5896a2be2da4660699ab3 INFO: 172.21.0.1:44996 - "POST /node/68d5896a2be2da4660699ab3 HTTP/1.0" 202 Accepted 2025-09-27 18:33:01,102 - lava_callback - INFO - Starting async job submit for node 68d5896a2be2da4660699ab3 2025-09-27 18:33:01,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:01,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5896a2be2da4660699ab3 HTTP/1.1" 200 None 2025-09-27 18:33:01,149 - lava_callback - DEBUG - Processing node 68d5896a2be2da4660699ab3: baseline-arm 2025-09-27 18:33:01,412 - lava_callback - ERROR - Error processing callback for node 68d5896a2be2da4660699ab3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:33:08,049 - lava_callback - INFO - Received callback for node 68d75120a6a7b6615d4c4d4a INFO: 172.21.0.1:45016 - "POST /node/68d75120a6a7b6615d4c4d4a HTTP/1.0" 202 Accepted 2025-09-27 18:33:08,056 - lava_callback - INFO - Starting async job submit for node 68d75120a6a7b6615d4c4d4a 2025-09-27 18:33:08,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:08,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75120a6a7b6615d4c4d4a HTTP/1.1" 200 None 2025-09-27 18:33:08,089 - lava_callback - DEBUG - Processing node 68d75120a6a7b6615d4c4d4a: baseline-arm64 2025-09-27 18:33:08,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:33:08,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:33:08,543 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75120a6a7b6615d4c4d4a/log.txt.gz 2025-09-27 18:33:08,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:33:08,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:33:08,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75120a6a7b6615d4c4d4a/lava_callback.json.gz 2025-09-27 18:33:08,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:08,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75120a6a7b6615d4c4d4a HTTP/1.1" 200 None 2025-09-27 18:33:08,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:08,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:33:08,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:08,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75120a6a7b6615d4c4d4a HTTP/1.1" 200 None 2025-09-27 18:33:08,756 - lava_callback - INFO - Completed processing callback for node 68d75120a6a7b6615d4c4d4a INFO: 172.21.0.1:52338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:33:54,244 - lava_callback - INFO - Received callback for node 68d75124a6a7b6615d4c4d50 INFO: 172.21.0.1:55468 - "POST /node/68d75124a6a7b6615d4c4d50 HTTP/1.0" 202 Accepted 2025-09-27 18:33:54,250 - lava_callback - INFO - Starting async job submit for node 68d75124a6a7b6615d4c4d50 2025-09-27 18:33:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:54,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75124a6a7b6615d4c4d50 HTTP/1.1" 200 None 2025-09-27 18:33:54,298 - lava_callback - DEBUG - Processing node 68d75124a6a7b6615d4c4d50: baseline-arm64 2025-09-27 18:33:54,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:33:54,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:33:54,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75124a6a7b6615d4c4d50/log.txt.gz 2025-09-27 18:33:54,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:33:54,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:33:54,872 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75124a6a7b6615d4c4d50/lava_callback.json.gz 2025-09-27 18:33:54,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:54,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75124a6a7b6615d4c4d50 HTTP/1.1" 200 None 2025-09-27 18:33:54,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:54,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:33:54,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:33:54,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75124a6a7b6615d4c4d50 HTTP/1.1" 200 None 2025-09-27 18:33:54,948 - lava_callback - INFO - Completed processing callback for node 68d75124a6a7b6615d4c4d50 INFO: 172.21.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:34:00,386 - lava_callback - INFO - Received callback for node 68d76ac9a6a7b6615d4c5097 INFO: 172.21.0.1:60546 - "POST /node/68d76ac9a6a7b6615d4c5097 HTTP/1.0" 202 Accepted 2025-09-27 18:34:00,392 - lava_callback - INFO - Starting async job submit for node 68d76ac9a6a7b6615d4c5097 2025-09-27 18:34:00,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:00,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac9a6a7b6615d4c5097 HTTP/1.1" 200 None 2025-09-27 18:34:00,425 - lava_callback - DEBUG - Processing node 68d76ac9a6a7b6615d4c5097: baseline-arm 2025-09-27 18:34:00,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:34:00,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:34:00,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac9a6a7b6615d4c5097/log.txt.gz 2025-09-27 18:34:00,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:34:00,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:34:00,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d76ac9a6a7b6615d4c5097/lava_callback.json.gz 2025-09-27 18:34:00,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:00,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76ac9a6a7b6615d4c5097 HTTP/1.1" 200 None 2025-09-27 18:34:00,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:00,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 18:34:00,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:01,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76ac9a6a7b6615d4c5097 HTTP/1.1" 200 None 2025-09-27 18:34:01,009 - lava_callback - INFO - Completed processing callback for node 68d76ac9a6a7b6615d4c5097 INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:34:17,729 - lava_callback - INFO - Received callback for node 68d75124a6a7b6615d4c4d53 INFO: 172.21.0.1:41298 - "POST /node/68d75124a6a7b6615d4c4d53 HTTP/1.0" 202 Accepted 2025-09-27 18:34:17,735 - lava_callback - INFO - Starting async job submit for node 68d75124a6a7b6615d4c4d53 2025-09-27 18:34:17,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:17,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75124a6a7b6615d4c4d53 HTTP/1.1" 200 None 2025-09-27 18:34:17,768 - lava_callback - DEBUG - Processing node 68d75124a6a7b6615d4c4d53: baseline-arm64 2025-09-27 18:34:18,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:34:18,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:34:18,243 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75124a6a7b6615d4c4d53/log.txt.gz 2025-09-27 18:34:18,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:34:18,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:34:18,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75124a6a7b6615d4c4d53/lava_callback.json.gz 2025-09-27 18:34:18,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:18,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75124a6a7b6615d4c4d53 HTTP/1.1" 200 None 2025-09-27 18:34:18,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:18,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:34:18,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:18,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75124a6a7b6615d4c4d53 HTTP/1.1" 200 None 2025-09-27 18:34:18,469 - lava_callback - INFO - Completed processing callback for node 68d75124a6a7b6615d4c4d53 INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:34:36,550 - lava_callback - INFO - Received callback for node 68d5a6032be2da466069a1c7 INFO: 172.21.0.1:51200 - "POST /node/68d5a6032be2da466069a1c7 HTTP/1.0" 202 Accepted 2025-09-27 18:34:36,557 - lava_callback - INFO - Starting async job submit for node 68d5a6032be2da466069a1c7 2025-09-27 18:34:36,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:36,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a6032be2da466069a1c7 HTTP/1.1" 200 None 2025-09-27 18:34:36,597 - lava_callback - DEBUG - Processing node 68d5a6032be2da466069a1c7: ltp-fsx 2025-09-27 18:34:36,971 - lava_callback - ERROR - Error processing callback for node 68d5a6032be2da466069a1c7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 18:34:44,863 - lava_callback - INFO - Received callback for node 68d75127a6a7b6615d4c4d56 INFO: 172.21.0.1:40248 - "POST /node/68d75127a6a7b6615d4c4d56 HTTP/1.0" 202 Accepted 2025-09-27 18:34:44,869 - lava_callback - INFO - Starting async job submit for node 68d75127a6a7b6615d4c4d56 2025-09-27 18:34:44,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:44,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75127a6a7b6615d4c4d56 HTTP/1.1" 200 None 2025-09-27 18:34:44,903 - lava_callback - DEBUG - Processing node 68d75127a6a7b6615d4c4d56: baseline-arm64 2025-09-27 18:34:45,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:34:45,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:34:45,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75127a6a7b6615d4c4d56/log.txt.gz 2025-09-27 18:34:45,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:34:45,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:34:45,469 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75127a6a7b6615d4c4d56/lava_callback.json.gz 2025-09-27 18:34:45,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:45,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75127a6a7b6615d4c4d56 HTTP/1.1" 200 None 2025-09-27 18:34:45,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:45,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:34:45,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:34:45,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75127a6a7b6615d4c4d56 HTTP/1.1" 200 None 2025-09-27 18:34:45,553 - lava_callback - INFO - Completed processing callback for node 68d75127a6a7b6615d4c4d56 INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:35:14,627 - lava_callback - INFO - Received callback for node 68d75127a6a7b6615d4c4d59 INFO: 172.21.0.1:37708 - "POST /node/68d75127a6a7b6615d4c4d59 HTTP/1.0" 202 Accepted 2025-09-27 18:35:14,633 - lava_callback - INFO - Starting async job submit for node 68d75127a6a7b6615d4c4d59 2025-09-27 18:35:14,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:14,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75127a6a7b6615d4c4d59 HTTP/1.1" 200 None 2025-09-27 18:35:14,708 - lava_callback - DEBUG - Processing node 68d75127a6a7b6615d4c4d59: baseline-arm64 2025-09-27 18:35:15,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37710 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 18:35:15,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:35:15,170 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75127a6a7b6615d4c4d59/log.txt.gz 2025-09-27 18:35:15,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:35:15,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:35:15,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75127a6a7b6615d4c4d59/lava_callback.json.gz 2025-09-27 18:35:15,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:15,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75127a6a7b6615d4c4d59 HTTP/1.1" 200 None 2025-09-27 18:35:15,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:15,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:35:15,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:15,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75127a6a7b6615d4c4d59 HTTP/1.1" 200 None 2025-09-27 18:35:15,404 - lava_callback - INFO - Completed processing callback for node 68d75127a6a7b6615d4c4d59 INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:35:37,468 - lava_callback - INFO - Received callback for node 68d7512ba6a7b6615d4c4d5c INFO: 172.21.0.1:34530 - "POST /node/68d7512ba6a7b6615d4c4d5c HTTP/1.0" 202 Accepted 2025-09-27 18:35:37,474 - lava_callback - INFO - Starting async job submit for node 68d7512ba6a7b6615d4c4d5c 2025-09-27 18:35:37,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:37,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7512ba6a7b6615d4c4d5c HTTP/1.1" 200 None 2025-09-27 18:35:37,508 - lava_callback - DEBUG - Processing node 68d7512ba6a7b6615d4c4d5c: baseline-arm64 2025-09-27 18:35:37,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:35:37,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:35:37,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7512ba6a7b6615d4c4d5c/log.txt.gz 2025-09-27 18:35:37,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:35:38,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:35:38,114 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7512ba6a7b6615d4c4d5c/lava_callback.json.gz 2025-09-27 18:35:38,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:38,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7512ba6a7b6615d4c4d5c HTTP/1.1" 200 None 2025-09-27 18:35:38,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:38,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:35:38,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:38,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7512ba6a7b6615d4c4d5c HTTP/1.1" 200 None 2025-09-27 18:35:38,200 - lava_callback - INFO - Completed processing callback for node 68d7512ba6a7b6615d4c4d5c 2025-09-27 18:35:45,078 - lava_callback - INFO - Received callback for node 68d7512ba6a7b6615d4c4d5f INFO: 172.21.0.1:41518 - "POST /node/68d7512ba6a7b6615d4c4d5f HTTP/1.0" 202 Accepted 2025-09-27 18:35:45,084 - lava_callback - INFO - Starting async job submit for node 68d7512ba6a7b6615d4c4d5f 2025-09-27 18:35:45,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:45,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7512ba6a7b6615d4c4d5f HTTP/1.1" 200 None 2025-09-27 18:35:45,118 - lava_callback - DEBUG - Processing node 68d7512ba6a7b6615d4c4d5f: baseline-arm64 2025-09-27 18:35:45,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:35:45,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:35:45,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7512ba6a7b6615d4c4d5f/log.txt.gz 2025-09-27 18:35:45,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:35:45,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:35:45,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7512ba6a7b6615d4c4d5f/lava_callback.json.gz 2025-09-27 18:35:45,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:45,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7512ba6a7b6615d4c4d5f HTTP/1.1" 200 None 2025-09-27 18:35:45,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:45,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 18:35:45,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:35:45,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7512ba6a7b6615d4c4d5f HTTP/1.1" 200 None 2025-09-27 18:35:45,764 - lava_callback - INFO - Completed processing callback for node 68d7512ba6a7b6615d4c4d5f INFO: 172.21.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:36:13,720 - lava_callback - INFO - Received callback for node 68d783dca6a7b6615d4c517f INFO: 172.21.0.1:52812 - "POST /node/68d783dca6a7b6615d4c517f HTTP/1.0" 202 Accepted 2025-09-27 18:36:13,726 - lava_callback - INFO - Starting async job submit for node 68d783dca6a7b6615d4c517f 2025-09-27 18:36:13,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:36:13,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d783dca6a7b6615d4c517f HTTP/1.1" 200 None 2025-09-27 18:36:13,759 - lava_callback - DEBUG - Processing node 68d783dca6a7b6615d4c517f: baseline-arm 2025-09-27 18:36:13,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:36:14,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:36:14,122 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d783dca6a7b6615d4c517f/log.txt.gz 2025-09-27 18:36:14,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:36:14,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:36:14,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d783dca6a7b6615d4c517f/lava_callback.json.gz 2025-09-27 18:36:14,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:36:14,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d783dca6a7b6615d4c517f HTTP/1.1" 200 None 2025-09-27 18:36:14,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:36:14,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 18:36:14,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:36:14,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d783dca6a7b6615d4c517f HTTP/1.1" 200 None 2025-09-27 18:36:14,325 - lava_callback - INFO - Completed processing callback for node 68d783dca6a7b6615d4c517f INFO: 172.21.0.1:52816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:36:29,633 - lava_callback - INFO - Received callback for node 68d5a6042be2da466069a1ca INFO: 172.21.0.1:46688 - "POST /node/68d5a6042be2da466069a1ca HTTP/1.0" 202 Accepted 2025-09-27 18:36:29,640 - lava_callback - INFO - Starting async job submit for node 68d5a6042be2da466069a1ca 2025-09-27 18:36:29,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:36:29,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a6042be2da466069a1ca HTTP/1.1" 200 None 2025-09-27 18:36:29,683 - lava_callback - DEBUG - Processing node 68d5a6042be2da466069a1ca: ltp-input 2025-09-27 18:36:30,084 - lava_callback - ERROR - Error processing callback for node 68d5a6042be2da466069a1ca: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:38:33,844 - lava_callback - INFO - Received callback for node 68d5a6062be2da466069a1cd INFO: 172.21.0.1:47508 - "POST /node/68d5a6062be2da466069a1cd HTTP/1.0" 202 Accepted 2025-09-27 18:38:33,851 - lava_callback - INFO - Starting async job submit for node 68d5a6062be2da466069a1cd 2025-09-27 18:38:33,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:38:33,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a6062be2da466069a1cd HTTP/1.1" 200 None 2025-09-27 18:38:33,898 - lava_callback - DEBUG - Processing node 68d5a6062be2da466069a1cd: ltp-ipc 2025-09-27 18:38:34,233 - lava_callback - ERROR - Error processing callback for node 68d5a6062be2da466069a1cd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47522 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:38:37,346 - lava_callback - INFO - Received callback for node 68d783dda6a7b6615d4c5194 INFO: 172.21.0.1:47536 - "POST /node/68d783dda6a7b6615d4c5194 HTTP/1.0" 202 Accepted 2025-09-27 18:38:37,352 - lava_callback - INFO - Starting async job submit for node 68d783dda6a7b6615d4c5194 2025-09-27 18:38:37,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:38:37,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d783dda6a7b6615d4c5194 HTTP/1.1" 200 None 2025-09-27 18:38:37,398 - lava_callback - DEBUG - Processing node 68d783dda6a7b6615d4c5194: baseline-arm 2025-09-27 18:38:37,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:38:37,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:38:37,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d783dda6a7b6615d4c5194/log.txt.gz 2025-09-27 18:38:37,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:38:37,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:38:37,929 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d783dda6a7b6615d4c5194/lava_callback.json.gz 2025-09-27 18:38:37,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:38:37,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d783dda6a7b6615d4c5194 HTTP/1.1" 200 None 2025-09-27 18:38:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:38:37,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 18:38:37,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:38:38,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d783dda6a7b6615d4c5194 HTTP/1.1" 200 None 2025-09-27 18:38:38,019 - lava_callback - INFO - Completed processing callback for node 68d783dda6a7b6615d4c5194 INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:40:59,031 - lava_callback - INFO - Received callback for node 68d783e1a6a7b6615d4c519d INFO: 172.21.0.1:38454 - "POST /node/68d783e1a6a7b6615d4c519d HTTP/1.0" 202 Accepted 2025-09-27 18:40:59,037 - lava_callback - INFO - Starting async job submit for node 68d783e1a6a7b6615d4c519d 2025-09-27 18:40:59,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:40:59,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d783e1a6a7b6615d4c519d HTTP/1.1" 200 None 2025-09-27 18:40:59,071 - lava_callback - DEBUG - Processing node 68d783e1a6a7b6615d4c519d: baseline-arm 2025-09-27 18:40:59,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:40:59,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:40:59,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d783e1a6a7b6615d4c519d/log.txt.gz 2025-09-27 18:40:59,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:40:59,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:40:59,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d783e1a6a7b6615d4c519d/lava_callback.json.gz 2025-09-27 18:40:59,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:40:59,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d783e1a6a7b6615d4c519d HTTP/1.1" 200 None 2025-09-27 18:40:59,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:40:59,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 18:40:59,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:40:59,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d783e1a6a7b6615d4c519d HTTP/1.1" 200 None 2025-09-27 18:40:59,704 - lava_callback - INFO - Completed processing callback for node 68d783e1a6a7b6615d4c519d INFO: 172.21.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:43:18,400 - lava_callback - INFO - Received callback for node 68d783e2a6a7b6615d4c51a0 INFO: 172.21.0.1:40002 - "POST /node/68d783e2a6a7b6615d4c51a0 HTTP/1.0" 202 Accepted 2025-09-27 18:43:18,406 - lava_callback - INFO - Starting async job submit for node 68d783e2a6a7b6615d4c51a0 2025-09-27 18:43:18,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:43:18,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d783e2a6a7b6615d4c51a0 HTTP/1.1" 200 None 2025-09-27 18:43:18,440 - lava_callback - DEBUG - Processing node 68d783e2a6a7b6615d4c51a0: baseline-arm 2025-09-27 18:43:18,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:43:18,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:43:18,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d783e2a6a7b6615d4c51a0/log.txt.gz 2025-09-27 18:43:18,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:43:18,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:43:18,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d783e2a6a7b6615d4c51a0/lava_callback.json.gz 2025-09-27 18:43:19,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:43:19,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d783e2a6a7b6615d4c51a0 HTTP/1.1" 200 None 2025-09-27 18:43:19,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:43:19,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 18:43:19,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:43:19,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d783e2a6a7b6615d4c51a0 HTTP/1.1" 200 None 2025-09-27 18:43:19,091 - lava_callback - INFO - Completed processing callback for node 68d783e2a6a7b6615d4c51a0 INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46648 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:45:39,298 - lava_callback - INFO - Received callback for node 68d7881aa6a7b6615d4c5239 INFO: 172.21.0.1:46650 - "POST /node/68d7881aa6a7b6615d4c5239 HTTP/1.0" 202 Accepted 2025-09-27 18:45:39,304 - lava_callback - INFO - Starting async job submit for node 68d7881aa6a7b6615d4c5239 2025-09-27 18:45:39,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:45:39,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7881aa6a7b6615d4c5239 HTTP/1.1" 200 None 2025-09-27 18:45:39,468 - lava_callback - DEBUG - Processing node 68d7881aa6a7b6615d4c5239: baseline-arm 2025-09-27 18:45:39,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:45:39,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:45:39,843 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7881aa6a7b6615d4c5239/log.txt.gz 2025-09-27 18:45:39,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:45:39,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:45:39,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7881aa6a7b6615d4c5239/lava_callback.json.gz 2025-09-27 18:45:40,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:45:40,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7881aa6a7b6615d4c5239 HTTP/1.1" 200 None 2025-09-27 18:45:40,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:45:40,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 18:45:40,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:45:40,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7881aa6a7b6615d4c5239 HTTP/1.1" 200 None 2025-09-27 18:45:40,093 - lava_callback - INFO - Completed processing callback for node 68d7881aa6a7b6615d4c5239 INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43386 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:47:50,034 - lava_callback - INFO - Received callback for node 68d5a6092be2da466069a1d3 INFO: 172.21.0.1:40100 - "POST /node/68d5a6092be2da466069a1d3 HTTP/1.0" 202 Accepted 2025-09-27 18:47:50,041 - lava_callback - INFO - Starting async job submit for node 68d5a6092be2da466069a1d3 2025-09-27 18:47:50,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:47:50,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a6092be2da466069a1d3 HTTP/1.1" 200 None 2025-09-27 18:47:50,087 - lava_callback - DEBUG - Processing node 68d5a6092be2da466069a1d3: ltp-sched 2025-09-27 18:47:50,579 - lava_callback - ERROR - Error processing callback for node 68d5a6092be2da466069a1d3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 18:47:54,543 - lava_callback - INFO - Received callback for node 68d7881ba6a7b6615d4c523c INFO: 172.21.0.1:40108 - "POST /node/68d7881ba6a7b6615d4c523c HTTP/1.0" 202 Accepted 2025-09-27 18:47:54,549 - lava_callback - INFO - Starting async job submit for node 68d7881ba6a7b6615d4c523c 2025-09-27 18:47:54,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:47:54,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7881ba6a7b6615d4c523c HTTP/1.1" 200 None 2025-09-27 18:47:54,583 - lava_callback - DEBUG - Processing node 68d7881ba6a7b6615d4c523c: baseline-arm 2025-09-27 18:47:54,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:47:54,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:47:54,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7881ba6a7b6615d4c523c/log.txt.gz 2025-09-27 18:47:54,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:47:55,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:47:55,047 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7881ba6a7b6615d4c523c/lava_callback.json.gz 2025-09-27 18:47:55,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:47:55,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7881ba6a7b6615d4c523c HTTP/1.1" 200 None 2025-09-27 18:47:55,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:47:55,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 18:47:55,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:47:55,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7881ba6a7b6615d4c523c HTTP/1.1" 200 None 2025-09-27 18:47:55,121 - lava_callback - INFO - Completed processing callback for node 68d7881ba6a7b6615d4c523c INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49130 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:48:13,927 - lava_callback - INFO - Received callback for node 68d5a6082be2da466069a1d0 INFO: 172.21.0.1:39340 - "POST /node/68d5a6082be2da466069a1d0 HTTP/1.0" 202 Accepted 2025-09-27 18:48:13,936 - lava_callback - INFO - Starting async job submit for node 68d5a6082be2da466069a1d0 2025-09-27 18:48:14,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:48:14,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a6082be2da466069a1d0 HTTP/1.1" 200 None 2025-09-27 18:48:14,028 - lava_callback - DEBUG - Processing node 68d5a6082be2da466069a1d0: ltp-pty 2025-09-27 18:48:14,673 - lava_callback - ERROR - Error processing callback for node 68d5a6082be2da466069a1d0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:50:20,043 - lava_callback - INFO - Received callback for node 68d7881fa6a7b6615d4c5245 INFO: 172.21.0.1:48790 - "POST /node/68d7881fa6a7b6615d4c5245 HTTP/1.0" 202 Accepted 2025-09-27 18:50:20,050 - lava_callback - INFO - Starting async job submit for node 68d7881fa6a7b6615d4c5245 2025-09-27 18:50:20,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:50:20,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7881fa6a7b6615d4c5245 HTTP/1.1" 200 None 2025-09-27 18:50:20,092 - lava_callback - DEBUG - Processing node 68d7881fa6a7b6615d4c5245: baseline-arm 2025-09-27 18:50:20,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:50:20,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:50:20,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7881fa6a7b6615d4c5245/log.txt.gz 2025-09-27 18:50:20,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:50:20,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:50:20,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7881fa6a7b6615d4c5245/lava_callback.json.gz 2025-09-27 18:50:20,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:50:20,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7881fa6a7b6615d4c5245 HTTP/1.1" 200 None 2025-09-27 18:50:20,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:50:20,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 18:50:20,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:50:20,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7881fa6a7b6615d4c5245 HTTP/1.1" 200 None 2025-09-27 18:50:20,704 - lava_callback - INFO - Completed processing callback for node 68d7881fa6a7b6615d4c5245 INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:52:38,446 - lava_callback - INFO - Received callback for node 68d7881fa6a7b6615d4c5248 INFO: 172.21.0.1:48088 - "POST /node/68d7881fa6a7b6615d4c5248 HTTP/1.0" 202 Accepted 2025-09-27 18:52:38,452 - lava_callback - INFO - Starting async job submit for node 68d7881fa6a7b6615d4c5248 2025-09-27 18:52:38,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:52:38,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7881fa6a7b6615d4c5248 HTTP/1.1" 200 None 2025-09-27 18:52:38,494 - lava_callback - DEBUG - Processing node 68d7881fa6a7b6615d4c5248: baseline-arm 2025-09-27 18:52:38,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:52:38,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:52:38,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7881fa6a7b6615d4c5248/log.txt.gz 2025-09-27 18:52:38,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:52:39,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:52:39,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7881fa6a7b6615d4c5248/lava_callback.json.gz 2025-09-27 18:52:39,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:52:39,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7881fa6a7b6615d4c5248 HTTP/1.1" 200 None 2025-09-27 18:52:39,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:52:39,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 18:52:39,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:52:39,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7881fa6a7b6615d4c5248 HTTP/1.1" 200 None 2025-09-27 18:52:39,115 - lava_callback - INFO - Completed processing callback for node 68d7881fa6a7b6615d4c5248 INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:52:41,969 - lava_callback - INFO - Received callback for node 68d5a5a02be2da466069a12e INFO: 172.21.0.1:38922 - "POST /node/68d5a5a02be2da466069a12e HTTP/1.0" 202 Accepted 2025-09-27 18:52:41,975 - lava_callback - INFO - Starting async job submit for node 68d5a5a02be2da466069a12e 2025-09-27 18:52:42,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:52:42,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5a02be2da466069a12e HTTP/1.1" 200 None 2025-09-27 18:52:42,038 - lava_callback - DEBUG - Processing node 68d5a5a02be2da466069a12e: baseline-arm 2025-09-27 18:52:42,335 - lava_callback - ERROR - Error processing callback for node 68d5a5a02be2da466069a12e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:53:11,524 - lava_callback - INFO - Received callback for node 68d5a60d2be2da466069a1d9 INFO: 172.21.0.1:55852 - "POST /node/68d5a60d2be2da466069a1d9 HTTP/1.0" 202 Accepted 2025-09-27 18:53:11,545 - lava_callback - INFO - Starting async job submit for node 68d5a60d2be2da466069a1d9 2025-09-27 18:53:12,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:53:12,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a60d2be2da466069a1d9 HTTP/1.1" 200 None 2025-09-27 18:53:12,923 - lava_callback - DEBUG - Processing node 68d5a60d2be2da466069a1d9: ltp-syscalls INFO: 172.21.0.1:55856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:53:19,654 - lava_callback - ERROR - Error processing callback for node 68d5a60d2be2da466069a1d9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55614 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:54:59,704 - lava_callback - INFO - Received callback for node 68d7a00d8dd6b39fd1aea344 INFO: 172.21.0.1:59908 - "POST /node/68d7a00d8dd6b39fd1aea344 HTTP/1.0" 202 Accepted 2025-09-27 18:54:59,710 - lava_callback - INFO - Starting async job submit for node 68d7a00d8dd6b39fd1aea344 2025-09-27 18:54:59,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:54:59,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a00d8dd6b39fd1aea344 HTTP/1.1" 200 None 2025-09-27 18:54:59,744 - lava_callback - DEBUG - Processing node 68d7a00d8dd6b39fd1aea344: baseline-arm 2025-09-27 18:54:59,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:55:00,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:55:00,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a00d8dd6b39fd1aea344/log.txt.gz 2025-09-27 18:55:00,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:55:00,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:55:00,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a00d8dd6b39fd1aea344/lava_callback.json.gz 2025-09-27 18:55:00,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:55:00,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a00d8dd6b39fd1aea344 HTTP/1.1" 200 None 2025-09-27 18:55:00,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:55:00,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-27 18:55:00,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:55:00,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a00d8dd6b39fd1aea344 HTTP/1.1" 200 None 2025-09-27 18:55:00,358 - lava_callback - INFO - Completed processing callback for node 68d7a00d8dd6b39fd1aea344 INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:55:30,561 - lava_callback - INFO - Received callback for node 68d5a60b2be2da466069a1d6 INFO: 172.21.0.1:57434 - "POST /node/68d5a60b2be2da466069a1d6 HTTP/1.0" 202 Accepted 2025-09-27 18:55:30,568 - lava_callback - INFO - Starting async job submit for node 68d5a60b2be2da466069a1d6 2025-09-27 18:55:30,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:55:30,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a60b2be2da466069a1d6 HTTP/1.1" 200 None 2025-09-27 18:55:30,616 - lava_callback - DEBUG - Processing node 68d5a60b2be2da466069a1d6: ltp-smoketest 2025-09-27 18:55:31,047 - lava_callback - ERROR - Error processing callback for node 68d5a60b2be2da466069a1d6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:55:49,747 - lava_callback - INFO - Received callback for node 68d756c3a6a7b6615d4c4d8a INFO: 172.21.0.1:46398 - "POST /node/68d756c3a6a7b6615d4c4d8a HTTP/1.0" 202 Accepted 2025-09-27 18:55:49,754 - lava_callback - INFO - Starting async job submit for node 68d756c3a6a7b6615d4c4d8a 2025-09-27 18:55:49,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:55:49,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756c3a6a7b6615d4c4d8a HTTP/1.1" 200 None 2025-09-27 18:55:49,812 - lava_callback - DEBUG - Processing node 68d756c3a6a7b6615d4c4d8a: baseline-arm64 2025-09-27 18:55:50,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:55:50,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:55:50,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756c3a6a7b6615d4c4d8a/log.txt.gz 2025-09-27 18:55:50,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:55:50,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:55:50,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756c3a6a7b6615d4c4d8a/lava_callback.json.gz DEBUG: Setup failed for 68d756c3a6a7b6615d4c4d8a. Transitting job node result: incomplete -> fail 2025-09-27 18:55:51,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:55:51,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756c3a6a7b6615d4c4d8a HTTP/1.1" 200 None 2025-09-27 18:55:51,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:55:51,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 18:55:51,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:55:51,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d756c3a6a7b6615d4c4d8a HTTP/1.1" 200 None 2025-09-27 18:55:51,128 - lava_callback - INFO - Completed processing callback for node 68d756c3a6a7b6615d4c4d8a INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:56:00,363 - lava_callback - INFO - Received callback for node 68d756c6a6a7b6615d4c4d90 INFO: 172.21.0.1:38224 - "POST /node/68d756c6a6a7b6615d4c4d90 HTTP/1.0" 202 Accepted 2025-09-27 18:56:00,371 - lava_callback - INFO - Starting async job submit for node 68d756c6a6a7b6615d4c4d90 2025-09-27 18:56:00,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:56:00,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756c6a6a7b6615d4c4d90 HTTP/1.1" 200 None 2025-09-27 18:56:00,434 - lava_callback - DEBUG - Processing node 68d756c6a6a7b6615d4c4d90: baseline-arm64 2025-09-27 18:56:01,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:56:01,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:56:01,437 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756c6a6a7b6615d4c4d90/log.txt.gz 2025-09-27 18:56:01,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:56:01,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:56:01,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756c6a6a7b6615d4c4d90/lava_callback.json.gz DEBUG: Setup failed for 68d756c6a6a7b6615d4c4d90. Transitting job node result: incomplete -> fail 2025-09-27 18:56:01,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:56:01,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756c6a6a7b6615d4c4d90 HTTP/1.1" 200 None 2025-09-27 18:56:01,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:56:01,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 18:56:01,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:56:01,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d756c6a6a7b6615d4c4d90 HTTP/1.1" 200 None 2025-09-27 18:56:01,786 - lava_callback - INFO - Completed processing callback for node 68d756c6a6a7b6615d4c4d90 INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:56:09,690 - lava_callback - INFO - Received callback for node 68d756c4a6a7b6615d4c4d8d INFO: 172.21.0.1:57724 - "POST /node/68d756c4a6a7b6615d4c4d8d HTTP/1.0" 202 Accepted 2025-09-27 18:56:09,698 - lava_callback - INFO - Starting async job submit for node 68d756c4a6a7b6615d4c4d8d 2025-09-27 18:56:09,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:56:09,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756c4a6a7b6615d4c4d8d HTTP/1.1" 200 None 2025-09-27 18:56:09,757 - lava_callback - DEBUG - Processing node 68d756c4a6a7b6615d4c4d8d: baseline-arm64 2025-09-27 18:56:10,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:56:10,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:56:10,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756c4a6a7b6615d4c4d8d/log.txt.gz 2025-09-27 18:56:10,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:56:10,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:56:10,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756c4a6a7b6615d4c4d8d/lava_callback.json.gz DEBUG: Setup failed for 68d756c4a6a7b6615d4c4d8d. Transitting job node result: incomplete -> fail 2025-09-27 18:56:11,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:56:11,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756c4a6a7b6615d4c4d8d HTTP/1.1" 200 None 2025-09-27 18:56:11,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:56:11,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 18:56:11,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:56:11,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d756c4a6a7b6615d4c4d8d HTTP/1.1" 200 None 2025-09-27 18:56:11,132 - lava_callback - INFO - Completed processing callback for node 68d756c4a6a7b6615d4c4d8d INFO: 172.21.0.1:57738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:57:20,254 - lava_callback - INFO - Received callback for node 68d7a00e8dd6b39fd1aea347 INFO: 172.21.0.1:43830 - "POST /node/68d7a00e8dd6b39fd1aea347 HTTP/1.0" 202 Accepted 2025-09-27 18:57:20,261 - lava_callback - INFO - Starting async job submit for node 68d7a00e8dd6b39fd1aea347 2025-09-27 18:57:20,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:57:20,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a00e8dd6b39fd1aea347 HTTP/1.1" 200 None 2025-09-27 18:57:20,296 - lava_callback - DEBUG - Processing node 68d7a00e8dd6b39fd1aea347: baseline-arm 2025-09-27 18:57:20,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:57:20,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:57:20,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a00e8dd6b39fd1aea347/log.txt.gz 2025-09-27 18:57:20,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:57:20,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:57:20,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a00e8dd6b39fd1aea347/lava_callback.json.gz 2025-09-27 18:57:20,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:57:20,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a00e8dd6b39fd1aea347 HTTP/1.1" 200 None 2025-09-27 18:57:20,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:57:20,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-27 18:57:20,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:57:20,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a00e8dd6b39fd1aea347 HTTP/1.1" 200 None 2025-09-27 18:57:20,922 - lava_callback - INFO - Completed processing callback for node 68d7a00e8dd6b39fd1aea347 INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK 2025-09-27 18:59:34,448 - lava_callback - INFO - Received callback for node 68d7a1f38dd6b39fd1aea72e INFO: 172.21.0.1:42676 - "POST /node/68d7a1f38dd6b39fd1aea72e HTTP/1.0" 202 Accepted 2025-09-27 18:59:34,453 - lava_callback - INFO - Starting async job submit for node 68d7a1f38dd6b39fd1aea72e 2025-09-27 18:59:34,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:59:34,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1f38dd6b39fd1aea72e HTTP/1.1" 200 None 2025-09-27 18:59:34,485 - lava_callback - DEBUG - Processing node 68d7a1f38dd6b39fd1aea72e: baseline-arm 2025-09-27 18:59:34,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:59:34,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:59:34,848 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a1f38dd6b39fd1aea72e/log.txt.gz 2025-09-27 18:59:34,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 18:59:34,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 18:59:34,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a1f38dd6b39fd1aea72e/lava_callback.json.gz 2025-09-27 18:59:35,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:59:35,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1f38dd6b39fd1aea72e HTTP/1.1" 200 None 2025-09-27 18:59:35,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:59:35,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 18:59:35,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 18:59:35,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a1f38dd6b39fd1aea72e HTTP/1.1" 200 None 2025-09-27 18:59:35,070 - lava_callback - INFO - Completed processing callback for node 68d7a1f38dd6b39fd1aea72e INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:01:59,231 - lava_callback - INFO - Received callback for node 68d7a1f68dd6b39fd1aea73a INFO: 172.21.0.1:42562 - "POST /node/68d7a1f68dd6b39fd1aea73a HTTP/1.0" 202 Accepted 2025-09-27 19:01:59,237 - lava_callback - INFO - Starting async job submit for node 68d7a1f68dd6b39fd1aea73a 2025-09-27 19:01:59,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:01:59,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1f68dd6b39fd1aea73a HTTP/1.1" 200 None 2025-09-27 19:01:59,270 - lava_callback - DEBUG - Processing node 68d7a1f68dd6b39fd1aea73a: baseline-arm 2025-09-27 19:01:59,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:01:59,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:01:59,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a1f68dd6b39fd1aea73a/log.txt.gz 2025-09-27 19:01:59,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:01:59,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:01:59,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a1f68dd6b39fd1aea73a/lava_callback.json.gz 2025-09-27 19:01:59,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:01:59,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1f68dd6b39fd1aea73a HTTP/1.1" 200 None 2025-09-27 19:01:59,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:01:59,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 19:01:59,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:01:59,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a1f68dd6b39fd1aea73a HTTP/1.1" 200 None 2025-09-27 19:01:59,842 - lava_callback - INFO - Completed processing callback for node 68d7a1f68dd6b39fd1aea73a INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:04:19,923 - lava_callback - INFO - Received callback for node 68d7a3678dd6b39fd1aea888 INFO: 172.21.0.1:52266 - "POST /node/68d7a3678dd6b39fd1aea888 HTTP/1.0" 202 Accepted 2025-09-27 19:04:19,929 - lava_callback - INFO - Starting async job submit for node 68d7a3678dd6b39fd1aea888 2025-09-27 19:04:19,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:04:19,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a3678dd6b39fd1aea888 HTTP/1.1" 200 None 2025-09-27 19:04:19,966 - lava_callback - DEBUG - Processing node 68d7a3678dd6b39fd1aea888: baseline-arm 2025-09-27 19:04:20,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:04:20,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:04:20,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a3678dd6b39fd1aea888/log.txt.gz 2025-09-27 19:04:20,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:04:20,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:04:20,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a3678dd6b39fd1aea888/lava_callback.json.gz 2025-09-27 19:04:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:04:20,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a3678dd6b39fd1aea888 HTTP/1.1" 200 None 2025-09-27 19:04:20,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:04:20,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-27 19:04:20,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:04:20,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a3678dd6b39fd1aea888 HTTP/1.1" 200 None 2025-09-27 19:04:20,661 - lava_callback - INFO - Completed processing callback for node 68d7a3678dd6b39fd1aea888 INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:06:30,693 - lava_callback - INFO - Received callback for node 68d5a6102be2da466069a1df INFO: 172.21.0.1:43502 - "POST /node/68d5a6102be2da466069a1df HTTP/1.0" 202 Accepted 2025-09-27 19:06:30,699 - lava_callback - INFO - Starting async job submit for node 68d5a6102be2da466069a1df 2025-09-27 19:06:30,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:06:30,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a6102be2da466069a1df HTTP/1.1" 200 None 2025-09-27 19:06:30,810 - lava_callback - DEBUG - Processing node 68d5a6102be2da466069a1df: ltp-timers 2025-09-27 19:06:31,135 - lava_callback - ERROR - Error processing callback for node 68d5a6102be2da466069a1df: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43514 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:06:42,045 - lava_callback - INFO - Received callback for node 68d7a3688dd6b39fd1aea894 INFO: 172.21.0.1:43680 - "POST /node/68d7a3688dd6b39fd1aea894 HTTP/1.0" 202 Accepted 2025-09-27 19:06:42,052 - lava_callback - INFO - Starting async job submit for node 68d7a3688dd6b39fd1aea894 2025-09-27 19:06:42,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:06:42,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a3688dd6b39fd1aea894 HTTP/1.1" 200 None 2025-09-27 19:06:42,088 - lava_callback - DEBUG - Processing node 68d7a3688dd6b39fd1aea894: baseline-arm 2025-09-27 19:06:42,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:06:42,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:06:42,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a3688dd6b39fd1aea894/log.txt.gz 2025-09-27 19:06:42,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:06:42,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:06:42,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a3688dd6b39fd1aea894/lava_callback.json.gz 2025-09-27 19:06:42,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:06:42,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a3688dd6b39fd1aea894 HTTP/1.1" 200 None 2025-09-27 19:06:42,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:06:42,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-27 19:06:42,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:06:42,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a3688dd6b39fd1aea894 HTTP/1.1" 200 None 2025-09-27 19:06:42,717 - lava_callback - INFO - Completed processing callback for node 68d7a3688dd6b39fd1aea894 INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:07:17,626 - lava_callback - INFO - Received callback for node 68d5a60e2be2da466069a1dc INFO: 172.21.0.1:53806 - "POST /node/68d5a60e2be2da466069a1dc HTTP/1.0" 202 Accepted 2025-09-27 19:07:17,634 - lava_callback - INFO - Starting async job submit for node 68d5a60e2be2da466069a1dc 2025-09-27 19:07:17,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:07:17,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a60e2be2da466069a1dc HTTP/1.1" 200 None 2025-09-27 19:07:17,684 - lava_callback - DEBUG - Processing node 68d5a60e2be2da466069a1dc: ltp-syscalls-ipc 2025-09-27 19:07:18,480 - lava_callback - ERROR - Error processing callback for node 68d5a60e2be2da466069a1dc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52444 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:08:58,652 - lava_callback - INFO - Received callback for node 68d7a6f08dd6b39fd1aeaba4 INFO: 172.21.0.1:52452 - "POST /node/68d7a6f08dd6b39fd1aeaba4 HTTP/1.0" 202 Accepted 2025-09-27 19:08:58,658 - lava_callback - INFO - Starting async job submit for node 68d7a6f08dd6b39fd1aeaba4 2025-09-27 19:08:58,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:08:58,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a6f08dd6b39fd1aeaba4 HTTP/1.1" 200 None 2025-09-27 19:08:58,717 - lava_callback - DEBUG - Processing node 68d7a6f08dd6b39fd1aeaba4: baseline-arm 2025-09-27 19:08:58,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:08:59,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:08:59,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a6f08dd6b39fd1aeaba4/log.txt.gz 2025-09-27 19:08:59,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:08:59,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:08:59,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a6f08dd6b39fd1aeaba4/lava_callback.json.gz 2025-09-27 19:08:59,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:08:59,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a6f08dd6b39fd1aeaba4 HTTP/1.1" 200 None 2025-09-27 19:08:59,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:08:59,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-27 19:08:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:08:59,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a6f08dd6b39fd1aeaba4 HTTP/1.1" 200 None 2025-09-27 19:08:59,386 - lava_callback - INFO - Completed processing callback for node 68d7a6f08dd6b39fd1aeaba4 INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:09:17,615 - lava_callback - INFO - Received callback for node 68d5a8b82be2da466069a28c INFO: 172.21.0.1:38714 - "POST /node/68d5a8b82be2da466069a28c HTTP/1.0" 202 Accepted 2025-09-27 19:09:17,621 - lava_callback - INFO - Starting async job submit for node 68d5a8b82be2da466069a28c 2025-09-27 19:09:17,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:09:17,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8b82be2da466069a28c HTTP/1.1" 200 None 2025-09-27 19:09:17,656 - lava_callback - DEBUG - Processing node 68d5a8b82be2da466069a28c: baseline-arm-broonie 2025-09-27 19:09:17,845 - lava_callback - ERROR - Error processing callback for node 68d5a8b82be2da466069a28c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:10:50,872 - lava_callback - INFO - Received callback for node 68d5a6122be2da466069a1e2 INFO: 172.21.0.1:43476 - "POST /node/68d5a6122be2da466069a1e2 HTTP/1.0" 202 Accepted 2025-09-27 19:10:50,879 - lava_callback - INFO - Starting async job submit for node 68d5a6122be2da466069a1e2 2025-09-27 19:10:50,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:10:50,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a6122be2da466069a1e2 HTTP/1.1" 200 None 2025-09-27 19:10:50,927 - lava_callback - DEBUG - Processing node 68d5a6122be2da466069a1e2: ltp-watchqueue 2025-09-27 19:10:51,344 - lava_callback - ERROR - Error processing callback for node 68d5a6122be2da466069a1e2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:11:19,190 - lava_callback - INFO - Received callback for node 68d7a6f18dd6b39fd1aeaba7 INFO: 172.21.0.1:39174 - "POST /node/68d7a6f18dd6b39fd1aeaba7 HTTP/1.0" 202 Accepted 2025-09-27 19:11:19,196 - lava_callback - INFO - Starting async job submit for node 68d7a6f18dd6b39fd1aeaba7 2025-09-27 19:11:19,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:11:19,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a6f18dd6b39fd1aeaba7 HTTP/1.1" 200 None 2025-09-27 19:11:19,230 - lava_callback - DEBUG - Processing node 68d7a6f18dd6b39fd1aeaba7: baseline-arm 2025-09-27 19:11:19,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:11:19,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:11:19,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a6f18dd6b39fd1aeaba7/log.txt.gz 2025-09-27 19:11:19,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:11:19,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:11:19,776 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7a6f18dd6b39fd1aeaba7/lava_callback.json.gz 2025-09-27 19:11:19,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:11:19,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a6f18dd6b39fd1aeaba7 HTTP/1.1" 200 None 2025-09-27 19:11:19,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:11:19,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-27 19:11:19,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:11:19,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a6f18dd6b39fd1aeaba7 HTTP/1.1" 200 None 2025-09-27 19:11:19,851 - lava_callback - INFO - Completed processing callback for node 68d7a6f18dd6b39fd1aeaba7 INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:11:50,786 - lava_callback - INFO - Received callback for node 68d5a8bd2be2da466069a295 INFO: 172.21.0.1:47312 - "POST /node/68d5a8bd2be2da466069a295 HTTP/1.0" 202 Accepted 2025-09-27 19:11:50,792 - lava_callback - INFO - Starting async job submit for node 68d5a8bd2be2da466069a295 2025-09-27 19:11:50,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:11:50,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8bd2be2da466069a295 HTTP/1.1" 200 None 2025-09-27 19:11:50,826 - lava_callback - DEBUG - Processing node 68d5a8bd2be2da466069a295: baseline-arm-broonie 2025-09-27 19:11:51,054 - lava_callback - ERROR - Error processing callback for node 68d5a8bd2be2da466069a295: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:12:22,366 - lava_callback - INFO - Received callback for node 68d5a5a02be2da466069a131 INFO: 172.21.0.1:39978 - "POST /node/68d5a5a02be2da466069a131 HTTP/1.0" 202 Accepted 2025-09-27 19:12:22,372 - lava_callback - INFO - Starting async job submit for node 68d5a5a02be2da466069a131 2025-09-27 19:12:22,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:12:22,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5a02be2da466069a131 HTTP/1.1" 200 None 2025-09-27 19:12:22,415 - lava_callback - DEBUG - Processing node 68d5a5a02be2da466069a131: baseline-arm 2025-09-27 19:12:22,705 - lava_callback - ERROR - Error processing callback for node 68d5a5a02be2da466069a131: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38934 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:13:41,063 - lava_callback - INFO - Received callback for node 68d5a8d82be2da466069a2c2 INFO: 172.21.0.1:44470 - "POST /node/68d5a8d82be2da466069a2c2 HTTP/1.0" 202 Accepted 2025-09-27 19:13:41,070 - lava_callback - INFO - Starting async job submit for node 68d5a8d82be2da466069a2c2 2025-09-27 19:13:41,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:13:41,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8d82be2da466069a2c2 HTTP/1.1" 200 None 2025-09-27 19:13:41,109 - lava_callback - DEBUG - Processing node 68d5a8d82be2da466069a2c2: ltp-cap-bounds 2025-09-27 19:13:41,436 - lava_callback - ERROR - Error processing callback for node 68d5a8d82be2da466069a2c2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:16:30,766 - lava_callback - INFO - Received callback for node 68d756c7a6a7b6615d4c4d93 INFO: 172.21.0.1:39460 - "POST /node/68d756c7a6a7b6615d4c4d93 HTTP/1.0" 202 Accepted 2025-09-27 19:16:30,773 - lava_callback - INFO - Starting async job submit for node 68d756c7a6a7b6615d4c4d93 2025-09-27 19:16:30,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:30,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756c7a6a7b6615d4c4d93 HTTP/1.1" 200 None 2025-09-27 19:16:30,827 - lava_callback - DEBUG - Processing node 68d756c7a6a7b6615d4c4d93: baseline-arm64 2025-09-27 19:16:31,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:16:31,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:16:31,870 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756c7a6a7b6615d4c4d93/log.txt.gz 2025-09-27 19:16:31,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:16:32,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:16:32,065 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756c7a6a7b6615d4c4d93/lava_callback.json.gz DEBUG: Setup failed for 68d756c7a6a7b6615d4c4d93. Transitting job node result: incomplete -> fail 2025-09-27 19:16:32,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:32,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756c7a6a7b6615d4c4d93 HTTP/1.1" 200 None 2025-09-27 19:16:32,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:32,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:16:32,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:32,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d756c7a6a7b6615d4c4d93 HTTP/1.1" 200 None 2025-09-27 19:16:32,206 - lava_callback - INFO - Completed processing callback for node 68d756c7a6a7b6615d4c4d93 INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:16:40,441 - lava_callback - INFO - Received callback for node 68d756caa6a7b6615d4c4d96 INFO: 172.21.0.1:50156 - "POST /node/68d756caa6a7b6615d4c4d96 HTTP/1.0" 202 Accepted 2025-09-27 19:16:40,448 - lava_callback - INFO - Starting async job submit for node 68d756caa6a7b6615d4c4d96 2025-09-27 19:16:40,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:40,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756caa6a7b6615d4c4d96 HTTP/1.1" 200 None 2025-09-27 19:16:40,503 - lava_callback - DEBUG - Processing node 68d756caa6a7b6615d4c4d96: baseline-arm64 2025-09-27 19:16:41,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:16:41,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:16:41,502 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756caa6a7b6615d4c4d96/log.txt.gz 2025-09-27 19:16:41,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:16:41,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:16:41,704 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756caa6a7b6615d4c4d96/lava_callback.json.gz DEBUG: Setup failed for 68d756caa6a7b6615d4c4d96. Transitting job node result: incomplete -> fail 2025-09-27 19:16:41,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:41,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756caa6a7b6615d4c4d96 HTTP/1.1" 200 None 2025-09-27 19:16:41,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:41,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:16:41,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:41,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d756caa6a7b6615d4c4d96 HTTP/1.1" 200 None 2025-09-27 19:16:41,888 - lava_callback - INFO - Completed processing callback for node 68d756caa6a7b6615d4c4d96 INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:16:49,440 - lava_callback - INFO - Received callback for node 68d756caa6a7b6615d4c4d99 INFO: 172.21.0.1:40124 - "POST /node/68d756caa6a7b6615d4c4d99 HTTP/1.0" 202 Accepted 2025-09-27 19:16:49,447 - lava_callback - INFO - Starting async job submit for node 68d756caa6a7b6615d4c4d99 2025-09-27 19:16:49,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:49,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756caa6a7b6615d4c4d99 HTTP/1.1" 200 None 2025-09-27 19:16:49,501 - lava_callback - DEBUG - Processing node 68d756caa6a7b6615d4c4d99: baseline-arm64 2025-09-27 19:16:50,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:16:50,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:16:50,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756caa6a7b6615d4c4d99/log.txt.gz 2025-09-27 19:16:50,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:16:50,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:16:50,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756caa6a7b6615d4c4d99/lava_callback.json.gz DEBUG: Setup failed for 68d756caa6a7b6615d4c4d99. Transitting job node result: incomplete -> fail 2025-09-27 19:16:50,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:50,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756caa6a7b6615d4c4d99 HTTP/1.1" 200 None 2025-09-27 19:16:50,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:50,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:16:50,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:50,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d756caa6a7b6615d4c4d99 HTTP/1.1" 200 None 2025-09-27 19:16:50,943 - lava_callback - INFO - Completed processing callback for node 68d756caa6a7b6615d4c4d99 2025-09-27 19:16:51,314 - lava_callback - INFO - Received callback for node 68d5a8da2be2da466069a2c5 INFO: 172.21.0.1:40128 - "POST /node/68d5a8da2be2da466069a2c5 HTTP/1.0" 202 Accepted 2025-09-27 19:16:51,322 - lava_callback - INFO - Starting async job submit for node 68d5a8da2be2da466069a2c5 2025-09-27 19:16:51,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:16:51,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8da2be2da466069a2c5 HTTP/1.1" 200 None 2025-09-27 19:16:51,440 - lava_callback - DEBUG - Processing node 68d5a8da2be2da466069a2c5: ltp-containers 2025-09-27 19:16:52,268 - lava_callback - ERROR - Error processing callback for node 68d5a8da2be2da466069a2c5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:18:19,760 - lava_callback - INFO - Received callback for node 68d7bc618dd6b39fd1aeaf6e INFO: 172.21.0.1:54084 - "POST /node/68d7bc618dd6b39fd1aeaf6e HTTP/1.0" 202 Accepted 2025-09-27 19:18:19,766 - lava_callback - INFO - Starting async job submit for node 68d7bc618dd6b39fd1aeaf6e 2025-09-27 19:18:19,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:18:19,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc618dd6b39fd1aeaf6e HTTP/1.1" 200 None 2025-09-27 19:18:19,799 - lava_callback - DEBUG - Processing node 68d7bc618dd6b39fd1aeaf6e: baseline-arm 2025-09-27 19:18:20,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:18:20,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:18:20,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc618dd6b39fd1aeaf6e/log.txt.gz 2025-09-27 19:18:20,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:18:20,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:18:20,348 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc618dd6b39fd1aeaf6e/lava_callback.json.gz 2025-09-27 19:18:20,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:18:20,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc618dd6b39fd1aeaf6e HTTP/1.1" 200 None 2025-09-27 19:18:20,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:18:20,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:18:20,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:18:20,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc618dd6b39fd1aeaf6e HTTP/1.1" 200 None 2025-09-27 19:18:20,446 - lava_callback - INFO - Completed processing callback for node 68d7bc618dd6b39fd1aeaf6e INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:20:32,836 - lava_callback - INFO - Received callback for node 68d7bc628dd6b39fd1aeaf75 INFO: 172.21.0.1:58292 - "POST /node/68d7bc628dd6b39fd1aeaf75 HTTP/1.0" 202 Accepted 2025-09-27 19:20:32,842 - lava_callback - INFO - Starting async job submit for node 68d7bc628dd6b39fd1aeaf75 2025-09-27 19:20:32,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:20:32,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc628dd6b39fd1aeaf75 HTTP/1.1" 200 None 2025-09-27 19:20:32,894 - lava_callback - DEBUG - Processing node 68d7bc628dd6b39fd1aeaf75: baseline-arm 2025-09-27 19:20:33,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:20:33,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:20:33,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc628dd6b39fd1aeaf75/log.txt.gz 2025-09-27 19:20:33,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:20:33,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:20:33,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc628dd6b39fd1aeaf75/lava_callback.json.gz 2025-09-27 19:20:33,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:20:33,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc628dd6b39fd1aeaf75 HTTP/1.1" 200 None 2025-09-27 19:20:33,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:20:33,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:20:33,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:20:33,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc628dd6b39fd1aeaf75 HTTP/1.1" 200 None 2025-09-27 19:20:33,542 - lava_callback - INFO - Completed processing callback for node 68d7bc628dd6b39fd1aeaf75 INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:23:00,325 - lava_callback - INFO - Received callback for node 68d7bc648dd6b39fd1aeaf78 INFO: 172.21.0.1:53956 - "POST /node/68d7bc648dd6b39fd1aeaf78 HTTP/1.0" 202 Accepted 2025-09-27 19:23:00,331 - lava_callback - INFO - Starting async job submit for node 68d7bc648dd6b39fd1aeaf78 2025-09-27 19:23:00,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:23:00,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc648dd6b39fd1aeaf78 HTTP/1.1" 200 None 2025-09-27 19:23:00,412 - lava_callback - DEBUG - Processing node 68d7bc648dd6b39fd1aeaf78: baseline-arm 2025-09-27 19:23:00,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:23:00,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:23:00,811 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc648dd6b39fd1aeaf78/log.txt.gz 2025-09-27 19:23:00,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:23:00,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:23:00,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc648dd6b39fd1aeaf78/lava_callback.json.gz 2025-09-27 19:23:00,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:23:00,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc648dd6b39fd1aeaf78 HTTP/1.1" 200 None 2025-09-27 19:23:00,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:23:00,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:23:00,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:23:01,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc648dd6b39fd1aeaf78 HTTP/1.1" 200 None 2025-09-27 19:23:01,027 - lava_callback - INFO - Completed processing callback for node 68d7bc648dd6b39fd1aeaf78 INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:24:11,418 - lava_callback - INFO - Received callback for node 68d5a8e32be2da466069a2dc INFO: 172.21.0.1:55926 - "POST /node/68d5a8e32be2da466069a2dc HTTP/1.0" 202 Accepted 2025-09-27 19:24:11,425 - lava_callback - INFO - Starting async job submit for node 68d5a8e32be2da466069a2dc 2025-09-27 19:24:11,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:24:11,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8e32be2da466069a2dc HTTP/1.1" 200 None 2025-09-27 19:24:11,557 - lava_callback - DEBUG - Processing node 68d5a8e32be2da466069a2dc: ltp-fs-bind 2025-09-27 19:24:12,089 - lava_callback - ERROR - Error processing callback for node 68d5a8e32be2da466069a2dc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:25:19,989 - lava_callback - INFO - Received callback for node 68d7bc648dd6b39fd1aeaf7b INFO: 172.21.0.1:50374 - "POST /node/68d7bc648dd6b39fd1aeaf7b HTTP/1.0" 202 Accepted 2025-09-27 19:25:19,995 - lava_callback - INFO - Starting async job submit for node 68d7bc648dd6b39fd1aeaf7b 2025-09-27 19:25:20,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:25:20,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc648dd6b39fd1aeaf7b HTTP/1.1" 200 None 2025-09-27 19:25:20,028 - lava_callback - DEBUG - Processing node 68d7bc648dd6b39fd1aeaf7b: baseline-arm 2025-09-27 19:25:20,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:25:20,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:25:20,403 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc648dd6b39fd1aeaf7b/log.txt.gz 2025-09-27 19:25:20,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:25:20,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:25:20,546 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc648dd6b39fd1aeaf7b/lava_callback.json.gz 2025-09-27 19:25:20,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:25:20,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc648dd6b39fd1aeaf7b HTTP/1.1" 200 None 2025-09-27 19:25:20,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:25:20,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:25:20,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:25:20,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc648dd6b39fd1aeaf7b HTTP/1.1" 200 None 2025-09-27 19:25:20,640 - lava_callback - INFO - Completed processing callback for node 68d7bc648dd6b39fd1aeaf7b INFO: 172.21.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:27:40,283 - lava_callback - INFO - Received callback for node 68d7bc668dd6b39fd1aeaf7e INFO: 172.21.0.1:58512 - "POST /node/68d7bc668dd6b39fd1aeaf7e HTTP/1.0" 202 Accepted 2025-09-27 19:27:40,289 - lava_callback - INFO - Starting async job submit for node 68d7bc668dd6b39fd1aeaf7e 2025-09-27 19:27:40,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:27:40,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc668dd6b39fd1aeaf7e HTTP/1.1" 200 None 2025-09-27 19:27:40,323 - lava_callback - DEBUG - Processing node 68d7bc668dd6b39fd1aeaf7e: baseline-arm 2025-09-27 19:27:40,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:27:40,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:27:40,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc668dd6b39fd1aeaf7e/log.txt.gz 2025-09-27 19:27:40,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:27:40,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:27:40,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc668dd6b39fd1aeaf7e/lava_callback.json.gz 2025-09-27 19:27:40,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:27:40,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc668dd6b39fd1aeaf7e HTTP/1.1" 200 None 2025-09-27 19:27:40,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:27:40,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:27:40,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:27:40,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc668dd6b39fd1aeaf7e HTTP/1.1" 200 None 2025-09-27 19:27:40,934 - lava_callback - INFO - Completed processing callback for node 68d7bc668dd6b39fd1aeaf7e INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58186 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:28:31,556 - lava_callback - INFO - Received callback for node 68d5a8e52be2da466069a2df INFO: 172.21.0.1:59264 - "POST /node/68d5a8e52be2da466069a2df HTTP/1.0" 202 Accepted 2025-09-27 19:28:31,563 - lava_callback - INFO - Starting async job submit for node 68d5a8e52be2da466069a2df 2025-09-27 19:28:31,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:28:31,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8e52be2da466069a2df HTTP/1.1" 200 None 2025-09-27 19:28:31,601 - lava_callback - DEBUG - Processing node 68d5a8e52be2da466069a2df: ltp-fsx 2025-09-27 19:28:31,948 - lava_callback - ERROR - Error processing callback for node 68d5a8e52be2da466069a2df: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:30:59,044 - lava_callback - INFO - Received callback for node 68d7bc668dd6b39fd1aeaf81 INFO: 172.21.0.1:54370 - "POST /node/68d7bc668dd6b39fd1aeaf81 HTTP/1.0" 202 Accepted 2025-09-27 19:30:59,050 - lava_callback - INFO - Starting async job submit for node 68d7bc668dd6b39fd1aeaf81 2025-09-27 19:30:59,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:30:59,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc668dd6b39fd1aeaf81 HTTP/1.1" 200 None 2025-09-27 19:30:59,111 - lava_callback - DEBUG - Processing node 68d7bc668dd6b39fd1aeaf81: baseline-arm 2025-09-27 19:30:59,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:30:59,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:30:59,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc668dd6b39fd1aeaf81/log.txt.gz 2025-09-27 19:30:59,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:30:59,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:30:59,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc668dd6b39fd1aeaf81/lava_callback.json.gz 2025-09-27 19:30:59,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:30:59,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc668dd6b39fd1aeaf81 HTTP/1.1" 200 None 2025-09-27 19:30:59,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:30:59,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:30:59,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:30:59,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc668dd6b39fd1aeaf81 HTTP/1.1" 200 None 2025-09-27 19:30:59,741 - lava_callback - INFO - Completed processing callback for node 68d7bc668dd6b39fd1aeaf81 INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:32:03,408 - lava_callback - INFO - Received callback for node 68d5a5d02be2da466069a13b INFO: 172.21.0.1:34236 - "POST /node/68d5a5d02be2da466069a13b HTTP/1.0" 202 Accepted 2025-09-27 19:32:03,414 - lava_callback - INFO - Starting async job submit for node 68d5a5d02be2da466069a13b 2025-09-27 19:32:03,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:32:03,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5d02be2da466069a13b HTTP/1.1" 200 None 2025-09-27 19:32:03,457 - lava_callback - DEBUG - Processing node 68d5a5d02be2da466069a13b: baseline-arm 2025-09-27 19:32:03,725 - lava_callback - ERROR - Error processing callback for node 68d5a5d02be2da466069a13b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:32:51,728 - lava_callback - INFO - Received callback for node 68d5a8e72be2da466069a2e2 INFO: 172.21.0.1:59924 - "POST /node/68d5a8e72be2da466069a2e2 HTTP/1.0" 202 Accepted 2025-09-27 19:32:51,735 - lava_callback - INFO - Starting async job submit for node 68d5a8e72be2da466069a2e2 2025-09-27 19:32:51,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:32:51,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8e72be2da466069a2e2 HTTP/1.1" 200 None 2025-09-27 19:32:51,808 - lava_callback - DEBUG - Processing node 68d5a8e72be2da466069a2e2: ltp-input 2025-09-27 19:32:52,193 - lava_callback - ERROR - Error processing callback for node 68d5a8e72be2da466069a2e2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:33:23,577 - lava_callback - INFO - Received callback for node 68d7bc688dd6b39fd1aeaf84 INFO: 172.21.0.1:48276 - "POST /node/68d7bc688dd6b39fd1aeaf84 HTTP/1.0" 202 Accepted 2025-09-27 19:33:23,583 - lava_callback - INFO - Starting async job submit for node 68d7bc688dd6b39fd1aeaf84 2025-09-27 19:33:23,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:33:23,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc688dd6b39fd1aeaf84 HTTP/1.1" 200 None 2025-09-27 19:33:23,615 - lava_callback - DEBUG - Processing node 68d7bc688dd6b39fd1aeaf84: baseline-arm 2025-09-27 19:33:23,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:33:23,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:33:23,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc688dd6b39fd1aeaf84/log.txt.gz 2025-09-27 19:33:24,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:33:24,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:33:24,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc688dd6b39fd1aeaf84/lava_callback.json.gz 2025-09-27 19:33:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:33:24,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc688dd6b39fd1aeaf84 HTTP/1.1" 200 None 2025-09-27 19:33:24,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:33:24,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:33:24,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:33:24,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc688dd6b39fd1aeaf84 HTTP/1.1" 200 None 2025-09-27 19:33:24,209 - lava_callback - INFO - Completed processing callback for node 68d7bc688dd6b39fd1aeaf84 INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:35:40,207 - lava_callback - INFO - Received callback for node 68d7bc688dd6b39fd1aeaf87 INFO: 172.21.0.1:32896 - "POST /node/68d7bc688dd6b39fd1aeaf87 HTTP/1.0" 202 Accepted 2025-09-27 19:35:40,213 - lava_callback - INFO - Starting async job submit for node 68d7bc688dd6b39fd1aeaf87 2025-09-27 19:35:40,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:35:40,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc688dd6b39fd1aeaf87 HTTP/1.1" 200 None 2025-09-27 19:35:40,253 - lava_callback - DEBUG - Processing node 68d7bc688dd6b39fd1aeaf87: baseline-arm 2025-09-27 19:35:40,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:35:40,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:35:40,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc688dd6b39fd1aeaf87/log.txt.gz 2025-09-27 19:35:40,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:35:40,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:35:40,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc688dd6b39fd1aeaf87/lava_callback.json.gz 2025-09-27 19:35:40,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:35:40,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc688dd6b39fd1aeaf87 HTTP/1.1" 200 None 2025-09-27 19:35:40,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:35:40,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:35:40,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:35:40,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc688dd6b39fd1aeaf87 HTTP/1.1" 200 None 2025-09-27 19:35:40,910 - lava_callback - INFO - Completed processing callback for node 68d7bc688dd6b39fd1aeaf87 INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60604 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:37:01,634 - lava_callback - INFO - Received callback for node 68d756ffa6a7b6615d4c4da1 INFO: 172.21.0.1:54366 - "POST /node/68d756ffa6a7b6615d4c4da1 HTTP/1.0" 202 Accepted 2025-09-27 19:37:01,641 - lava_callback - INFO - Starting async job submit for node 68d756ffa6a7b6615d4c4da1 2025-09-27 19:37:01,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:01,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756ffa6a7b6615d4c4da1 HTTP/1.1" 200 None 2025-09-27 19:37:01,698 - lava_callback - DEBUG - Processing node 68d756ffa6a7b6615d4c4da1: baseline-arm64 2025-09-27 19:37:02,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:37:02,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:37:02,688 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756ffa6a7b6615d4c4da1/log.txt.gz 2025-09-27 19:37:02,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:37:02,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:37:02,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d756ffa6a7b6615d4c4da1/lava_callback.json.gz DEBUG: Setup failed for 68d756ffa6a7b6615d4c4da1. Transitting job node result: incomplete -> fail 2025-09-27 19:37:02,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:03,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d756ffa6a7b6615d4c4da1 HTTP/1.1" 200 None 2025-09-27 19:37:03,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:03,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:37:03,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:03,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d756ffa6a7b6615d4c4da1 HTTP/1.1" 200 None 2025-09-27 19:37:03,071 - lava_callback - INFO - Completed processing callback for node 68d756ffa6a7b6615d4c4da1 INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:37:11,216 - lava_callback - INFO - Received callback for node 68d75700a6a7b6615d4c4da4 INFO: 172.21.0.1:52628 - "POST /node/68d75700a6a7b6615d4c4da4 HTTP/1.0" 202 Accepted 2025-09-27 19:37:11,224 - lava_callback - INFO - Starting async job submit for node 68d75700a6a7b6615d4c4da4 2025-09-27 19:37:11,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:11,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75700a6a7b6615d4c4da4 HTTP/1.1" 200 None 2025-09-27 19:37:11,277 - lava_callback - DEBUG - Processing node 68d75700a6a7b6615d4c4da4: baseline-arm64 2025-09-27 19:37:11,950 - lava_callback - INFO - Received callback for node 68d5a8e82be2da466069a2e5 INFO: 172.21.0.1:52642 - "POST /node/68d5a8e82be2da466069a2e5 HTTP/1.0" 202 Accepted 2025-09-27 19:37:11,978 - lava_callback - INFO - Starting async job submit for node 68d5a8e82be2da466069a2e5 2025-09-27 19:37:12,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:12,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8e82be2da466069a2e5 HTTP/1.1" 200 None 2025-09-27 19:37:12,123 - lava_callback - DEBUG - Processing node 68d5a8e82be2da466069a2e5: ltp-ipc 2025-09-27 19:37:12,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:37:12,642 - lava_callback - ERROR - Error processing callback for node 68d5a8e82be2da466069a2e5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 19:37:12,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:37:12,644 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75700a6a7b6615d4c4da4/log.txt.gz 2025-09-27 19:37:12,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:37:12,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:37:12,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75700a6a7b6615d4c4da4/lava_callback.json.gz DEBUG: Setup failed for 68d75700a6a7b6615d4c4da4. Transitting job node result: incomplete -> fail 2025-09-27 19:37:12,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:12,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75700a6a7b6615d4c4da4 HTTP/1.1" 200 None 2025-09-27 19:37:12,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:12,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:37:12,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:12,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75700a6a7b6615d4c4da4 HTTP/1.1" 200 None 2025-09-27 19:37:12,947 - lava_callback - INFO - Completed processing callback for node 68d75700a6a7b6615d4c4da4 INFO: 172.21.0.1:52654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:37:30,730 - lava_callback - INFO - Received callback for node 68d75702a6a7b6615d4c4da7 INFO: 172.21.0.1:55702 - "POST /node/68d75702a6a7b6615d4c4da7 HTTP/1.0" 202 Accepted 2025-09-27 19:37:30,737 - lava_callback - INFO - Starting async job submit for node 68d75702a6a7b6615d4c4da7 2025-09-27 19:37:30,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:30,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75702a6a7b6615d4c4da7 HTTP/1.1" 200 None 2025-09-27 19:37:30,792 - lava_callback - DEBUG - Processing node 68d75702a6a7b6615d4c4da7: baseline-arm64 2025-09-27 19:37:31,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:37:31,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:37:31,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75702a6a7b6615d4c4da7/log.txt.gz 2025-09-27 19:37:31,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:37:31,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:37:31,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75702a6a7b6615d4c4da7/lava_callback.json.gz DEBUG: Setup failed for 68d75702a6a7b6615d4c4da7. Transitting job node result: incomplete -> fail 2025-09-27 19:37:32,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:32,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75702a6a7b6615d4c4da7 HTTP/1.1" 200 None 2025-09-27 19:37:32,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:32,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:37:32,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:32,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75702a6a7b6615d4c4da7 HTTP/1.1" 200 None 2025-09-27 19:37:32,145 - lava_callback - INFO - Completed processing callback for node 68d75702a6a7b6615d4c4da7 2025-09-27 19:37:32,377 - lava_callback - INFO - Received callback for node 68d5a8dd2be2da466069a2cb INFO: 172.21.0.1:55712 - "POST /node/68d5a8dd2be2da466069a2cb HTTP/1.0" 202 Accepted 2025-09-27 19:37:32,387 - lava_callback - INFO - Starting async job submit for node 68d5a8dd2be2da466069a2cb 2025-09-27 19:37:32,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:37:32,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8dd2be2da466069a2cb HTTP/1.1" 200 None 2025-09-27 19:37:32,548 - lava_callback - DEBUG - Processing node 68d5a8dd2be2da466069a2cb: ltp-cve 2025-09-27 19:37:33,306 - lava_callback - ERROR - Error processing callback for node 68d5a8dd2be2da466069a2cb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:38:00,209 - lava_callback - INFO - Received callback for node 68d7bc728dd6b39fd1aeafa2 INFO: 172.21.0.1:49460 - "POST /node/68d7bc728dd6b39fd1aeafa2 HTTP/1.0" 202 Accepted 2025-09-27 19:38:00,215 - lava_callback - INFO - Starting async job submit for node 68d7bc728dd6b39fd1aeafa2 2025-09-27 19:38:00,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:38:00,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc728dd6b39fd1aeafa2 HTTP/1.1" 200 None 2025-09-27 19:38:00,277 - lava_callback - DEBUG - Processing node 68d7bc728dd6b39fd1aeafa2: baseline-arm 2025-09-27 19:38:00,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:38:00,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:38:00,622 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc728dd6b39fd1aeafa2/log.txt.gz 2025-09-27 19:38:00,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:38:00,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:38:00,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc728dd6b39fd1aeafa2/lava_callback.json.gz 2025-09-27 19:38:00,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:38:00,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc728dd6b39fd1aeafa2 HTTP/1.1" 200 None 2025-09-27 19:38:00,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:38:00,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:38:00,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:38:01,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc728dd6b39fd1aeafa2 HTTP/1.1" 200 None 2025-09-27 19:38:01,084 - lava_callback - INFO - Completed processing callback for node 68d7bc728dd6b39fd1aeafa2 INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:40:13,042 - lava_callback - INFO - Received callback for node 68d7bc728dd6b39fd1aeafa5 INFO: 172.21.0.1:37462 - "POST /node/68d7bc728dd6b39fd1aeafa5 HTTP/1.0" 202 Accepted 2025-09-27 19:40:13,049 - lava_callback - INFO - Starting async job submit for node 68d7bc728dd6b39fd1aeafa5 2025-09-27 19:40:13,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:40:13,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc728dd6b39fd1aeafa5 HTTP/1.1" 200 None 2025-09-27 19:40:13,086 - lava_callback - DEBUG - Processing node 68d7bc728dd6b39fd1aeafa5: baseline-arm 2025-09-27 19:40:13,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:40:13,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:40:13,567 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc728dd6b39fd1aeafa5/log.txt.gz 2025-09-27 19:40:13,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:40:13,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:40:13,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc728dd6b39fd1aeafa5/lava_callback.json.gz 2025-09-27 19:40:13,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:40:13,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc728dd6b39fd1aeafa5 HTTP/1.1" 200 None 2025-09-27 19:40:13,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:40:13,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:40:13,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:40:13,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc728dd6b39fd1aeafa5 HTTP/1.1" 200 None 2025-09-27 19:40:13,825 - lava_callback - INFO - Completed processing callback for node 68d7bc728dd6b39fd1aeafa5 INFO: 172.21.0.1:37470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:42:40,189 - lava_callback - INFO - Received callback for node 68d7bc748dd6b39fd1aeafa8 INFO: 172.21.0.1:42096 - "POST /node/68d7bc748dd6b39fd1aeafa8 HTTP/1.0" 202 Accepted 2025-09-27 19:42:40,195 - lava_callback - INFO - Starting async job submit for node 68d7bc748dd6b39fd1aeafa8 2025-09-27 19:42:40,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:42:40,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc748dd6b39fd1aeafa8 HTTP/1.1" 200 None 2025-09-27 19:42:40,229 - lava_callback - DEBUG - Processing node 68d7bc748dd6b39fd1aeafa8: baseline-arm 2025-09-27 19:42:40,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:42:40,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:42:40,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc748dd6b39fd1aeafa8/log.txt.gz 2025-09-27 19:42:40,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:42:40,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:42:40,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc748dd6b39fd1aeafa8/lava_callback.json.gz 2025-09-27 19:42:40,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:42:40,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc748dd6b39fd1aeafa8 HTTP/1.1" 200 None 2025-09-27 19:42:40,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:42:40,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:42:40,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:42:40,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc748dd6b39fd1aeafa8 HTTP/1.1" 200 None 2025-09-27 19:42:40,875 - lava_callback - INFO - Completed processing callback for node 68d7bc748dd6b39fd1aeafa8 INFO: 172.21.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:45:00,996 - lava_callback - INFO - Received callback for node 68d7bc748dd6b39fd1aeafab INFO: 172.21.0.1:44562 - "POST /node/68d7bc748dd6b39fd1aeafab HTTP/1.0" 202 Accepted 2025-09-27 19:45:01,003 - lava_callback - INFO - Starting async job submit for node 68d7bc748dd6b39fd1aeafab 2025-09-27 19:45:01,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:45:01,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc748dd6b39fd1aeafab HTTP/1.1" 200 None 2025-09-27 19:45:01,037 - lava_callback - DEBUG - Processing node 68d7bc748dd6b39fd1aeafab: baseline-arm 2025-09-27 19:45:01,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:45:01,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:45:01,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc748dd6b39fd1aeafab/log.txt.gz 2025-09-27 19:45:01,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:45:01,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:45:01,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc748dd6b39fd1aeafab/lava_callback.json.gz 2025-09-27 19:45:01,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:45:01,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc748dd6b39fd1aeafab HTTP/1.1" 200 None 2025-09-27 19:45:01,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:45:01,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:45:01,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:45:01,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc748dd6b39fd1aeafab HTTP/1.1" 200 None 2025-09-27 19:45:01,678 - lava_callback - INFO - Completed processing callback for node 68d7bc748dd6b39fd1aeafab INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:45:45,693 - lava_callback - INFO - Received callback for node 68d5a8dc2be2da466069a2c8 INFO: 172.21.0.1:52740 - "POST /node/68d5a8dc2be2da466069a2c8 HTTP/1.0" 202 Accepted 2025-09-27 19:45:45,704 - lava_callback - INFO - Starting async job submit for node 68d5a8dc2be2da466069a2c8 2025-09-27 19:45:46,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:45:46,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8dc2be2da466069a2c8 HTTP/1.1" 200 None 2025-09-27 19:45:46,043 - lava_callback - DEBUG - Processing node 68d5a8dc2be2da466069a2c8: ltp-controllers INFO: 172.21.0.1:52752 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:45:48,751 - lava_callback - ERROR - Error processing callback for node 68d5a8dc2be2da466069a2c8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56166 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:46:52,251 - lava_callback - INFO - Received callback for node 68d5a8ea2be2da466069a2e8 INFO: 172.21.0.1:35518 - "POST /node/68d5a8ea2be2da466069a2e8 HTTP/1.0" 202 Accepted 2025-09-27 19:46:52,257 - lava_callback - INFO - Starting async job submit for node 68d5a8ea2be2da466069a2e8 2025-09-27 19:46:52,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:46:52,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8ea2be2da466069a2e8 HTTP/1.1" 200 None 2025-09-27 19:46:52,310 - lava_callback - DEBUG - Processing node 68d5a8ea2be2da466069a2e8: ltp-pty 2025-09-27 19:46:52,683 - lava_callback - ERROR - Error processing callback for node 68d5a8ea2be2da466069a2e8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41182 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:47:21,623 - lava_callback - INFO - Received callback for node 68d7bc9d8dd6b39fd1aeafb7 INFO: 172.21.0.1:55820 - "POST /node/68d7bc9d8dd6b39fd1aeafb7 HTTP/1.0" 202 Accepted 2025-09-27 19:47:21,629 - lava_callback - INFO - Starting async job submit for node 68d7bc9d8dd6b39fd1aeafb7 2025-09-27 19:47:21,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:47:21,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc9d8dd6b39fd1aeafb7 HTTP/1.1" 200 None 2025-09-27 19:47:21,662 - lava_callback - DEBUG - Processing node 68d7bc9d8dd6b39fd1aeafb7: baseline-arm 2025-09-27 19:47:21,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:47:22,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:47:22,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc9d8dd6b39fd1aeafb7/log.txt.gz 2025-09-27 19:47:22,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:47:22,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:47:22,288 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc9d8dd6b39fd1aeafb7/lava_callback.json.gz 2025-09-27 19:47:22,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:47:22,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc9d8dd6b39fd1aeafb7 HTTP/1.1" 200 None 2025-09-27 19:47:22,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:47:22,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:47:22,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:47:22,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc9d8dd6b39fd1aeafb7 HTTP/1.1" 200 None 2025-09-27 19:47:22,397 - lava_callback - INFO - Completed processing callback for node 68d7bc9d8dd6b39fd1aeafb7 INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:49:40,563 - lava_callback - INFO - Received callback for node 68d7bc9e8dd6b39fd1aeafc4 INFO: 172.21.0.1:48808 - "POST /node/68d7bc9e8dd6b39fd1aeafc4 HTTP/1.0" 202 Accepted 2025-09-27 19:49:40,569 - lava_callback - INFO - Starting async job submit for node 68d7bc9e8dd6b39fd1aeafc4 2025-09-27 19:49:40,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:49:40,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc9e8dd6b39fd1aeafc4 HTTP/1.1" 200 None 2025-09-27 19:49:40,606 - lava_callback - DEBUG - Processing node 68d7bc9e8dd6b39fd1aeafc4: baseline-arm 2025-09-27 19:49:40,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:49:41,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:49:41,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc9e8dd6b39fd1aeafc4/log.txt.gz 2025-09-27 19:49:41,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:49:41,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:49:41,147 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bc9e8dd6b39fd1aeafc4/lava_callback.json.gz 2025-09-27 19:49:41,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:49:41,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bc9e8dd6b39fd1aeafc4 HTTP/1.1" 200 None 2025-09-27 19:49:41,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:49:41,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:49:41,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:49:41,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bc9e8dd6b39fd1aeafc4 HTTP/1.1" 200 None 2025-09-27 19:49:41,227 - lava_callback - INFO - Completed processing callback for node 68d7bc9e8dd6b39fd1aeafc4 INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:51:42,718 - lava_callback - INFO - Received callback for node 68d5a5d02be2da466069a14a INFO: 172.21.0.1:35168 - "POST /node/68d5a5d02be2da466069a14a HTTP/1.0" 202 Accepted 2025-09-27 19:51:42,724 - lava_callback - INFO - Starting async job submit for node 68d5a5d02be2da466069a14a 2025-09-27 19:51:42,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:51:42,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5d02be2da466069a14a HTTP/1.1" 200 None 2025-09-27 19:51:42,788 - lava_callback - DEBUG - Processing node 68d5a5d02be2da466069a14a: baseline-arm 2025-09-27 19:51:43,048 - lava_callback - ERROR - Error processing callback for node 68d5a5d02be2da466069a14a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59976 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:51:59,375 - lava_callback - INFO - Received callback for node 68d7bca08dd6b39fd1aeafc7 INFO: 172.21.0.1:35100 - "POST /node/68d7bca08dd6b39fd1aeafc7 HTTP/1.0" 202 Accepted 2025-09-27 19:51:59,381 - lava_callback - INFO - Starting async job submit for node 68d7bca08dd6b39fd1aeafc7 2025-09-27 19:51:59,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:51:59,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bca08dd6b39fd1aeafc7 HTTP/1.1" 200 None 2025-09-27 19:51:59,415 - lava_callback - DEBUG - Processing node 68d7bca08dd6b39fd1aeafc7: baseline-arm 2025-09-27 19:51:59,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:51:59,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:51:59,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bca08dd6b39fd1aeafc7/log.txt.gz 2025-09-27 19:51:59,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:51:59,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:51:59,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bca08dd6b39fd1aeafc7/lava_callback.json.gz 2025-09-27 19:51:59,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:51:59,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bca08dd6b39fd1aeafc7 HTTP/1.1" 200 None 2025-09-27 19:51:59,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:51:59,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:51:59,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:52:00,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bca08dd6b39fd1aeafc7 HTTP/1.1" 200 None 2025-09-27 19:52:00,010 - lava_callback - INFO - Completed processing callback for node 68d7bca08dd6b39fd1aeafc7 INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:54:18,871 - lava_callback - INFO - Received callback for node 68d7bca08dd6b39fd1aeafca INFO: 172.21.0.1:40054 - "POST /node/68d7bca08dd6b39fd1aeafca HTTP/1.0" 202 Accepted 2025-09-27 19:54:18,877 - lava_callback - INFO - Starting async job submit for node 68d7bca08dd6b39fd1aeafca 2025-09-27 19:54:18,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:54:18,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bca08dd6b39fd1aeafca HTTP/1.1" 200 None 2025-09-27 19:54:18,912 - lava_callback - DEBUG - Processing node 68d7bca08dd6b39fd1aeafca: baseline-arm 2025-09-27 19:54:19,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:54:19,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:54:19,328 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bca08dd6b39fd1aeafca/log.txt.gz 2025-09-27 19:54:19,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:54:19,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:54:19,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bca08dd6b39fd1aeafca/lava_callback.json.gz 2025-09-27 19:54:19,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:54:19,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bca08dd6b39fd1aeafca HTTP/1.1" 200 None 2025-09-27 19:54:19,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:54:19,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9da2f83206171a92b45 HTTP/1.1" 200 None 2025-09-27 19:54:19,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:54:19,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bca08dd6b39fd1aeafca HTTP/1.1" 200 None 2025-09-27 19:54:19,546 - lava_callback - INFO - Completed processing callback for node 68d7bca08dd6b39fd1aeafca INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:56:32,612 - lava_callback - INFO - Received callback for node 68d5a8ed2be2da466069a2ee INFO: 172.21.0.1:59880 - "POST /node/68d5a8ed2be2da466069a2ee HTTP/1.0" 202 Accepted 2025-09-27 19:56:32,619 - lava_callback - INFO - Starting async job submit for node 68d5a8ed2be2da466069a2ee 2025-09-27 19:56:32,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:56:32,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8ed2be2da466069a2ee HTTP/1.1" 200 None 2025-09-27 19:56:32,691 - lava_callback - DEBUG - Processing node 68d5a8ed2be2da466069a2ee: ltp-smoketest 2025-09-27 19:56:33,090 - lava_callback - ERROR - Error processing callback for node 68d5a8ed2be2da466069a2ee: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:56:40,479 - lava_callback - INFO - Received callback for node 68d7bf348dd6b39fd1aeb052 INFO: 172.21.0.1:33422 - "POST /node/68d7bf348dd6b39fd1aeb052 HTTP/1.0" 202 Accepted 2025-09-27 19:56:40,485 - lava_callback - INFO - Starting async job submit for node 68d7bf348dd6b39fd1aeb052 2025-09-27 19:56:40,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:56:40,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf348dd6b39fd1aeb052 HTTP/1.1" 200 None 2025-09-27 19:56:40,537 - lava_callback - DEBUG - Processing node 68d7bf348dd6b39fd1aeb052: baseline-arm 2025-09-27 19:56:40,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:56:40,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:56:40,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf348dd6b39fd1aeb052/log.txt.gz 2025-09-27 19:56:40,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:56:41,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:56:41,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf348dd6b39fd1aeb052/lava_callback.json.gz 2025-09-27 19:56:41,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:56:41,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf348dd6b39fd1aeb052 HTTP/1.1" 200 None 2025-09-27 19:56:41,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:56:41,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 19:56:41,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:56:41,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf348dd6b39fd1aeb052 HTTP/1.1" 200 None 2025-09-27 19:56:41,130 - lava_callback - INFO - Completed processing callback for node 68d7bf348dd6b39fd1aeb052 INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:57:22,817 - lava_callback - INFO - Received callback for node 68d75703a6a7b6615d4c4daa INFO: 172.21.0.1:34768 - "POST /node/68d75703a6a7b6615d4c4daa HTTP/1.0" 202 Accepted 2025-09-27 19:57:22,824 - lava_callback - INFO - Starting async job submit for node 68d75703a6a7b6615d4c4daa 2025-09-27 19:57:22,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:22,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75703a6a7b6615d4c4daa HTTP/1.1" 200 None 2025-09-27 19:57:22,898 - lava_callback - DEBUG - Processing node 68d75703a6a7b6615d4c4daa: baseline-arm64 2025-09-27 19:57:23,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:57:23,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:57:23,929 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75703a6a7b6615d4c4daa/log.txt.gz 2025-09-27 19:57:23,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:57:24,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:57:24,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75703a6a7b6615d4c4daa/lava_callback.json.gz DEBUG: Setup failed for 68d75703a6a7b6615d4c4daa. Transitting job node result: incomplete -> fail 2025-09-27 19:57:24,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:24,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75703a6a7b6615d4c4daa HTTP/1.1" 200 None 2025-09-27 19:57:24,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:24,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:57:24,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:24,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75703a6a7b6615d4c4daa HTTP/1.1" 200 None 2025-09-27 19:57:24,262 - lava_callback - INFO - Completed processing callback for node 68d75703a6a7b6615d4c4daa INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:57:39,575 - lava_callback - INFO - Received callback for node 68d76388a6a7b6615d4c4fcf INFO: 172.21.0.1:57552 - "POST /node/68d76388a6a7b6615d4c4fcf HTTP/1.0" 202 Accepted 2025-09-27 19:57:39,581 - lava_callback - INFO - Starting async job submit for node 68d76388a6a7b6615d4c4fcf 2025-09-27 19:57:39,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:39,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76388a6a7b6615d4c4fcf HTTP/1.1" 200 None 2025-09-27 19:57:39,612 - lava_callback - DEBUG - Processing node 68d76388a6a7b6615d4c4fcf: baseline-arm64-broonie 2025-09-27 19:57:39,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:57:40,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:57:40,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d76388a6a7b6615d4c4fcf/log.txt.gz 2025-09-27 19:57:40,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:57:40,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:57:40,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d76388a6a7b6615d4c4fcf/lava_callback.json.gz 2025-09-27 19:57:40,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:40,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76388a6a7b6615d4c4fcf HTTP/1.1" 200 None 2025-09-27 19:57:40,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:40,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 19:57:40,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:40,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76388a6a7b6615d4c4fcf HTTP/1.1" 200 None 2025-09-27 19:57:40,258 - lava_callback - INFO - Completed processing callback for node 68d76388a6a7b6615d4c4fcf INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:57:52,506 - lava_callback - INFO - Received callback for node 68d75705a6a7b6615d4c4dad INFO: 172.21.0.1:46678 - "POST /node/68d75705a6a7b6615d4c4dad HTTP/1.0" 202 Accepted 2025-09-27 19:57:52,513 - lava_callback - INFO - Starting async job submit for node 68d75705a6a7b6615d4c4dad 2025-09-27 19:57:52,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:52,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75705a6a7b6615d4c4dad HTTP/1.1" 200 None 2025-09-27 19:57:52,569 - lava_callback - DEBUG - Processing node 68d75705a6a7b6615d4c4dad: baseline-arm64 2025-09-27 19:57:53,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:57:53,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:57:53,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75705a6a7b6615d4c4dad/log.txt.gz 2025-09-27 19:57:53,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:57:53,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:57:53,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75705a6a7b6615d4c4dad/lava_callback.json.gz DEBUG: Setup failed for 68d75705a6a7b6615d4c4dad. Transitting job node result: incomplete -> fail 2025-09-27 19:57:53,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:53,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75705a6a7b6615d4c4dad HTTP/1.1" 200 None 2025-09-27 19:57:53,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:53,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:57:53,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:57:53,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75705a6a7b6615d4c4dad HTTP/1.1" 200 None 2025-09-27 19:57:53,932 - lava_callback - INFO - Completed processing callback for node 68d75705a6a7b6615d4c4dad INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48454 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:58:11,527 - lava_callback - INFO - Received callback for node 68d75706a6a7b6615d4c4db0 INFO: 172.21.0.1:46728 - "POST /node/68d75706a6a7b6615d4c4db0 HTTP/1.0" 202 Accepted 2025-09-27 19:58:11,537 - lava_callback - INFO - Starting async job submit for node 68d75706a6a7b6615d4c4db0 2025-09-27 19:58:11,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:58:11,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75706a6a7b6615d4c4db0 HTTP/1.1" 200 None 2025-09-27 19:58:11,594 - lava_callback - DEBUG - Processing node 68d75706a6a7b6615d4c4db0: baseline-arm64 2025-09-27 19:58:12,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:58:12,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:58:12,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75706a6a7b6615d4c4db0/log.txt.gz 2025-09-27 19:58:12,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:58:12,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:58:12,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75706a6a7b6615d4c4db0/lava_callback.json.gz DEBUG: Setup failed for 68d75706a6a7b6615d4c4db0. Transitting job node result: incomplete -> fail 2025-09-27 19:58:12,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:58:12,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75706a6a7b6615d4c4db0 HTTP/1.1" 200 None 2025-09-27 19:58:12,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:58:12,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 19:58:12,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:58:12,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75706a6a7b6615d4c4db0 HTTP/1.1" 200 None 2025-09-27 19:58:12,942 - lava_callback - INFO - Completed processing callback for node 68d75706a6a7b6615d4c4db0 INFO: 172.21.0.1:46742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK 2025-09-27 19:59:00,732 - lava_callback - INFO - Received callback for node 68d7bf358dd6b39fd1aeb05c INFO: 172.21.0.1:36662 - "POST /node/68d7bf358dd6b39fd1aeb05c HTTP/1.0" 202 Accepted 2025-09-27 19:59:00,738 - lava_callback - INFO - Starting async job submit for node 68d7bf358dd6b39fd1aeb05c 2025-09-27 19:59:00,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:59:00,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf358dd6b39fd1aeb05c HTTP/1.1" 200 None 2025-09-27 19:59:00,785 - lava_callback - DEBUG - Processing node 68d7bf358dd6b39fd1aeb05c: baseline-arm 2025-09-27 19:59:01,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:59:01,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:59:01,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf358dd6b39fd1aeb05c/log.txt.gz 2025-09-27 19:59:01,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 19:59:01,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 19:59:01,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf358dd6b39fd1aeb05c/lava_callback.json.gz 2025-09-27 19:59:01,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:59:01,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf358dd6b39fd1aeb05c HTTP/1.1" 200 None 2025-09-27 19:59:01,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:59:01,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 19:59:01,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 19:59:01,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf358dd6b39fd1aeb05c HTTP/1.1" 200 None 2025-09-27 19:59:01,402 - lava_callback - INFO - Completed processing callback for node 68d7bf358dd6b39fd1aeb05c INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:00:52,809 - lava_callback - INFO - Received callback for node 68d5a8f22be2da466069a2f7 INFO: 172.21.0.1:42972 - "POST /node/68d5a8f22be2da466069a2f7 HTTP/1.0" 202 Accepted 2025-09-27 20:00:52,816 - lava_callback - INFO - Starting async job submit for node 68d5a8f22be2da466069a2f7 2025-09-27 20:00:52,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:00:52,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8f22be2da466069a2f7 HTTP/1.1" 200 None 2025-09-27 20:00:52,854 - lava_callback - DEBUG - Processing node 68d5a8f22be2da466069a2f7: ltp-timers 2025-09-27 20:00:53,176 - lava_callback - ERROR - Error processing callback for node 68d5a8f22be2da466069a2f7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:01:20,722 - lava_callback - INFO - Received callback for node 68d7bf368dd6b39fd1aeb062 INFO: 172.21.0.1:54350 - "POST /node/68d7bf368dd6b39fd1aeb062 HTTP/1.0" 202 Accepted 2025-09-27 20:01:20,728 - lava_callback - INFO - Starting async job submit for node 68d7bf368dd6b39fd1aeb062 2025-09-27 20:01:20,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:01:20,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf368dd6b39fd1aeb062 HTTP/1.1" 200 None 2025-09-27 20:01:20,789 - lava_callback - DEBUG - Processing node 68d7bf368dd6b39fd1aeb062: baseline-arm 2025-09-27 20:01:21,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:01:21,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:01:21,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf368dd6b39fd1aeb062/log.txt.gz 2025-09-27 20:01:21,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:01:21,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:01:21,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf368dd6b39fd1aeb062/lava_callback.json.gz 2025-09-27 20:01:21,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:01:21,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf368dd6b39fd1aeb062 HTTP/1.1" 200 None 2025-09-27 20:01:21,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:01:21,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:01:21,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:01:21,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf368dd6b39fd1aeb062 HTTP/1.1" 200 None 2025-09-27 20:01:21,483 - lava_callback - INFO - Completed processing callback for node 68d7bf368dd6b39fd1aeb062 INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:02:14,035 - lava_callback - INFO - Received callback for node 68d5a8ef2be2da466069a2f1 INFO: 172.21.0.1:33436 - "POST /node/68d5a8ef2be2da466069a2f1 HTTP/1.0" 202 Accepted 2025-09-27 20:02:14,053 - lava_callback - INFO - Starting async job submit for node 68d5a8ef2be2da466069a2f1 INFO: 172.21.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 20:02:15,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:02:15,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8ef2be2da466069a2f1 HTTP/1.1" 200 None 2025-09-27 20:02:15,359 - lava_callback - DEBUG - Processing node 68d5a8ef2be2da466069a2f1: ltp-syscalls INFO: 172.21.0.1:33450 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:02:22,152 - lava_callback - ERROR - Error processing callback for node 68d5a8ef2be2da466069a2f1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:02:33,217 - lava_callback - INFO - Received callback for node 68d5a8ec2be2da466069a2eb INFO: 172.21.0.1:58976 - "POST /node/68d5a8ec2be2da466069a2eb HTTP/1.0" 202 Accepted 2025-09-27 20:02:33,225 - lava_callback - INFO - Starting async job submit for node 68d5a8ec2be2da466069a2eb 2025-09-27 20:02:33,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:02:33,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8ec2be2da466069a2eb HTTP/1.1" 200 None 2025-09-27 20:02:33,282 - lava_callback - DEBUG - Processing node 68d5a8ec2be2da466069a2eb: ltp-sched 2025-09-27 20:02:33,873 - lava_callback - ERROR - Error processing callback for node 68d5a8ec2be2da466069a2eb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:03:39,612 - lava_callback - INFO - Received callback for node 68d7709ea6a7b6615d4c512a INFO: 172.21.0.1:40300 - "POST /node/68d7709ea6a7b6615d4c512a HTTP/1.0" 202 Accepted 2025-09-27 20:03:39,618 - lava_callback - INFO - Starting async job submit for node 68d7709ea6a7b6615d4c512a 2025-09-27 20:03:39,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:03:39,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7709ea6a7b6615d4c512a HTTP/1.1" 200 None 2025-09-27 20:03:39,649 - lava_callback - DEBUG - Processing node 68d7709ea6a7b6615d4c512a: baseline-arm64-broonie 2025-09-27 20:03:39,941 - lava_callback - INFO - Received callback for node 68d7bf378dd6b39fd1aeb065 INFO: 172.21.0.1:40310 - "POST /node/68d7bf378dd6b39fd1aeb065 HTTP/1.0" 202 Accepted 2025-09-27 20:03:39,952 - lava_callback - INFO - Starting async job submit for node 68d7bf378dd6b39fd1aeb065 2025-09-27 20:03:39,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:03:39,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:03:39,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf378dd6b39fd1aeb065 HTTP/1.1" 200 None 2025-09-27 20:03:39,994 - lava_callback - DEBUG - Processing node 68d7bf378dd6b39fd1aeb065: baseline-arm 2025-09-27 20:03:40,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:03:40,226 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7709ea6a7b6615d4c512a/log.txt.gz 2025-09-27 20:03:40,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:03:40,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:03:40,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:03:40,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf378dd6b39fd1aeb065/log.txt.gz 2025-09-27 20:03:40,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:03:40,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:03:40,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7709ea6a7b6615d4c512a/lava_callback.json.gz 2025-09-27 20:03:40,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:03:40,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7709ea6a7b6615d4c512a HTTP/1.1" 200 None 2025-09-27 20:03:40,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:03:40,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:03:40,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:03:40,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7709ea6a7b6615d4c512a HTTP/1.1" 200 None 2025-09-27 20:03:40,563 - lava_callback - INFO - Completed processing callback for node 68d7709ea6a7b6615d4c512a 2025-09-27 20:03:40,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:03:40,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf378dd6b39fd1aeb065/lava_callback.json.gz 2025-09-27 20:03:40,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:03:40,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf378dd6b39fd1aeb065 HTTP/1.1" 200 None 2025-09-27 20:03:40,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:03:40,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:03:40,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:03:40,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf378dd6b39fd1aeb065 HTTP/1.1" 200 None 2025-09-27 20:03:40,713 - lava_callback - INFO - Completed processing callback for node 68d7bf378dd6b39fd1aeb065 INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:05:13,126 - lava_callback - INFO - Received callback for node 68d5a8f42be2da466069a2fa INFO: 172.21.0.1:55360 - "POST /node/68d5a8f42be2da466069a2fa HTTP/1.0" 202 Accepted 2025-09-27 20:05:13,133 - lava_callback - INFO - Starting async job submit for node 68d5a8f42be2da466069a2fa 2025-09-27 20:05:13,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:05:13,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8f42be2da466069a2fa HTTP/1.1" 200 None 2025-09-27 20:05:13,196 - lava_callback - DEBUG - Processing node 68d5a8f42be2da466069a2fa: ltp-watchqueue 2025-09-27 20:05:13,583 - lava_callback - ERROR - Error processing callback for node 68d5a8f42be2da466069a2fa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:05:39,405 - lava_callback - INFO - Received callback for node 68d77d8ca6a7b6615d4c5155 INFO: 172.21.0.1:41602 - "POST /node/68d77d8ca6a7b6615d4c5155 HTTP/1.0" 202 Accepted 2025-09-27 20:05:39,411 - lava_callback - INFO - Starting async job submit for node 68d77d8ca6a7b6615d4c5155 2025-09-27 20:05:39,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:05:39,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d8ca6a7b6615d4c5155 HTTP/1.1" 200 None 2025-09-27 20:05:39,441 - lava_callback - DEBUG - Processing node 68d77d8ca6a7b6615d4c5155: baseline-arm64-broonie 2025-09-27 20:05:39,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:05:39,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:05:39,899 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d77d8ca6a7b6615d4c5155/log.txt.gz 2025-09-27 20:05:39,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:05:40,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:05:40,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d77d8ca6a7b6615d4c5155/lava_callback.json.gz 2025-09-27 20:05:40,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:05:40,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d8ca6a7b6615d4c5155 HTTP/1.1" 200 None 2025-09-27 20:05:40,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:05:40,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:05:40,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:05:40,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d8ca6a7b6615d4c5155 HTTP/1.1" 200 None 2025-09-27 20:05:40,111 - lava_callback - INFO - Completed processing callback for node 68d77d8ca6a7b6615d4c5155 INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:06:09,932 - lava_callback - INFO - Received callback for node 68d7bf388dd6b39fd1aeb068 INFO: 172.21.0.1:50930 - "POST /node/68d7bf388dd6b39fd1aeb068 HTTP/1.0" 202 Accepted 2025-09-27 20:06:09,938 - lava_callback - INFO - Starting async job submit for node 68d7bf388dd6b39fd1aeb068 2025-09-27 20:06:09,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:06:09,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf388dd6b39fd1aeb068 HTTP/1.1" 200 None 2025-09-27 20:06:09,971 - lava_callback - DEBUG - Processing node 68d7bf388dd6b39fd1aeb068: baseline-arm 2025-09-27 20:06:10,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:06:10,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:06:10,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf388dd6b39fd1aeb068/log.txt.gz 2025-09-27 20:06:10,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:06:10,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:06:10,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf388dd6b39fd1aeb068/lava_callback.json.gz 2025-09-27 20:06:10,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:06:10,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf388dd6b39fd1aeb068 HTTP/1.1" 200 None 2025-09-27 20:06:10,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:06:10,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:06:10,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:06:10,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf388dd6b39fd1aeb068 HTTP/1.1" 200 None 2025-09-27 20:06:10,562 - lava_callback - INFO - Completed processing callback for node 68d7bf388dd6b39fd1aeb068 INFO: 172.21.0.1:50944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:07:38,995 - lava_callback - INFO - Received callback for node 68d78b73a6a7b6615d4c52d5 INFO: 172.21.0.1:40152 - "POST /node/68d78b73a6a7b6615d4c52d5 HTTP/1.0" 202 Accepted 2025-09-27 20:07:39,002 - lava_callback - INFO - Starting async job submit for node 68d78b73a6a7b6615d4c52d5 2025-09-27 20:07:39,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:07:39,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b73a6a7b6615d4c52d5 HTTP/1.1" 200 None 2025-09-27 20:07:39,034 - lava_callback - DEBUG - Processing node 68d78b73a6a7b6615d4c52d5: baseline-arm64-broonie 2025-09-27 20:07:39,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:07:39,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:07:39,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d78b73a6a7b6615d4c52d5/log.txt.gz 2025-09-27 20:07:39,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:07:39,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:07:39,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d78b73a6a7b6615d4c52d5/lava_callback.json.gz 2025-09-27 20:07:39,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:07:39,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b73a6a7b6615d4c52d5 HTTP/1.1" 200 None 2025-09-27 20:07:39,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:07:39,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 20:07:39,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:07:39,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b73a6a7b6615d4c52d5 HTTP/1.1" 200 None 2025-09-27 20:07:39,822 - lava_callback - INFO - Completed processing callback for node 68d78b73a6a7b6615d4c52d5 INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:08:21,213 - lava_callback - INFO - Received callback for node 68d7bf398dd6b39fd1aeb06b INFO: 172.21.0.1:47262 - "POST /node/68d7bf398dd6b39fd1aeb06b HTTP/1.0" 202 Accepted 2025-09-27 20:08:21,219 - lava_callback - INFO - Starting async job submit for node 68d7bf398dd6b39fd1aeb06b 2025-09-27 20:08:21,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:08:21,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf398dd6b39fd1aeb06b HTTP/1.1" 200 None 2025-09-27 20:08:21,252 - lava_callback - DEBUG - Processing node 68d7bf398dd6b39fd1aeb06b: baseline-arm 2025-09-27 20:08:21,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:08:21,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:08:21,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf398dd6b39fd1aeb06b/log.txt.gz 2025-09-27 20:08:21,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:08:21,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:08:21,776 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf398dd6b39fd1aeb06b/lava_callback.json.gz 2025-09-27 20:08:21,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:08:21,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf398dd6b39fd1aeb06b HTTP/1.1" 200 None 2025-09-27 20:08:21,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:08:21,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:08:21,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:08:21,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf398dd6b39fd1aeb06b HTTP/1.1" 200 None 2025-09-27 20:08:21,852 - lava_callback - INFO - Completed processing callback for node 68d7bf398dd6b39fd1aeb06b INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:10:40,812 - lava_callback - INFO - Received callback for node 68d7bf3a8dd6b39fd1aeb06e INFO: 172.21.0.1:43270 - "POST /node/68d7bf3a8dd6b39fd1aeb06e HTTP/1.0" 202 Accepted 2025-09-27 20:10:40,818 - lava_callback - INFO - Starting async job submit for node 68d7bf3a8dd6b39fd1aeb06e 2025-09-27 20:10:40,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:10:40,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf3a8dd6b39fd1aeb06e HTTP/1.1" 200 None 2025-09-27 20:10:40,854 - lava_callback - DEBUG - Processing node 68d7bf3a8dd6b39fd1aeb06e: baseline-arm 2025-09-27 20:10:41,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:10:41,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:10:41,232 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf3a8dd6b39fd1aeb06e/log.txt.gz 2025-09-27 20:10:41,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:10:41,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:10:41,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf3a8dd6b39fd1aeb06e/lava_callback.json.gz 2025-09-27 20:10:41,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:10:41,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf3a8dd6b39fd1aeb06e HTTP/1.1" 200 None 2025-09-27 20:10:41,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:10:41,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:10:41,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:10:41,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf3a8dd6b39fd1aeb06e HTTP/1.1" 200 None 2025-09-27 20:10:41,465 - lava_callback - INFO - Completed processing callback for node 68d7bf3a8dd6b39fd1aeb06e 2025-09-27 20:10:42,833 - lava_callback - INFO - Received callback for node 68d78ba2a6a7b6615d4c52fb INFO: 172.21.0.1:43274 - "POST /node/68d78ba2a6a7b6615d4c52fb HTTP/1.0" 202 Accepted 2025-09-27 20:10:42,839 - lava_callback - INFO - Starting async job submit for node 68d78ba2a6a7b6615d4c52fb 2025-09-27 20:10:42,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:10:42,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78ba2a6a7b6615d4c52fb HTTP/1.1" 200 None 2025-09-27 20:10:42,870 - lava_callback - DEBUG - Processing node 68d78ba2a6a7b6615d4c52fb: baseline-arm64-broonie 2025-09-27 20:10:43,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:10:43,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:10:43,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d78ba2a6a7b6615d4c52fb/log.txt.gz 2025-09-27 20:10:43,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:10:43,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:10:43,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d78ba2a6a7b6615d4c52fb/lava_callback.json.gz 2025-09-27 20:10:43,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:10:43,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78ba2a6a7b6615d4c52fb HTTP/1.1" 200 None 2025-09-27 20:10:43,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:10:43,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 20:10:43,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:10:43,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78ba2a6a7b6615d4c52fb HTTP/1.1" 200 None 2025-09-27 20:10:43,546 - lava_callback - INFO - Completed processing callback for node 68d78ba2a6a7b6615d4c52fb INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:11:23,859 - lava_callback - INFO - Received callback for node 68d5a5e02be2da466069a182 INFO: 172.21.0.1:39278 - "POST /node/68d5a5e02be2da466069a182 HTTP/1.0" 202 Accepted 2025-09-27 20:11:23,866 - lava_callback - INFO - Starting async job submit for node 68d5a5e02be2da466069a182 2025-09-27 20:11:23,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:11:23,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5e02be2da466069a182 HTTP/1.1" 200 None 2025-09-27 20:11:23,929 - lava_callback - DEBUG - Processing node 68d5a5e02be2da466069a182: baseline-arm 2025-09-27 20:11:24,193 - lava_callback - ERROR - Error processing callback for node 68d5a5e02be2da466069a182: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:12:05,671 - lava_callback - INFO - Received callback for node 68d5a8f12be2da466069a2f4 INFO: 172.21.0.1:51604 - "POST /node/68d5a8f12be2da466069a2f4 HTTP/1.0" 202 Accepted 2025-09-27 20:12:05,678 - lava_callback - INFO - Starting async job submit for node 68d5a8f12be2da466069a2f4 2025-09-27 20:12:05,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:12:05,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8f12be2da466069a2f4 HTTP/1.1" 200 None 2025-09-27 20:12:05,743 - lava_callback - DEBUG - Processing node 68d5a8f12be2da466069a2f4: ltp-syscalls-ipc 2025-09-27 20:12:06,476 - lava_callback - ERROR - Error processing callback for node 68d5a8f12be2da466069a2f4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:12:59,918 - lava_callback - INFO - Received callback for node 68d7bf3b8dd6b39fd1aeb071 INFO: 172.21.0.1:45094 - "POST /node/68d7bf3b8dd6b39fd1aeb071 HTTP/1.0" 202 Accepted 2025-09-27 20:12:59,924 - lava_callback - INFO - Starting async job submit for node 68d7bf3b8dd6b39fd1aeb071 2025-09-27 20:12:59,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:12:59,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf3b8dd6b39fd1aeb071 HTTP/1.1" 200 None 2025-09-27 20:12:59,957 - lava_callback - DEBUG - Processing node 68d7bf3b8dd6b39fd1aeb071: baseline-arm 2025-09-27 20:13:00,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:13:00,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:13:00,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf3b8dd6b39fd1aeb071/log.txt.gz 2025-09-27 20:13:00,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:13:00,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:13:00,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf3b8dd6b39fd1aeb071/lava_callback.json.gz 2025-09-27 20:13:00,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:13:00,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf3b8dd6b39fd1aeb071 HTTP/1.1" 200 None 2025-09-27 20:13:00,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:13:00,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:13:00,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:13:00,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf3b8dd6b39fd1aeb071 HTTP/1.1" 200 None 2025-09-27 20:13:00,565 - lava_callback - INFO - Completed processing callback for node 68d7bf3b8dd6b39fd1aeb071 INFO: 172.21.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52584 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:13:17,147 - lava_callback - INFO - Received callback for node 68d7a1b98dd6b39fd1aea6e9 INFO: 172.21.0.1:52596 - "POST /node/68d7a1b98dd6b39fd1aea6e9 HTTP/1.0" 202 Accepted 2025-09-27 20:13:17,153 - lava_callback - INFO - Starting async job submit for node 68d7a1b98dd6b39fd1aea6e9 2025-09-27 20:13:17,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:13:17,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1b98dd6b39fd1aea6e9 HTTP/1.1" 200 None 2025-09-27 20:13:17,183 - lava_callback - DEBUG - Processing node 68d7a1b98dd6b39fd1aea6e9: baseline-arm64-broonie 2025-09-27 20:13:17,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:13:17,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:13:17,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7a1b98dd6b39fd1aea6e9/log.txt.gz 2025-09-27 20:13:17,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:13:17,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:13:17,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7a1b98dd6b39fd1aea6e9/lava_callback.json.gz 2025-09-27 20:13:17,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:13:17,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1b98dd6b39fd1aea6e9 HTTP/1.1" 200 None 2025-09-27 20:13:17,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:13:17,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79ae2a6a7b6615d4c53f2 HTTP/1.1" 200 None 2025-09-27 20:13:17,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:13:17,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a1b98dd6b39fd1aea6e9 HTTP/1.1" 200 None 2025-09-27 20:13:17,886 - lava_callback - INFO - Completed processing callback for node 68d7a1b98dd6b39fd1aea6e9 INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:15:18,575 - lava_callback - INFO - Received callback for node 68d7bf458dd6b39fd1aeb08f INFO: 172.21.0.1:55208 - "POST /node/68d7bf458dd6b39fd1aeb08f HTTP/1.0" 202 Accepted 2025-09-27 20:15:18,581 - lava_callback - INFO - Starting async job submit for node 68d7bf458dd6b39fd1aeb08f 2025-09-27 20:15:18,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:15:18,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf458dd6b39fd1aeb08f HTTP/1.1" 200 None 2025-09-27 20:15:18,615 - lava_callback - DEBUG - Processing node 68d7bf458dd6b39fd1aeb08f: baseline-arm 2025-09-27 20:15:18,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:15:18,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:15:18,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf458dd6b39fd1aeb08f/log.txt.gz 2025-09-27 20:15:18,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:15:19,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:15:19,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf458dd6b39fd1aeb08f/lava_callback.json.gz 2025-09-27 20:15:19,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:15:19,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf458dd6b39fd1aeb08f HTTP/1.1" 200 None 2025-09-27 20:15:19,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:15:19,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:15:19,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:15:19,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf458dd6b39fd1aeb08f HTTP/1.1" 200 None 2025-09-27 20:15:19,212 - lava_callback - INFO - Completed processing callback for node 68d7bf458dd6b39fd1aeb08f INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:16:17,809 - lava_callback - INFO - Received callback for node 68d7a68f8dd6b39fd1aeaaff INFO: 172.21.0.1:38572 - "POST /node/68d7a68f8dd6b39fd1aeaaff HTTP/1.0" 202 Accepted 2025-09-27 20:16:17,815 - lava_callback - INFO - Starting async job submit for node 68d7a68f8dd6b39fd1aeaaff 2025-09-27 20:16:17,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:16:17,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a68f8dd6b39fd1aeaaff HTTP/1.1" 200 None 2025-09-27 20:16:17,868 - lava_callback - DEBUG - Processing node 68d7a68f8dd6b39fd1aeaaff: baseline-arm64-broonie 2025-09-27 20:16:18,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:16:18,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:16:18,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7a68f8dd6b39fd1aeaaff/log.txt.gz 2025-09-27 20:16:18,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:16:18,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:16:18,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7a68f8dd6b39fd1aeaaff/lava_callback.json.gz 2025-09-27 20:16:18,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:16:18,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a68f8dd6b39fd1aeaaff HTTP/1.1" 200 None 2025-09-27 20:16:18,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:16:18,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eda8dd6b39fd1aea2de HTTP/1.1" 200 None 2025-09-27 20:16:18,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:16:18,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a68f8dd6b39fd1aeaaff HTTP/1.1" 200 None 2025-09-27 20:16:18,578 - lava_callback - INFO - Completed processing callback for node 68d7a68f8dd6b39fd1aeaaff INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:17:42,830 - lava_callback - INFO - Received callback for node 68d7bf458dd6b39fd1aeb092 INFO: 172.21.0.1:46432 - "POST /node/68d7bf458dd6b39fd1aeb092 HTTP/1.0" 202 Accepted 2025-09-27 20:17:42,836 - lava_callback - INFO - Starting async job submit for node 68d7bf458dd6b39fd1aeb092 2025-09-27 20:17:42,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:17:42,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf458dd6b39fd1aeb092 HTTP/1.1" 200 None 2025-09-27 20:17:42,870 - lava_callback - DEBUG - Processing node 68d7bf458dd6b39fd1aeb092: baseline-arm 2025-09-27 20:17:43,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:17:43,268 - lava_callback - INFO - Received callback for node 68d75708a6a7b6615d4c4db3 INFO: 172.21.0.1:46442 - "POST /node/68d75708a6a7b6615d4c4db3 HTTP/1.0" 202 Accepted 2025-09-27 20:17:43,275 - lava_callback - INFO - Starting async job submit for node 68d75708a6a7b6615d4c4db3 2025-09-27 20:17:43,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:17:43,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75708a6a7b6615d4c4db3 HTTP/1.1" 200 None 2025-09-27 20:17:43,347 - lava_callback - DEBUG - Processing node 68d75708a6a7b6615d4c4db3: baseline-arm64 2025-09-27 20:17:43,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:17:43,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf458dd6b39fd1aeb092/log.txt.gz 2025-09-27 20:17:43,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:17:43,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:17:43,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf458dd6b39fd1aeb092/lava_callback.json.gz 2025-09-27 20:17:43,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:17:43,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf458dd6b39fd1aeb092 HTTP/1.1" 200 None 2025-09-27 20:17:43,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:17:44,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:17:44,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:17:44,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf458dd6b39fd1aeb092 HTTP/1.1" 200 None 2025-09-27 20:17:44,161 - lava_callback - INFO - Completed processing callback for node 68d7bf458dd6b39fd1aeb092 2025-09-27 20:17:44,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:17:44,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:17:44,490 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75708a6a7b6615d4c4db3/log.txt.gz 2025-09-27 20:17:44,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:17:44,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:17:44,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75708a6a7b6615d4c4db3/lava_callback.json.gz DEBUG: Setup failed for 68d75708a6a7b6615d4c4db3. Transitting job node result: incomplete -> fail 2025-09-27 20:17:44,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:17:44,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75708a6a7b6615d4c4db3 HTTP/1.1" 200 None 2025-09-27 20:17:44,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:17:44,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 20:17:44,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:17:44,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75708a6a7b6615d4c4db3 HTTP/1.1" 200 None 2025-09-27 20:17:44,806 - lava_callback - INFO - Completed processing callback for node 68d75708a6a7b6615d4c4db3 INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:18:32,264 - lava_callback - INFO - Received callback for node 68d75709a6a7b6615d4c4db6 INFO: 172.21.0.1:53066 - "POST /node/68d75709a6a7b6615d4c4db6 HTTP/1.0" 202 Accepted 2025-09-27 20:18:32,271 - lava_callback - INFO - Starting async job submit for node 68d75709a6a7b6615d4c4db6 2025-09-27 20:18:32,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:18:32,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75709a6a7b6615d4c4db6 HTTP/1.1" 200 None 2025-09-27 20:18:32,354 - lava_callback - DEBUG - Processing node 68d75709a6a7b6615d4c4db6: baseline-arm64 2025-09-27 20:18:33,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:18:33,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:18:33,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75709a6a7b6615d4c4db6/log.txt.gz 2025-09-27 20:18:33,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:18:33,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:18:33,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d75709a6a7b6615d4c4db6/lava_callback.json.gz DEBUG: Setup failed for 68d75709a6a7b6615d4c4db6. Transitting job node result: incomplete -> fail 2025-09-27 20:18:33,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:18:33,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d75709a6a7b6615d4c4db6 HTTP/1.1" 200 None 2025-09-27 20:18:33,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:18:33,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 20:18:33,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:18:33,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d75709a6a7b6615d4c4db6 HTTP/1.1" 200 None 2025-09-27 20:18:33,757 - lava_callback - INFO - Completed processing callback for node 68d75709a6a7b6615d4c4db6 INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:18:51,639 - lava_callback - INFO - Received callback for node 68d7570ca6a7b6615d4c4db9 INFO: 172.21.0.1:35468 - "POST /node/68d7570ca6a7b6615d4c4db9 HTTP/1.0" 202 Accepted 2025-09-27 20:18:51,646 - lava_callback - INFO - Starting async job submit for node 68d7570ca6a7b6615d4c4db9 2025-09-27 20:18:51,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:18:51,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7570ca6a7b6615d4c4db9 HTTP/1.1" 200 None 2025-09-27 20:18:51,708 - lava_callback - DEBUG - Processing node 68d7570ca6a7b6615d4c4db9: baseline-arm64 2025-09-27 20:18:52,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:18:52,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:18:52,791 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7570ca6a7b6615d4c4db9/log.txt.gz 2025-09-27 20:18:52,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:18:52,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:18:52,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7570ca6a7b6615d4c4db9/lava_callback.json.gz DEBUG: Setup failed for 68d7570ca6a7b6615d4c4db9. Transitting job node result: incomplete -> fail 2025-09-27 20:18:53,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:18:53,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7570ca6a7b6615d4c4db9 HTTP/1.1" 200 None 2025-09-27 20:18:53,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:18:53,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 20:18:53,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:18:53,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7570ca6a7b6615d4c4db9 HTTP/1.1" 200 None 2025-09-27 20:18:53,137 - lava_callback - INFO - Completed processing callback for node 68d7570ca6a7b6615d4c4db9 INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:20:00,589 - lava_callback - INFO - Received callback for node 68d7bf478dd6b39fd1aeb095 INFO: 172.21.0.1:47840 - "POST /node/68d7bf478dd6b39fd1aeb095 HTTP/1.0" 202 Accepted 2025-09-27 20:20:00,595 - lava_callback - INFO - Starting async job submit for node 68d7bf478dd6b39fd1aeb095 2025-09-27 20:20:00,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:20:00,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf478dd6b39fd1aeb095 HTTP/1.1" 200 None 2025-09-27 20:20:00,631 - lava_callback - DEBUG - Processing node 68d7bf478dd6b39fd1aeb095: baseline-arm INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:20:00,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:20:01,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:20:01,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf478dd6b39fd1aeb095/log.txt.gz 2025-09-27 20:20:01,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:20:01,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:20:01,158 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf478dd6b39fd1aeb095/lava_callback.json.gz 2025-09-27 20:20:01,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:20:01,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf478dd6b39fd1aeb095 HTTP/1.1" 200 None 2025-09-27 20:20:01,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:20:01,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:20:01,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:20:01,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf478dd6b39fd1aeb095 HTTP/1.1" 200 None 2025-09-27 20:20:01,266 - lava_callback - INFO - Completed processing callback for node 68d7bf478dd6b39fd1aeb095 INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:22:20,744 - lava_callback - INFO - Received callback for node 68d7bf478dd6b39fd1aeb098 INFO: 172.21.0.1:33998 - "POST /node/68d7bf478dd6b39fd1aeb098 HTTP/1.0" 202 Accepted 2025-09-27 20:22:20,750 - lava_callback - INFO - Starting async job submit for node 68d7bf478dd6b39fd1aeb098 2025-09-27 20:22:20,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:22:20,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf478dd6b39fd1aeb098 HTTP/1.1" 200 None 2025-09-27 20:22:20,791 - lava_callback - DEBUG - Processing node 68d7bf478dd6b39fd1aeb098: baseline-arm 2025-09-27 20:22:21,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:22:21,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:22:21,178 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf478dd6b39fd1aeb098/log.txt.gz 2025-09-27 20:22:21,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:22:21,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:22:21,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf478dd6b39fd1aeb098/lava_callback.json.gz 2025-09-27 20:22:21,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:22:21,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf478dd6b39fd1aeb098 HTTP/1.1" 200 None 2025-09-27 20:22:21,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:22:21,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:22:21,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:22:21,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf478dd6b39fd1aeb098 HTTP/1.1" 200 None 2025-09-27 20:22:21,435 - lava_callback - INFO - Completed processing callback for node 68d7bf478dd6b39fd1aeb098 INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:23:01,407 - lava_callback - INFO - Received callback for node 68d7b0cc8dd6b39fd1aeaded INFO: 172.21.0.1:58404 - "POST /node/68d7b0cc8dd6b39fd1aeaded HTTP/1.0" 202 Accepted 2025-09-27 20:23:01,413 - lava_callback - INFO - Starting async job submit for node 68d7b0cc8dd6b39fd1aeaded 2025-09-27 20:23:01,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:23:01,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7b0cc8dd6b39fd1aeaded HTTP/1.1" 200 None 2025-09-27 20:23:01,443 - lava_callback - DEBUG - Processing node 68d7b0cc8dd6b39fd1aeaded: baseline-arm64-broonie INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:23:01,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:23:01,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:23:01,862 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7b0cc8dd6b39fd1aeaded/log.txt.gz 2025-09-27 20:23:01,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:23:02,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:23:02,012 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7b0cc8dd6b39fd1aeaded/lava_callback.json.gz 2025-09-27 20:23:02,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:23:02,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7b0cc8dd6b39fd1aeaded HTTP/1.1" 200 None 2025-09-27 20:23:02,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:23:02,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-27 20:23:02,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:23:02,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7b0cc8dd6b39fd1aeaded HTTP/1.1" 200 None 2025-09-27 20:23:02,127 - lava_callback - INFO - Completed processing callback for node 68d7b0cc8dd6b39fd1aeaded INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:24:37,544 - lava_callback - INFO - Received callback for node 68d7bf498dd6b39fd1aeb09b INFO: 172.21.0.1:48776 - "POST /node/68d7bf498dd6b39fd1aeb09b HTTP/1.0" 202 Accepted 2025-09-27 20:24:37,550 - lava_callback - INFO - Starting async job submit for node 68d7bf498dd6b39fd1aeb09b 2025-09-27 20:24:37,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:24:37,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf498dd6b39fd1aeb09b HTTP/1.1" 200 None 2025-09-27 20:24:37,609 - lava_callback - DEBUG - Processing node 68d7bf498dd6b39fd1aeb09b: baseline-arm 2025-09-27 20:24:37,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:24:38,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:24:38,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf498dd6b39fd1aeb09b/log.txt.gz 2025-09-27 20:24:38,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:24:38,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:24:38,147 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf498dd6b39fd1aeb09b/lava_callback.json.gz 2025-09-27 20:24:38,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:24:38,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf498dd6b39fd1aeb09b HTTP/1.1" 200 None 2025-09-27 20:24:38,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:24:38,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:24:38,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:24:38,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf498dd6b39fd1aeb09b HTTP/1.1" 200 None 2025-09-27 20:24:38,224 - lava_callback - INFO - Completed processing callback for node 68d7bf498dd6b39fd1aeb09b INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:26:01,815 - lava_callback - INFO - Received callback for node 68d7b11c8dd6b39fd1aeadfe INFO: 172.21.0.1:53436 - "POST /node/68d7b11c8dd6b39fd1aeadfe HTTP/1.0" 202 Accepted 2025-09-27 20:26:01,821 - lava_callback - INFO - Starting async job submit for node 68d7b11c8dd6b39fd1aeadfe 2025-09-27 20:26:01,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:26:01,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7b11c8dd6b39fd1aeadfe HTTP/1.1" 200 None 2025-09-27 20:26:01,979 - lava_callback - DEBUG - Processing node 68d7b11c8dd6b39fd1aeadfe: baseline-arm64-broonie 2025-09-27 20:26:02,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:26:02,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:26:02,437 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7b11c8dd6b39fd1aeadfe/log.txt.gz 2025-09-27 20:26:02,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:26:02,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:26:02,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7b11c8dd6b39fd1aeadfe/lava_callback.json.gz 2025-09-27 20:26:02,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:26:02,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7b11c8dd6b39fd1aeadfe HTTP/1.1" 200 None 2025-09-27 20:26:02,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:26:02,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 20:26:02,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:26:02,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7b11c8dd6b39fd1aeadfe HTTP/1.1" 200 None 2025-09-27 20:26:02,668 - lava_callback - INFO - Completed processing callback for node 68d7b11c8dd6b39fd1aeadfe INFO: 172.21.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:27:01,329 - lava_callback - INFO - Received callback for node 68d7bf498dd6b39fd1aeb09e INFO: 172.21.0.1:54224 - "POST /node/68d7bf498dd6b39fd1aeb09e HTTP/1.0" 202 Accepted 2025-09-27 20:27:01,336 - lava_callback - INFO - Starting async job submit for node 68d7bf498dd6b39fd1aeb09e 2025-09-27 20:27:01,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:27:01,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf498dd6b39fd1aeb09e HTTP/1.1" 200 None 2025-09-27 20:27:01,370 - lava_callback - DEBUG - Processing node 68d7bf498dd6b39fd1aeb09e: baseline-arm 2025-09-27 20:27:01,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:27:01,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:27:01,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf498dd6b39fd1aeb09e/log.txt.gz 2025-09-27 20:27:01,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:27:01,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:27:01,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf498dd6b39fd1aeb09e/lava_callback.json.gz 2025-09-27 20:27:01,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:27:01,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf498dd6b39fd1aeb09e HTTP/1.1" 200 None 2025-09-27 20:27:01,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:27:01,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:27:01,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:27:01,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf498dd6b39fd1aeb09e HTTP/1.1" 200 None 2025-09-27 20:27:01,961 - lava_callback - INFO - Completed processing callback for node 68d7bf498dd6b39fd1aeb09e INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:27:38,743 - lava_callback - INFO - Received callback for node 68d76338a6a7b6615d4c4f90 INFO: 172.21.0.1:34886 - "POST /node/68d76338a6a7b6615d4c4f90 HTTP/1.0" 202 Accepted 2025-09-27 20:27:38,749 - lava_callback - INFO - Starting async job submit for node 68d76338a6a7b6615d4c4f90 2025-09-27 20:27:38,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:27:38,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76338a6a7b6615d4c4f90 HTTP/1.1" 200 None 2025-09-27 20:27:38,782 - lava_callback - DEBUG - Processing node 68d76338a6a7b6615d4c4f90: baseline-arm64 2025-09-27 20:27:39,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:27:39,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:27:39,225 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76338a6a7b6615d4c4f90/log.txt.gz 2025-09-27 20:27:39,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:27:39,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:27:39,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76338a6a7b6615d4c4f90/lava_callback.json.gz 2025-09-27 20:27:39,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:27:39,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76338a6a7b6615d4c4f90 HTTP/1.1" 200 None 2025-09-27 20:27:39,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:27:39,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:27:39,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:27:39,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76338a6a7b6615d4c4f90 HTTP/1.1" 200 None 2025-09-27 20:27:39,471 - lava_callback - INFO - Completed processing callback for node 68d76338a6a7b6615d4c4f90 INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:28:23,601 - lava_callback - INFO - Received callback for node 68d76339a6a7b6615d4c4f93 INFO: 172.21.0.1:57630 - "POST /node/68d76339a6a7b6615d4c4f93 HTTP/1.0" 202 Accepted 2025-09-27 20:28:23,608 - lava_callback - INFO - Starting async job submit for node 68d76339a6a7b6615d4c4f93 2025-09-27 20:28:23,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:23,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76339a6a7b6615d4c4f93 HTTP/1.1" 200 None 2025-09-27 20:28:23,647 - lava_callback - DEBUG - Processing node 68d76339a6a7b6615d4c4f93: baseline-arm64 2025-09-27 20:28:23,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:28:24,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:28:24,093 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76339a6a7b6615d4c4f93/log.txt.gz 2025-09-27 20:28:24,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:28:24,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:28:24,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76339a6a7b6615d4c4f93/lava_callback.json.gz 2025-09-27 20:28:24,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:24,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76339a6a7b6615d4c4f93 HTTP/1.1" 200 None 2025-09-27 20:28:24,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:28:24,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:24,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76339a6a7b6615d4c4f93 HTTP/1.1" 200 None 2025-09-27 20:28:24,336 - lava_callback - INFO - Completed processing callback for node 68d76339a6a7b6615d4c4f93 INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:28:32,489 - lava_callback - INFO - Received callback for node 68d5a5e22be2da466069a188 INFO: 172.21.0.1:52056 - "POST /node/68d5a5e22be2da466069a188 HTTP/1.0" 202 Accepted 2025-09-27 20:28:32,495 - lava_callback - INFO - Starting async job submit for node 68d5a5e22be2da466069a188 2025-09-27 20:28:32,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:32,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5e22be2da466069a188 HTTP/1.1" 200 None 2025-09-27 20:28:32,508 - lava_callback - DEBUG - Processing node 68d5a5e22be2da466069a188: baseline-arm 2025-09-27 20:28:32,508 - lava_callback - ERROR - Error processing callback for node 68d5a5e22be2da466069a188: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:28:33,136 - lava_callback - INFO - Received callback for node 68d5a5e32be2da466069a18b INFO: 172.21.0.1:52070 - "POST /node/68d5a5e32be2da466069a18b HTTP/1.0" 202 Accepted 2025-09-27 20:28:33,141 - lava_callback - INFO - Starting async job submit for node 68d5a5e32be2da466069a18b 2025-09-27 20:28:33,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:33,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5e32be2da466069a18b HTTP/1.1" 200 None 2025-09-27 20:28:33,155 - lava_callback - DEBUG - Processing node 68d5a5e32be2da466069a18b: baseline-arm 2025-09-27 20:28:33,155 - lava_callback - ERROR - Error processing callback for node 68d5a5e32be2da466069a18b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60034 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:28:58,993 - lava_callback - INFO - Received callback for node 68d7633ca6a7b6615d4c4f96 INFO: 172.21.0.1:60040 - "POST /node/68d7633ca6a7b6615d4c4f96 HTTP/1.0" 202 Accepted 2025-09-27 20:28:58,999 - lava_callback - INFO - Starting async job submit for node 68d7633ca6a7b6615d4c4f96 2025-09-27 20:28:59,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:59,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7633ca6a7b6615d4c4f96 HTTP/1.1" 200 None 2025-09-27 20:28:59,043 - lava_callback - DEBUG - Processing node 68d7633ca6a7b6615d4c4f96: baseline-arm64 2025-09-27 20:28:59,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:28:59,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:28:59,511 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7633ca6a7b6615d4c4f96/log.txt.gz 2025-09-27 20:28:59,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:28:59,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:28:59,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7633ca6a7b6615d4c4f96/lava_callback.json.gz 2025-09-27 20:28:59,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:28:59,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7633ca6a7b6615d4c4f96 HTTP/1.1" 200 None 2025-09-27 20:28:59,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:59,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:28:59,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:28:59,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7633ca6a7b6615d4c4f96 HTTP/1.1" 200 None 2025-09-27 20:28:59,706 - lava_callback - INFO - Completed processing callback for node 68d7633ca6a7b6615d4c4f96 2025-09-27 20:29:02,085 - lava_callback - INFO - Received callback for node 68d7c5158dd6b39fd1aeb1e9 INFO: 172.21.0.1:57682 - "POST /node/68d7c5158dd6b39fd1aeb1e9 HTTP/1.0" 202 Accepted 2025-09-27 20:29:02,091 - lava_callback - INFO - Starting async job submit for node 68d7c5158dd6b39fd1aeb1e9 2025-09-27 20:29:02,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:02,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c5158dd6b39fd1aeb1e9 HTTP/1.1" 200 None 2025-09-27 20:29:02,126 - lava_callback - DEBUG - Processing node 68d7c5158dd6b39fd1aeb1e9: baseline-arm64-broonie 2025-09-27 20:29:02,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:29:02,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:29:02,570 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7c5158dd6b39fd1aeb1e9/log.txt.gz 2025-09-27 20:29:02,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:29:02,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:29:02,687 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7c5158dd6b39fd1aeb1e9/lava_callback.json.gz 2025-09-27 20:29:02,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:02,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c5158dd6b39fd1aeb1e9 HTTP/1.1" 200 None 2025-09-27 20:29:02,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:02,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:29:02,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:02,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c5158dd6b39fd1aeb1e9 HTTP/1.1" 200 None 2025-09-27 20:29:02,781 - lava_callback - INFO - Completed processing callback for node 68d7c5158dd6b39fd1aeb1e9 INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:29:21,425 - lava_callback - INFO - Received callback for node 68d7bf4b8dd6b39fd1aeb0a1 INFO: 172.21.0.1:57088 - "POST /node/68d7bf4b8dd6b39fd1aeb0a1 HTTP/1.0" 202 Accepted 2025-09-27 20:29:21,432 - lava_callback - INFO - Starting async job submit for node 68d7bf4b8dd6b39fd1aeb0a1 2025-09-27 20:29:21,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:21,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf4b8dd6b39fd1aeb0a1 HTTP/1.1" 200 None 2025-09-27 20:29:21,465 - lava_callback - DEBUG - Processing node 68d7bf4b8dd6b39fd1aeb0a1: baseline-arm 2025-09-27 20:29:21,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:29:22,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:29:22,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf4b8dd6b39fd1aeb0a1/log.txt.gz 2025-09-27 20:29:22,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:29:22,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:29:22,142 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf4b8dd6b39fd1aeb0a1/lava_callback.json.gz 2025-09-27 20:29:22,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:22,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf4b8dd6b39fd1aeb0a1 HTTP/1.1" 200 None 2025-09-27 20:29:22,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:22,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:29:22,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:22,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf4b8dd6b39fd1aeb0a1 HTTP/1.1" 200 None 2025-09-27 20:29:22,217 - lava_callback - INFO - Completed processing callback for node 68d7bf4b8dd6b39fd1aeb0a1 INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:29:46,128 - lava_callback - INFO - Received callback for node 68d7633da6a7b6615d4c4f99 INFO: 172.21.0.1:59116 - "POST /node/68d7633da6a7b6615d4c4f99 HTTP/1.0" 202 Accepted 2025-09-27 20:29:46,134 - lava_callback - INFO - Starting async job submit for node 68d7633da6a7b6615d4c4f99 2025-09-27 20:29:46,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:46,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7633da6a7b6615d4c4f99 HTTP/1.1" 200 None 2025-09-27 20:29:46,183 - lava_callback - DEBUG - Processing node 68d7633da6a7b6615d4c4f99: baseline-arm64 2025-09-27 20:29:46,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:29:46,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:29:46,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7633da6a7b6615d4c4f99/log.txt.gz 2025-09-27 20:29:46,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:29:46,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:29:46,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7633da6a7b6615d4c4f99/lava_callback.json.gz 2025-09-27 20:29:46,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:46,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7633da6a7b6615d4c4f99 HTTP/1.1" 200 None 2025-09-27 20:29:46,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:46,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:29:46,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:29:46,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7633da6a7b6615d4c4f99 HTTP/1.1" 200 None 2025-09-27 20:29:46,902 - lava_callback - INFO - Completed processing callback for node 68d7633da6a7b6615d4c4f99 INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:30:26,569 - lava_callback - INFO - Received callback for node 68d7633fa6a7b6615d4c4f9c INFO: 172.21.0.1:39088 - "POST /node/68d7633fa6a7b6615d4c4f9c HTTP/1.0" 202 Accepted 2025-09-27 20:30:26,575 - lava_callback - INFO - Starting async job submit for node 68d7633fa6a7b6615d4c4f9c 2025-09-27 20:30:26,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:30:26,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7633fa6a7b6615d4c4f9c HTTP/1.1" 200 None 2025-09-27 20:30:26,611 - lava_callback - DEBUG - Processing node 68d7633fa6a7b6615d4c4f9c: baseline-arm64 INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:30:26,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:30:27,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:30:27,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7633fa6a7b6615d4c4f9c/log.txt.gz 2025-09-27 20:30:27,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:30:27,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:30:27,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7633fa6a7b6615d4c4f9c/lava_callback.json.gz 2025-09-27 20:30:27,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:30:27,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7633fa6a7b6615d4c4f9c HTTP/1.1" 200 None 2025-09-27 20:30:27,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:30:27,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:30:27,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:30:27,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7633fa6a7b6615d4c4f9c HTTP/1.1" 200 None 2025-09-27 20:30:27,299 - lava_callback - INFO - Completed processing callback for node 68d7633fa6a7b6615d4c4f9c INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:31:00,371 - lava_callback - INFO - Received callback for node 68d76340a6a7b6615d4c4f9f INFO: 172.21.0.1:57004 - "POST /node/68d76340a6a7b6615d4c4f9f HTTP/1.0" 202 Accepted 2025-09-27 20:31:00,377 - lava_callback - INFO - Starting async job submit for node 68d76340a6a7b6615d4c4f9f 2025-09-27 20:31:00,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:00,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76340a6a7b6615d4c4f9f HTTP/1.1" 200 None 2025-09-27 20:31:00,411 - lava_callback - DEBUG - Processing node 68d76340a6a7b6615d4c4f9f: baseline-arm64 2025-09-27 20:31:00,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:31:00,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:31:00,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76340a6a7b6615d4c4f9f/log.txt.gz 2025-09-27 20:31:00,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:31:01,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:31:01,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76340a6a7b6615d4c4f9f/lava_callback.json.gz 2025-09-27 20:31:01,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:01,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76340a6a7b6615d4c4f9f HTTP/1.1" 200 None 2025-09-27 20:31:01,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:01,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:31:01,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:01,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76340a6a7b6615d4c4f9f HTTP/1.1" 200 None 2025-09-27 20:31:01,083 - lava_callback - INFO - Completed processing callback for node 68d76340a6a7b6615d4c4f9f INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:31:04,783 - lava_callback - INFO - Received callback for node 68d5a5e02be2da466069a185 INFO: 172.21.0.1:57034 - "POST /node/68d5a5e02be2da466069a185 HTTP/1.0" 202 Accepted 2025-09-27 20:31:04,789 - lava_callback - INFO - Starting async job submit for node 68d5a5e02be2da466069a185 2025-09-27 20:31:04,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:04,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a5e02be2da466069a185 HTTP/1.1" 200 None 2025-09-27 20:31:04,831 - lava_callback - DEBUG - Processing node 68d5a5e02be2da466069a185: baseline-arm 2025-09-27 20:31:05,096 - lava_callback - ERROR - Error processing callback for node 68d5a5e02be2da466069a185: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:31:38,836 - lava_callback - INFO - Received callback for node 68d76342a6a7b6615d4c4fa2 INFO: 172.21.0.1:59530 - "POST /node/68d76342a6a7b6615d4c4fa2 HTTP/1.0" 202 Accepted 2025-09-27 20:31:38,843 - lava_callback - INFO - Starting async job submit for node 68d76342a6a7b6615d4c4fa2 2025-09-27 20:31:38,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:38,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76342a6a7b6615d4c4fa2 HTTP/1.1" 200 None 2025-09-27 20:31:38,878 - lava_callback - DEBUG - Processing node 68d76342a6a7b6615d4c4fa2: baseline-arm64 2025-09-27 20:31:39,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:31:39,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:31:39,342 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76342a6a7b6615d4c4fa2/log.txt.gz 2025-09-27 20:31:39,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:31:39,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:31:39,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76342a6a7b6615d4c4fa2/lava_callback.json.gz 2025-09-27 20:31:39,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:39,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76342a6a7b6615d4c4fa2 HTTP/1.1" 200 None 2025-09-27 20:31:39,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:39,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:31:39,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:39,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76342a6a7b6615d4c4fa2 HTTP/1.1" 200 None 2025-09-27 20:31:39,553 - lava_callback - INFO - Completed processing callback for node 68d76342a6a7b6615d4c4fa2 2025-09-27 20:31:43,062 - lava_callback - INFO - Received callback for node 68d7bf4b8dd6b39fd1aeb0a4 INFO: 172.21.0.1:44416 - "POST /node/68d7bf4b8dd6b39fd1aeb0a4 HTTP/1.0" 202 Accepted 2025-09-27 20:31:43,068 - lava_callback - INFO - Starting async job submit for node 68d7bf4b8dd6b39fd1aeb0a4 2025-09-27 20:31:43,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:43,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf4b8dd6b39fd1aeb0a4 HTTP/1.1" 200 None 2025-09-27 20:31:43,102 - lava_callback - DEBUG - Processing node 68d7bf4b8dd6b39fd1aeb0a4: baseline-arm 2025-09-27 20:31:43,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:31:43,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:31:43,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf4b8dd6b39fd1aeb0a4/log.txt.gz 2025-09-27 20:31:43,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:31:43,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:31:43,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7bf4b8dd6b39fd1aeb0a4/lava_callback.json.gz 2025-09-27 20:31:43,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:43,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bf4b8dd6b39fd1aeb0a4 HTTP/1.1" 200 None 2025-09-27 20:31:43,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:43,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 20:31:43,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:31:43,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bf4b8dd6b39fd1aeb0a4 HTTP/1.1" 200 None 2025-09-27 20:31:43,687 - lava_callback - INFO - Completed processing callback for node 68d7bf4b8dd6b39fd1aeb0a4 INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:32:18,261 - lava_callback - INFO - Received callback for node 68d76343a6a7b6615d4c4fa5 INFO: 172.21.0.1:59480 - "POST /node/68d76343a6a7b6615d4c4fa5 HTTP/1.0" 202 Accepted 2025-09-27 20:32:18,267 - lava_callback - INFO - Starting async job submit for node 68d76343a6a7b6615d4c4fa5 2025-09-27 20:32:18,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:18,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76343a6a7b6615d4c4fa5 HTTP/1.1" 200 None 2025-09-27 20:32:18,301 - lava_callback - DEBUG - Processing node 68d76343a6a7b6615d4c4fa5: baseline-arm64 2025-09-27 20:32:18,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:32:18,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:32:18,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76343a6a7b6615d4c4fa5/log.txt.gz 2025-09-27 20:32:18,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:32:18,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:32:18,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76343a6a7b6615d4c4fa5/lava_callback.json.gz 2025-09-27 20:32:18,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:18,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76343a6a7b6615d4c4fa5 HTTP/1.1" 200 None 2025-09-27 20:32:18,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:18,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:32:18,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:18,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76343a6a7b6615d4c4fa5 HTTP/1.1" 200 None 2025-09-27 20:32:18,967 - lava_callback - INFO - Completed processing callback for node 68d76343a6a7b6615d4c4fa5 INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:32:41,340 - lava_callback - INFO - Received callback for node 68d7d2038dd6b39fd1aeb2b2 INFO: 172.21.0.1:56584 - "POST /node/68d7d2038dd6b39fd1aeb2b2 HTTP/1.0" 202 Accepted 2025-09-27 20:32:41,346 - lava_callback - INFO - Starting async job submit for node 68d7d2038dd6b39fd1aeb2b2 2025-09-27 20:32:41,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:41,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d2038dd6b39fd1aeb2b2 HTTP/1.1" 200 None 2025-09-27 20:32:41,396 - lava_callback - DEBUG - Processing node 68d7d2038dd6b39fd1aeb2b2: baseline-arm64-broonie 2025-09-27 20:32:41,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:32:41,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:32:41,865 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7d2038dd6b39fd1aeb2b2/log.txt.gz 2025-09-27 20:32:41,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:32:42,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:32:42,007 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7d2038dd6b39fd1aeb2b2/lava_callback.json.gz 2025-09-27 20:32:42,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:42,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d2038dd6b39fd1aeb2b2 HTTP/1.1" 200 None 2025-09-27 20:32:42,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:42,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:32:42,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:42,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d2038dd6b39fd1aeb2b2 HTTP/1.1" 200 None 2025-09-27 20:32:42,122 - lava_callback - INFO - Completed processing callback for node 68d7d2038dd6b39fd1aeb2b2 INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44412 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:32:58,945 - lava_callback - INFO - Received callback for node 68d76375a6a7b6615d4c4faf INFO: 172.21.0.1:44420 - "POST /node/68d76375a6a7b6615d4c4faf HTTP/1.0" 202 Accepted 2025-09-27 20:32:58,951 - lava_callback - INFO - Starting async job submit for node 68d76375a6a7b6615d4c4faf 2025-09-27 20:32:58,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:59,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76375a6a7b6615d4c4faf HTTP/1.1" 200 None 2025-09-27 20:32:59,012 - lava_callback - DEBUG - Processing node 68d76375a6a7b6615d4c4faf: baseline-arm64 2025-09-27 20:32:59,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:32:59,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:32:59,464 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76375a6a7b6615d4c4faf/log.txt.gz 2025-09-27 20:32:59,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:32:59,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:32:59,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76375a6a7b6615d4c4faf/lava_callback.json.gz 2025-09-27 20:32:59,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:59,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76375a6a7b6615d4c4faf HTTP/1.1" 200 None 2025-09-27 20:32:59,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:59,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:32:59,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:32:59,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76375a6a7b6615d4c4faf HTTP/1.1" 200 None 2025-09-27 20:32:59,687 - lava_callback - INFO - Completed processing callback for node 68d76375a6a7b6615d4c4faf INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:33:44,721 - lava_callback - INFO - Received callback for node 68d76375a6a7b6615d4c4fb4 INFO: 172.21.0.1:46276 - "POST /node/68d76375a6a7b6615d4c4fb4 HTTP/1.0" 202 Accepted 2025-09-27 20:33:44,727 - lava_callback - INFO - Starting async job submit for node 68d76375a6a7b6615d4c4fb4 2025-09-27 20:33:44,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:33:44,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76375a6a7b6615d4c4fb4 HTTP/1.1" 200 None 2025-09-27 20:33:44,777 - lava_callback - DEBUG - Processing node 68d76375a6a7b6615d4c4fb4: baseline-arm64 2025-09-27 20:33:45,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:33:45,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:33:45,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76375a6a7b6615d4c4fb4/log.txt.gz 2025-09-27 20:33:45,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:33:45,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:33:45,373 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76375a6a7b6615d4c4fb4/lava_callback.json.gz 2025-09-27 20:33:45,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:33:45,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76375a6a7b6615d4c4fb4 HTTP/1.1" 200 None 2025-09-27 20:33:45,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:33:45,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:33:45,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:33:45,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76375a6a7b6615d4c4fb4 HTTP/1.1" 200 None 2025-09-27 20:33:45,487 - lava_callback - INFO - Completed processing callback for node 68d76375a6a7b6615d4c4fb4 INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40006 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:34:02,766 - lava_callback - INFO - Received callback for node 68d7d8538dd6b39fd1aeb310 INFO: 172.21.0.1:40008 - "POST /node/68d7d8538dd6b39fd1aeb310 HTTP/1.0" 202 Accepted 2025-09-27 20:34:02,772 - lava_callback - INFO - Starting async job submit for node 68d7d8538dd6b39fd1aeb310 2025-09-27 20:34:02,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:02,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d8538dd6b39fd1aeb310 HTTP/1.1" 200 None 2025-09-27 20:34:02,805 - lava_callback - DEBUG - Processing node 68d7d8538dd6b39fd1aeb310: baseline-arm 2025-09-27 20:34:03,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:34:03,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:34:03,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d8538dd6b39fd1aeb310/log.txt.gz 2025-09-27 20:34:03,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:34:03,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:34:03,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d8538dd6b39fd1aeb310/lava_callback.json.gz 2025-09-27 20:34:03,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:03,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d8538dd6b39fd1aeb310 HTTP/1.1" 200 None 2025-09-27 20:34:03,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:03,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 20:34:03,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:03,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d8538dd6b39fd1aeb310 HTTP/1.1" 200 None 2025-09-27 20:34:03,446 - lava_callback - INFO - Completed processing callback for node 68d7d8538dd6b39fd1aeb310 INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:34:21,961 - lava_callback - INFO - Received callback for node 68d76378a6a7b6615d4c4fb7 INFO: 172.21.0.1:53942 - "POST /node/68d76378a6a7b6615d4c4fb7 HTTP/1.0" 202 Accepted 2025-09-27 20:34:21,967 - lava_callback - INFO - Starting async job submit for node 68d76378a6a7b6615d4c4fb7 2025-09-27 20:34:21,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:22,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76378a6a7b6615d4c4fb7 HTTP/1.1" 200 None 2025-09-27 20:34:22,014 - lava_callback - DEBUG - Processing node 68d76378a6a7b6615d4c4fb7: baseline-arm64 2025-09-27 20:34:22,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:34:22,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:34:22,435 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76378a6a7b6615d4c4fb7/log.txt.gz 2025-09-27 20:34:22,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:34:22,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:34:22,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76378a6a7b6615d4c4fb7/lava_callback.json.gz 2025-09-27 20:34:22,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:22,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76378a6a7b6615d4c4fb7 HTTP/1.1" 200 None 2025-09-27 20:34:22,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:22,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:34:22,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:22,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76378a6a7b6615d4c4fb7 HTTP/1.1" 200 None 2025-09-27 20:34:22,661 - lava_callback - INFO - Completed processing callback for node 68d76378a6a7b6615d4c4fb7 INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:34:58,333 - lava_callback - INFO - Received callback for node 68d76379a6a7b6615d4c4fba INFO: 172.21.0.1:45524 - "POST /node/68d76379a6a7b6615d4c4fba HTTP/1.0" 202 Accepted 2025-09-27 20:34:58,339 - lava_callback - INFO - Starting async job submit for node 68d76379a6a7b6615d4c4fba 2025-09-27 20:34:58,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:58,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76379a6a7b6615d4c4fba HTTP/1.1" 200 None 2025-09-27 20:34:58,372 - lava_callback - DEBUG - Processing node 68d76379a6a7b6615d4c4fba: baseline-arm64 2025-09-27 20:34:58,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:34:58,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:34:58,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76379a6a7b6615d4c4fba/log.txt.gz 2025-09-27 20:34:58,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:34:58,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:34:58,961 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d76379a6a7b6615d4c4fba/lava_callback.json.gz 2025-09-27 20:34:59,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:59,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d76379a6a7b6615d4c4fba HTTP/1.1" 200 None 2025-09-27 20:34:59,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:59,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:34:59,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:34:59,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d76379a6a7b6615d4c4fba HTTP/1.1" 200 None 2025-09-27 20:34:59,093 - lava_callback - INFO - Completed processing callback for node 68d76379a6a7b6615d4c4fba INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:35:43,869 - lava_callback - INFO - Received callback for node 68d7637ba6a7b6615d4c4fbd INFO: 172.21.0.1:58696 - "POST /node/68d7637ba6a7b6615d4c4fbd HTTP/1.0" 202 Accepted 2025-09-27 20:35:43,875 - lava_callback - INFO - Starting async job submit for node 68d7637ba6a7b6615d4c4fbd 2025-09-27 20:35:43,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:35:43,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7637ba6a7b6615d4c4fbd HTTP/1.1" 200 None 2025-09-27 20:35:43,909 - lava_callback - DEBUG - Processing node 68d7637ba6a7b6615d4c4fbd: baseline-arm64 2025-09-27 20:35:44,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:35:44,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:35:44,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7637ba6a7b6615d4c4fbd/log.txt.gz 2025-09-27 20:35:44,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:35:44,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:35:44,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7637ba6a7b6615d4c4fbd/lava_callback.json.gz 2025-09-27 20:35:44,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:35:44,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7637ba6a7b6615d4c4fbd HTTP/1.1" 200 None 2025-09-27 20:35:44,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:35:44,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:35:44,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:35:44,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7637ba6a7b6615d4c4fbd HTTP/1.1" 200 None 2025-09-27 20:35:44,555 - lava_callback - INFO - Completed processing callback for node 68d7637ba6a7b6615d4c4fbd INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:36:17,257 - lava_callback - INFO - Received callback for node 68d7d8548dd6b39fd1aeb31e INFO: 172.21.0.1:58700 - "POST /node/68d7d8548dd6b39fd1aeb31e HTTP/1.0" 202 Accepted 2025-09-27 20:36:17,263 - lava_callback - INFO - Starting async job submit for node 68d7d8548dd6b39fd1aeb31e 2025-09-27 20:36:17,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:36:17,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d8548dd6b39fd1aeb31e HTTP/1.1" 200 None 2025-09-27 20:36:17,297 - lava_callback - DEBUG - Processing node 68d7d8548dd6b39fd1aeb31e: baseline-arm 2025-09-27 20:36:17,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:36:17,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:36:17,659 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d8548dd6b39fd1aeb31e/log.txt.gz 2025-09-27 20:36:17,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:36:17,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:36:17,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d8548dd6b39fd1aeb31e/lava_callback.json.gz 2025-09-27 20:36:17,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:36:17,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d8548dd6b39fd1aeb31e HTTP/1.1" 200 None 2025-09-27 20:36:17,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:36:17,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 20:36:17,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:36:17,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d8548dd6b39fd1aeb31e HTTP/1.1" 200 None 2025-09-27 20:36:17,885 - lava_callback - INFO - Completed processing callback for node 68d7d8548dd6b39fd1aeb31e 2025-09-27 20:36:21,925 - lava_callback - INFO - Received callback for node 68d7637ca6a7b6615d4c4fc0 INFO: 172.21.0.1:51494 - "POST /node/68d7637ca6a7b6615d4c4fc0 HTTP/1.0" 202 Accepted 2025-09-27 20:36:21,931 - lava_callback - INFO - Starting async job submit for node 68d7637ca6a7b6615d4c4fc0 2025-09-27 20:36:21,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:36:21,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7637ca6a7b6615d4c4fc0 HTTP/1.1" 200 None 2025-09-27 20:36:21,964 - lava_callback - DEBUG - Processing node 68d7637ca6a7b6615d4c4fc0: baseline-arm64 2025-09-27 20:36:22,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:36:22,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:36:22,427 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7637ca6a7b6615d4c4fc0/log.txt.gz 2025-09-27 20:36:22,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:36:22,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:36:22,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7637ca6a7b6615d4c4fc0/lava_callback.json.gz 2025-09-27 20:36:22,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:36:22,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7637ca6a7b6615d4c4fc0 HTTP/1.1" 200 None 2025-09-27 20:36:22,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:36:22,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:36:22,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:36:22,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7637ca6a7b6615d4c4fc0 HTTP/1.1" 200 None 2025-09-27 20:36:22,622 - lava_callback - INFO - Completed processing callback for node 68d7637ca6a7b6615d4c4fc0 INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:37:02,669 - lava_callback - INFO - Received callback for node 68d7d5da8dd6b39fd1aeb2f0 INFO: 172.21.0.1:49918 - "POST /node/68d7d5da8dd6b39fd1aeb2f0 HTTP/1.0" 202 Accepted 2025-09-27 20:37:02,674 - lava_callback - INFO - Starting async job submit for node 68d7d5da8dd6b39fd1aeb2f0 2025-09-27 20:37:02,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:02,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d5da8dd6b39fd1aeb2f0 HTTP/1.1" 200 None 2025-09-27 20:37:02,705 - lava_callback - DEBUG - Processing node 68d7d5da8dd6b39fd1aeb2f0: baseline-arm64-broonie 2025-09-27 20:37:03,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:37:03,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:37:03,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7d5da8dd6b39fd1aeb2f0/log.txt.gz 2025-09-27 20:37:03,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:37:03,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:37:03,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7d5da8dd6b39fd1aeb2f0/lava_callback.json.gz 2025-09-27 20:37:03,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:03,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d5da8dd6b39fd1aeb2f0 HTTP/1.1" 200 None 2025-09-27 20:37:03,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:03,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 20:37:03,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:03,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d5da8dd6b39fd1aeb2f0 HTTP/1.1" 200 None 2025-09-27 20:37:03,366 - lava_callback - INFO - Completed processing callback for node 68d7d5da8dd6b39fd1aeb2f0 2025-09-27 20:37:04,885 - lava_callback - INFO - Received callback for node 68d7637ea6a7b6615d4c4fc3 INFO: 172.21.0.1:49920 - "POST /node/68d7637ea6a7b6615d4c4fc3 HTTP/1.0" 202 Accepted 2025-09-27 20:37:04,892 - lava_callback - INFO - Starting async job submit for node 68d7637ea6a7b6615d4c4fc3 2025-09-27 20:37:04,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:04,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7637ea6a7b6615d4c4fc3 HTTP/1.1" 200 None 2025-09-27 20:37:04,929 - lava_callback - DEBUG - Processing node 68d7637ea6a7b6615d4c4fc3: baseline-arm64 INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:37:05,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:37:05,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:37:05,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7637ea6a7b6615d4c4fc3/log.txt.gz 2025-09-27 20:37:05,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:37:05,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:37:05,583 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7637ea6a7b6615d4c4fc3/lava_callback.json.gz 2025-09-27 20:37:05,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:05,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7637ea6a7b6615d4c4fc3 HTTP/1.1" 200 None 2025-09-27 20:37:05,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:05,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:37:05,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:05,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7637ea6a7b6615d4c4fc3 HTTP/1.1" 200 None 2025-09-27 20:37:05,685 - lava_callback - INFO - Completed processing callback for node 68d7637ea6a7b6615d4c4fc3 INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36982 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:37:47,368 - lava_callback - INFO - Received callback for node 68d7637fa6a7b6615d4c4fc6 INFO: 172.21.0.1:36986 - "POST /node/68d7637fa6a7b6615d4c4fc6 HTTP/1.0" 202 Accepted 2025-09-27 20:37:47,375 - lava_callback - INFO - Starting async job submit for node 68d7637fa6a7b6615d4c4fc6 2025-09-27 20:37:47,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:47,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7637fa6a7b6615d4c4fc6 HTTP/1.1" 200 None 2025-09-27 20:37:47,429 - lava_callback - DEBUG - Processing node 68d7637fa6a7b6615d4c4fc6: baseline-arm64 2025-09-27 20:37:47,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:37:47,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:37:47,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7637fa6a7b6615d4c4fc6/log.txt.gz 2025-09-27 20:37:47,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:37:47,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:37:47,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7637fa6a7b6615d4c4fc6/lava_callback.json.gz 2025-09-27 20:37:47,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:48,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7637fa6a7b6615d4c4fc6 HTTP/1.1" 200 None 2025-09-27 20:37:48,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:48,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-27 20:37:48,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:37:48,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7637fa6a7b6615d4c4fc6 HTTP/1.1" 200 None 2025-09-27 20:37:48,049 - lava_callback - INFO - Completed processing callback for node 68d7637fa6a7b6615d4c4fc6 INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42900 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:38:04,609 - lava_callback - INFO - Received callback for node 68d7570ca6a7b6615d4c4dbc INFO: 172.21.0.1:42904 - "POST /node/68d7570ca6a7b6615d4c4dbc HTTP/1.0" 202 Accepted 2025-09-27 20:38:04,617 - lava_callback - INFO - Starting async job submit for node 68d7570ca6a7b6615d4c4dbc 2025-09-27 20:38:04,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:38:04,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7570ca6a7b6615d4c4dbc HTTP/1.1" 200 None 2025-09-27 20:38:04,676 - lava_callback - DEBUG - Processing node 68d7570ca6a7b6615d4c4dbc: baseline-arm64 INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:38:05,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:38:05,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:38:05,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7570ca6a7b6615d4c4dbc/log.txt.gz 2025-09-27 20:38:05,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:38:05,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:38:05,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7570ca6a7b6615d4c4dbc/lava_callback.json.gz DEBUG: Setup failed for 68d7570ca6a7b6615d4c4dbc. Transitting job node result: incomplete -> fail 2025-09-27 20:38:05,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:38:05,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7570ca6a7b6615d4c4dbc HTTP/1.1" 200 None 2025-09-27 20:38:05,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:38:06,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 20:38:06,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:38:06,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7570ca6a7b6615d4c4dbc HTTP/1.1" 200 None 2025-09-27 20:38:06,039 - lava_callback - INFO - Completed processing callback for node 68d7570ca6a7b6615d4c4dbc INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:38:43,696 - lava_callback - INFO - Received callback for node 68d7d8558dd6b39fd1aeb321 INFO: 172.21.0.1:41750 - "POST /node/68d7d8558dd6b39fd1aeb321 HTTP/1.0" 202 Accepted 2025-09-27 20:38:43,703 - lava_callback - INFO - Starting async job submit for node 68d7d8558dd6b39fd1aeb321 2025-09-27 20:38:43,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:38:43,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d8558dd6b39fd1aeb321 HTTP/1.1" 200 None 2025-09-27 20:38:43,740 - lava_callback - DEBUG - Processing node 68d7d8558dd6b39fd1aeb321: baseline-arm 2025-09-27 20:38:43,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:38:44,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:38:44,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d8558dd6b39fd1aeb321/log.txt.gz 2025-09-27 20:38:44,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:38:44,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:38:44,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d8558dd6b39fd1aeb321/lava_callback.json.gz 2025-09-27 20:38:44,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:38:44,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d8558dd6b39fd1aeb321 HTTP/1.1" 200 None 2025-09-27 20:38:44,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:38:44,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 20:38:44,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:38:44,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d8558dd6b39fd1aeb321 HTTP/1.1" 200 None 2025-09-27 20:38:44,308 - lava_callback - INFO - Completed processing callback for node 68d7d8558dd6b39fd1aeb321 INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:39:13,399 - lava_callback - INFO - Received callback for node 68d5a8682be2da466069a214 INFO: 172.21.0.1:50650 - "POST /node/68d5a8682be2da466069a214 HTTP/1.0" 202 Accepted 2025-09-27 20:39:13,405 - lava_callback - INFO - Starting async job submit for node 68d5a8682be2da466069a214 2025-09-27 20:39:13,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:39:13,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8682be2da466069a214 HTTP/1.1" 200 None 2025-09-27 20:39:13,421 - lava_callback - DEBUG - Processing node 68d5a8682be2da466069a214: baseline-arm 2025-09-27 20:39:13,421 - lava_callback - ERROR - Error processing callback for node 68d5a8682be2da466069a214: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:39:14,043 - lava_callback - INFO - Received callback for node 68d5a8692be2da466069a217 INFO: 172.21.0.1:50658 - "POST /node/68d5a8692be2da466069a217 HTTP/1.0" 202 Accepted 2025-09-27 20:39:14,048 - lava_callback - INFO - Starting async job submit for node 68d5a8692be2da466069a217 2025-09-27 20:39:14,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:39:14,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8692be2da466069a217 HTTP/1.1" 200 None 2025-09-27 20:39:14,064 - lava_callback - DEBUG - Processing node 68d5a8692be2da466069a217: baseline-arm 2025-09-27 20:39:14,064 - lava_callback - ERROR - Error processing callback for node 68d5a8692be2da466069a217: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:39:14,678 - lava_callback - INFO - Received callback for node 68d5a86a2be2da466069a21a INFO: 172.21.0.1:50670 - "POST /node/68d5a86a2be2da466069a21a HTTP/1.0" 202 Accepted 2025-09-27 20:39:14,684 - lava_callback - INFO - Starting async job submit for node 68d5a86a2be2da466069a21a 2025-09-27 20:39:14,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:39:14,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a86a2be2da466069a21a HTTP/1.1" 200 None 2025-09-27 20:39:14,697 - lava_callback - DEBUG - Processing node 68d5a86a2be2da466069a21a: baseline-arm 2025-09-27 20:39:14,697 - lava_callback - ERROR - Error processing callback for node 68d5a86a2be2da466069a21a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:50678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:39:44,612 - lava_callback - INFO - Received callback for node 68d77061a6a7b6615d4c5110 INFO: 172.21.0.1:53600 - "POST /node/68d77061a6a7b6615d4c5110 HTTP/1.0" 202 Accepted 2025-09-27 20:39:44,618 - lava_callback - INFO - Starting async job submit for node 68d77061a6a7b6615d4c5110 2025-09-27 20:39:44,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:39:44,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77061a6a7b6615d4c5110 HTTP/1.1" 200 None 2025-09-27 20:39:44,673 - lava_callback - DEBUG - Processing node 68d77061a6a7b6615d4c5110: baseline-arm64 2025-09-27 20:39:45,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:39:45,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:39:45,331 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77061a6a7b6615d4c5110/log.txt.gz 2025-09-27 20:39:45,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:39:45,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:39:45,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77061a6a7b6615d4c5110/lava_callback.json.gz 2025-09-27 20:39:45,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:39:45,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77061a6a7b6615d4c5110 HTTP/1.1" 200 None 2025-09-27 20:39:45,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:39:45,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:39:45,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:39:45,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77061a6a7b6615d4c5110 HTTP/1.1" 200 None 2025-09-27 20:39:45,563 - lava_callback - INFO - Completed processing callback for node 68d77061a6a7b6615d4c5110 INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:39:59,780 - lava_callback - INFO - Received callback for node 68d77062a6a7b6615d4c5113 INFO: 172.21.0.1:59066 - "POST /node/68d77062a6a7b6615d4c5113 HTTP/1.0" 202 Accepted 2025-09-27 20:39:59,786 - lava_callback - INFO - Starting async job submit for node 68d77062a6a7b6615d4c5113 2025-09-27 20:39:59,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:39:59,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77062a6a7b6615d4c5113 HTTP/1.1" 200 None 2025-09-27 20:39:59,820 - lava_callback - DEBUG - Processing node 68d77062a6a7b6615d4c5113: baseline-arm64 INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:40:00,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:40:00,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:40:00,290 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77062a6a7b6615d4c5113/log.txt.gz 2025-09-27 20:40:00,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:40:00,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:40:00,414 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77062a6a7b6615d4c5113/lava_callback.json.gz 2025-09-27 20:40:00,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:00,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77062a6a7b6615d4c5113 HTTP/1.1" 200 None 2025-09-27 20:40:00,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:00,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:40:00,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:00,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77062a6a7b6615d4c5113 HTTP/1.1" 200 None 2025-09-27 20:40:00,487 - lava_callback - INFO - Completed processing callback for node 68d77062a6a7b6615d4c5113 INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:40:06,789 - lava_callback - INFO - Received callback for node 68d7dc078dd6b39fd1aeb3a3 INFO: 172.21.0.1:59108 - "POST /node/68d7dc078dd6b39fd1aeb3a3 HTTP/1.0" 202 Accepted 2025-09-27 20:40:06,795 - lava_callback - INFO - Starting async job submit for node 68d7dc078dd6b39fd1aeb3a3 2025-09-27 20:40:06,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:06,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc078dd6b39fd1aeb3a3 HTTP/1.1" 200 None 2025-09-27 20:40:06,826 - lava_callback - DEBUG - Processing node 68d7dc078dd6b39fd1aeb3a3: baseline-arm64-broonie 2025-09-27 20:40:07,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:40:07,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:40:07,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7dc078dd6b39fd1aeb3a3/log.txt.gz 2025-09-27 20:40:07,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:40:07,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:40:07,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7dc078dd6b39fd1aeb3a3/lava_callback.json.gz 2025-09-27 20:40:07,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:07,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc078dd6b39fd1aeb3a3 HTTP/1.1" 200 None 2025-09-27 20:40:07,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:07,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 20:40:07,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:07,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc078dd6b39fd1aeb3a3 HTTP/1.1" 200 None 2025-09-27 20:40:07,481 - lava_callback - INFO - Completed processing callback for node 68d7dc078dd6b39fd1aeb3a3 2025-09-27 20:40:13,273 - lava_callback - INFO - Received callback for node 68d5a8a32be2da466069a246 INFO: 172.21.0.1:47046 - "POST /node/68d5a8a32be2da466069a246 HTTP/1.0" 202 Accepted 2025-09-27 20:40:13,279 - lava_callback - INFO - Starting async job submit for node 68d5a8a32be2da466069a246 2025-09-27 20:40:13,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:13,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8a32be2da466069a246 HTTP/1.1" 200 None 2025-09-27 20:40:13,292 - lava_callback - DEBUG - Processing node 68d5a8a32be2da466069a246: baseline-arm 2025-09-27 20:40:13,292 - lava_callback - ERROR - Error processing callback for node 68d5a8a32be2da466069a246: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:40:13,924 - lava_callback - INFO - Received callback for node 68d5a8a42be2da466069a257 INFO: 172.21.0.1:47048 - "POST /node/68d5a8a42be2da466069a257 HTTP/1.0" 202 Accepted 2025-09-27 20:40:13,929 - lava_callback - INFO - Starting async job submit for node 68d5a8a42be2da466069a257 2025-09-27 20:40:13,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:13,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8a42be2da466069a257 HTTP/1.1" 200 None 2025-09-27 20:40:13,943 - lava_callback - DEBUG - Processing node 68d5a8a42be2da466069a257: baseline-arm 2025-09-27 20:40:13,943 - lava_callback - ERROR - Error processing callback for node 68d5a8a42be2da466069a257: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:40:14,545 - lava_callback - INFO - Received callback for node 68d5a8a72be2da466069a268 INFO: 172.21.0.1:47054 - "POST /node/68d5a8a72be2da466069a268 HTTP/1.0" 202 Accepted 2025-09-27 20:40:14,550 - lava_callback - INFO - Starting async job submit for node 68d5a8a72be2da466069a268 2025-09-27 20:40:14,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:14,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8a72be2da466069a268 HTTP/1.1" 200 None 2025-09-27 20:40:14,564 - lava_callback - DEBUG - Processing node 68d5a8a72be2da466069a268: baseline-arm 2025-09-27 20:40:14,564 - lava_callback - ERROR - Error processing callback for node 68d5a8a72be2da466069a268: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:47058 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 20:40:15,175 - lava_callback - INFO - Received callback for node 68d5a8a72be2da466069a26b INFO: 172.21.0.1:47070 - "POST /node/68d5a8a72be2da466069a26b HTTP/1.0" 202 Accepted 2025-09-27 20:40:15,181 - lava_callback - INFO - Starting async job submit for node 68d5a8a72be2da466069a26b 2025-09-27 20:40:15,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:15,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8a72be2da466069a26b HTTP/1.1" 200 None 2025-09-27 20:40:15,196 - lava_callback - DEBUG - Processing node 68d5a8a72be2da466069a26b: baseline-arm 2025-09-27 20:40:15,196 - lava_callback - ERROR - Error processing callback for node 68d5a8a72be2da466069a26b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:40:18,289 - lava_callback - INFO - Received callback for node 68d77064a6a7b6615d4c5116 INFO: 172.21.0.1:47086 - "POST /node/68d77064a6a7b6615d4c5116 HTTP/1.0" 202 Accepted 2025-09-27 20:40:18,295 - lava_callback - INFO - Starting async job submit for node 68d77064a6a7b6615d4c5116 2025-09-27 20:40:18,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:18,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77064a6a7b6615d4c5116 HTTP/1.1" 200 None 2025-09-27 20:40:18,329 - lava_callback - DEBUG - Processing node 68d77064a6a7b6615d4c5116: baseline-arm64 2025-09-27 20:40:18,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:40:18,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:40:18,792 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77064a6a7b6615d4c5116/log.txt.gz 2025-09-27 20:40:18,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:40:18,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:40:18,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77064a6a7b6615d4c5116/lava_callback.json.gz 2025-09-27 20:40:18,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:18,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77064a6a7b6615d4c5116 HTTP/1.1" 200 None 2025-09-27 20:40:18,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:18,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:40:18,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:18,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77064a6a7b6615d4c5116 HTTP/1.1" 200 None 2025-09-27 20:40:18,992 - lava_callback - INFO - Completed processing callback for node 68d77064a6a7b6615d4c5116 INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:40:43,266 - lava_callback - INFO - Received callback for node 68d5a8c22be2da466069a29e INFO: 172.21.0.1:43414 - "POST /node/68d5a8c22be2da466069a29e HTTP/1.0" 202 Accepted 2025-09-27 20:40:43,275 - lava_callback - INFO - Starting async job submit for node 68d5a8c22be2da466069a29e 2025-09-27 20:40:43,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:43,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8c22be2da466069a29e HTTP/1.1" 200 None 2025-09-27 20:40:43,418 - lava_callback - DEBUG - Processing node 68d5a8c22be2da466069a29e: baseline-arm-clabbe 2025-09-27 20:40:43,418 - lava_callback - ERROR - Error processing callback for node 68d5a8c22be2da466069a29e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:40:43,937 - lava_callback - INFO - Received callback for node 68d5a8c42be2da466069a2a1 INFO: 172.21.0.1:43422 - "POST /node/68d5a8c42be2da466069a2a1 HTTP/1.0" 202 Accepted 2025-09-27 20:40:43,943 - lava_callback - INFO - Starting async job submit for node 68d5a8c42be2da466069a2a1 2025-09-27 20:40:43,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:43,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8c42be2da466069a2a1 HTTP/1.1" 200 None 2025-09-27 20:40:43,956 - lava_callback - DEBUG - Processing node 68d5a8c42be2da466069a2a1: baseline-arm-clabbe 2025-09-27 20:40:43,956 - lava_callback - ERROR - Error processing callback for node 68d5a8c42be2da466069a2a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:40:44,597 - lava_callback - INFO - Received callback for node 68d5a8c82be2da466069a2a7 INFO: 172.21.0.1:43436 - "POST /node/68d5a8c82be2da466069a2a7 HTTP/1.0" 202 Accepted 2025-09-27 20:40:44,603 - lava_callback - INFO - Starting async job submit for node 68d5a8c82be2da466069a2a7 2025-09-27 20:40:44,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:44,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8c82be2da466069a2a7 HTTP/1.1" 200 None 2025-09-27 20:40:44,618 - lava_callback - DEBUG - Processing node 68d5a8c82be2da466069a2a7: baseline-arm-clabbe 2025-09-27 20:40:44,618 - lava_callback - ERROR - Error processing callback for node 68d5a8c82be2da466069a2a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:40:45,244 - lava_callback - INFO - Received callback for node 68d5a8ca2be2da466069a2aa INFO: 172.21.0.1:43444 - "POST /node/68d5a8ca2be2da466069a2aa HTTP/1.0" 202 Accepted 2025-09-27 20:40:45,249 - lava_callback - INFO - Starting async job submit for node 68d5a8ca2be2da466069a2aa 2025-09-27 20:40:45,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:45,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8ca2be2da466069a2aa HTTP/1.1" 200 None 2025-09-27 20:40:45,262 - lava_callback - DEBUG - Processing node 68d5a8ca2be2da466069a2aa: baseline-arm-clabbe 2025-09-27 20:40:45,262 - lava_callback - ERROR - Error processing callback for node 68d5a8ca2be2da466069a2aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:40:53,226 - lava_callback - INFO - Received callback for node 68d77065a6a7b6615d4c5119 INFO: 172.21.0.1:53094 - "POST /node/68d77065a6a7b6615d4c5119 HTTP/1.0" 202 Accepted 2025-09-27 20:40:53,232 - lava_callback - INFO - Starting async job submit for node 68d77065a6a7b6615d4c5119 2025-09-27 20:40:53,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:53,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77065a6a7b6615d4c5119 HTTP/1.1" 200 None 2025-09-27 20:40:53,270 - lava_callback - DEBUG - Processing node 68d77065a6a7b6615d4c5119: baseline-arm64 2025-09-27 20:40:53,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:40:53,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:40:53,806 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77065a6a7b6615d4c5119/log.txt.gz 2025-09-27 20:40:53,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:40:53,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:40:53,961 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77065a6a7b6615d4c5119/lava_callback.json.gz 2025-09-27 20:40:53,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:53,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77065a6a7b6615d4c5119 HTTP/1.1" 200 None 2025-09-27 20:40:53,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:54,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:40:54,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:40:54,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77065a6a7b6615d4c5119 HTTP/1.1" 200 None 2025-09-27 20:40:54,044 - lava_callback - INFO - Completed processing callback for node 68d77065a6a7b6615d4c5119 INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:41:02,274 - lava_callback - INFO - Received callback for node 68d7d8568dd6b39fd1aeb324 INFO: 172.21.0.1:58548 - "POST /node/68d7d8568dd6b39fd1aeb324 HTTP/1.0" 202 Accepted 2025-09-27 20:41:02,280 - lava_callback - INFO - Starting async job submit for node 68d7d8568dd6b39fd1aeb324 2025-09-27 20:41:02,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:02,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d8568dd6b39fd1aeb324 HTTP/1.1" 200 None 2025-09-27 20:41:02,311 - lava_callback - DEBUG - Processing node 68d7d8568dd6b39fd1aeb324: baseline-arm 2025-09-27 20:41:02,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:41:02,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:41:02,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d8568dd6b39fd1aeb324/log.txt.gz 2025-09-27 20:41:02,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:41:02,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:41:02,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d8568dd6b39fd1aeb324/lava_callback.json.gz 2025-09-27 20:41:02,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:02,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d8568dd6b39fd1aeb324 HTTP/1.1" 200 None 2025-09-27 20:41:02,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:02,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 20:41:02,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:02,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d8568dd6b39fd1aeb324 HTTP/1.1" 200 None 2025-09-27 20:41:02,872 - lava_callback - INFO - Completed processing callback for node 68d7d8568dd6b39fd1aeb324 2025-09-27 20:41:03,202 - lava_callback - INFO - Received callback for node 68d5a8d12be2da466069a2b6 INFO: 172.21.0.1:58558 - "POST /node/68d5a8d12be2da466069a2b6 HTTP/1.0" 202 Accepted 2025-09-27 20:41:03,208 - lava_callback - INFO - Starting async job submit for node 68d5a8d12be2da466069a2b6 2025-09-27 20:41:03,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:03,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8d12be2da466069a2b6 HTTP/1.1" 200 None 2025-09-27 20:41:03,221 - lava_callback - DEBUG - Processing node 68d5a8d12be2da466069a2b6: baseline-arm-clabbe 2025-09-27 20:41:03,221 - lava_callback - ERROR - Error processing callback for node 68d5a8d12be2da466069a2b6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:41:03,866 - lava_callback - INFO - Received callback for node 68d5a8cb2be2da466069a2ad INFO: 172.21.0.1:58560 - "POST /node/68d5a8cb2be2da466069a2ad HTTP/1.0" 202 Accepted 2025-09-27 20:41:03,872 - lava_callback - INFO - Starting async job submit for node 68d5a8cb2be2da466069a2ad 2025-09-27 20:41:03,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:03,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8cb2be2da466069a2ad HTTP/1.1" 200 None 2025-09-27 20:41:03,885 - lava_callback - DEBUG - Processing node 68d5a8cb2be2da466069a2ad: baseline-arm-clabbe 2025-09-27 20:41:03,885 - lava_callback - ERROR - Error processing callback for node 68d5a8cb2be2da466069a2ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:41:19,084 - lava_callback - INFO - Received callback for node 68d77067a6a7b6615d4c511c INFO: 172.21.0.1:60514 - "POST /node/68d77067a6a7b6615d4c511c HTTP/1.0" 202 Accepted 2025-09-27 20:41:19,090 - lava_callback - INFO - Starting async job submit for node 68d77067a6a7b6615d4c511c 2025-09-27 20:41:19,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:19,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77067a6a7b6615d4c511c HTTP/1.1" 200 None 2025-09-27 20:41:19,126 - lava_callback - DEBUG - Processing node 68d77067a6a7b6615d4c511c: baseline-arm64 2025-09-27 20:41:19,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:41:19,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:41:19,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77067a6a7b6615d4c511c/log.txt.gz 2025-09-27 20:41:19,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:41:19,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:41:19,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77067a6a7b6615d4c511c/lava_callback.json.gz 2025-09-27 20:41:19,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:19,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77067a6a7b6615d4c511c HTTP/1.1" 200 None 2025-09-27 20:41:19,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:19,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:41:19,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:19,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77067a6a7b6615d4c511c HTTP/1.1" 200 None 2025-09-27 20:41:19,815 - lava_callback - INFO - Completed processing callback for node 68d77067a6a7b6615d4c511c INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:41:45,068 - lava_callback - INFO - Received callback for node 68d77068a6a7b6615d4c511f INFO: 172.21.0.1:51756 - "POST /node/68d77068a6a7b6615d4c511f HTTP/1.0" 202 Accepted 2025-09-27 20:41:45,074 - lava_callback - INFO - Starting async job submit for node 68d77068a6a7b6615d4c511f 2025-09-27 20:41:45,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:45,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77068a6a7b6615d4c511f HTTP/1.1" 200 None 2025-09-27 20:41:45,127 - lava_callback - DEBUG - Processing node 68d77068a6a7b6615d4c511f: baseline-arm64 2025-09-27 20:41:45,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:41:45,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:41:45,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77068a6a7b6615d4c511f/log.txt.gz 2025-09-27 20:41:45,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:41:45,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:41:45,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77068a6a7b6615d4c511f/lava_callback.json.gz 2025-09-27 20:41:45,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:45,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77068a6a7b6615d4c511f HTTP/1.1" 200 None 2025-09-27 20:41:45,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:45,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:41:45,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:41:45,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77068a6a7b6615d4c511f HTTP/1.1" 200 None 2025-09-27 20:41:45,869 - lava_callback - INFO - Completed processing callback for node 68d77068a6a7b6615d4c511f INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:42:22,193 - lava_callback - INFO - Received callback for node 68d7afdc8dd6b39fd1aead82 INFO: 172.21.0.1:60418 - "POST /node/68d7afdc8dd6b39fd1aead82 HTTP/1.0" 202 Accepted 2025-09-27 20:42:22,199 - lava_callback - INFO - Starting async job submit for node 68d7afdc8dd6b39fd1aead82 2025-09-27 20:42:22,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:22,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7afdc8dd6b39fd1aead82 HTTP/1.1" 200 None 2025-09-27 20:42:22,234 - lava_callback - DEBUG - Processing node 68d7afdc8dd6b39fd1aead82: baseline-arm64-broonie 2025-09-27 20:42:22,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:42:22,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:42:22,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7afdc8dd6b39fd1aead82/log.txt.gz 2025-09-27 20:42:22,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:42:22,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:42:22,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7afdc8dd6b39fd1aead82/lava_callback.json.gz 2025-09-27 20:42:22,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:22,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7afdc8dd6b39fd1aead82 HTTP/1.1" 200 None 2025-09-27 20:42:22,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:22,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 20:42:22,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:22,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7afdc8dd6b39fd1aead82 HTTP/1.1" 200 None 2025-09-27 20:42:22,951 - lava_callback - INFO - Completed processing callback for node 68d7afdc8dd6b39fd1aead82 2025-09-27 20:42:25,051 - lava_callback - INFO - Received callback for node 68d7dfec8dd6b39fd1aeb48a INFO: 172.21.0.1:60434 - "POST /node/68d7dfec8dd6b39fd1aeb48a HTTP/1.0" 202 Accepted 2025-09-27 20:42:25,058 - lava_callback - INFO - Starting async job submit for node 68d7dfec8dd6b39fd1aeb48a 2025-09-27 20:42:25,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:25,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfec8dd6b39fd1aeb48a HTTP/1.1" 200 None 2025-09-27 20:42:25,095 - lava_callback - DEBUG - Processing node 68d7dfec8dd6b39fd1aeb48a: baseline-arm64-broonie 2025-09-27 20:42:25,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:42:25,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:42:25,662 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7dfec8dd6b39fd1aeb48a/log.txt.gz 2025-09-27 20:42:25,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:42:25,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:42:25,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7dfec8dd6b39fd1aeb48a/lava_callback.json.gz 2025-09-27 20:42:25,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:25,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfec8dd6b39fd1aeb48a HTTP/1.1" 200 None 2025-09-27 20:42:25,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:26,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 20:42:26,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:26,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfec8dd6b39fd1aeb48a HTTP/1.1" 200 None 2025-09-27 20:42:26,126 - lava_callback - INFO - Completed processing callback for node 68d7dfec8dd6b39fd1aeb48a INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:42:41,443 - lava_callback - INFO - Received callback for node 68d7706ba6a7b6615d4c5125 INFO: 172.21.0.1:47924 - "POST /node/68d7706ba6a7b6615d4c5125 HTTP/1.0" 202 Accepted 2025-09-27 20:42:41,451 - lava_callback - INFO - Starting async job submit for node 68d7706ba6a7b6615d4c5125 2025-09-27 20:42:41,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:41,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7706ba6a7b6615d4c5125 HTTP/1.1" 200 None 2025-09-27 20:42:41,492 - lava_callback - DEBUG - Processing node 68d7706ba6a7b6615d4c5125: baseline-arm64 2025-09-27 20:42:41,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:42:42,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:42:42,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7706ba6a7b6615d4c5125/log.txt.gz 2025-09-27 20:42:42,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:42:42,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:42:42,163 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7706ba6a7b6615d4c5125/lava_callback.json.gz 2025-09-27 20:42:42,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:42,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7706ba6a7b6615d4c5125 HTTP/1.1" 200 None 2025-09-27 20:42:42,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:42,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:42:42,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:42:42,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7706ba6a7b6615d4c5125 HTTP/1.1" 200 None 2025-09-27 20:42:42,264 - lava_callback - INFO - Completed processing callback for node 68d7706ba6a7b6615d4c5125 INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42644 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:43:01,366 - lava_callback - INFO - Received callback for node 68d77d49a6a7b6615d4c5134 INFO: 172.21.0.1:42646 - "POST /node/68d77d49a6a7b6615d4c5134 HTTP/1.0" 202 Accepted 2025-09-27 20:43:01,372 - lava_callback - INFO - Starting async job submit for node 68d77d49a6a7b6615d4c5134 2025-09-27 20:43:01,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:01,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d49a6a7b6615d4c5134 HTTP/1.1" 200 None 2025-09-27 20:43:01,408 - lava_callback - DEBUG - Processing node 68d77d49a6a7b6615d4c5134: baseline-arm64 2025-09-27 20:43:01,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:43:01,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:43:01,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d49a6a7b6615d4c5134/log.txt.gz 2025-09-27 20:43:01,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:43:02,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:43:02,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d49a6a7b6615d4c5134/lava_callback.json.gz 2025-09-27 20:43:02,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:02,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d49a6a7b6615d4c5134 HTTP/1.1" 200 None 2025-09-27 20:43:02,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:02,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:43:02,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:02,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d49a6a7b6615d4c5134 HTTP/1.1" 200 None 2025-09-27 20:43:02,123 - lava_callback - INFO - Completed processing callback for node 68d77d49a6a7b6615d4c5134 INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:43:09,846 - lava_callback - INFO - Received callback for node 68d7706aa6a7b6615d4c5122 INFO: 172.21.0.1:33582 - "POST /node/68d7706aa6a7b6615d4c5122 HTTP/1.0" 202 Accepted 2025-09-27 20:43:09,852 - lava_callback - INFO - Starting async job submit for node 68d7706aa6a7b6615d4c5122 2025-09-27 20:43:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:09,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7706aa6a7b6615d4c5122 HTTP/1.1" 200 None 2025-09-27 20:43:09,890 - lava_callback - DEBUG - Processing node 68d7706aa6a7b6615d4c5122: baseline-arm64 2025-09-27 20:43:10,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:43:10,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:43:10,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7706aa6a7b6615d4c5122/log.txt.gz 2025-09-27 20:43:10,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:43:10,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:43:10,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7706aa6a7b6615d4c5122/lava_callback.json.gz 2025-09-27 20:43:10,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:10,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7706aa6a7b6615d4c5122 HTTP/1.1" 200 None 2025-09-27 20:43:10,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:10,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 20:43:10,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:10,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7706aa6a7b6615d4c5122 HTTP/1.1" 200 None 2025-09-27 20:43:10,614 - lava_callback - INFO - Completed processing callback for node 68d7706aa6a7b6615d4c5122 INFO: 172.21.0.1:33598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:43:22,762 - lava_callback - INFO - Received callback for node 68d7d85c8dd6b39fd1aeb337 INFO: 172.21.0.1:38890 - "POST /node/68d7d85c8dd6b39fd1aeb337 HTTP/1.0" 202 Accepted 2025-09-27 20:43:22,768 - lava_callback - INFO - Starting async job submit for node 68d7d85c8dd6b39fd1aeb337 2025-09-27 20:43:22,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:22,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d85c8dd6b39fd1aeb337 HTTP/1.1" 200 None 2025-09-27 20:43:22,804 - lava_callback - DEBUG - Processing node 68d7d85c8dd6b39fd1aeb337: baseline-arm 2025-09-27 20:43:23,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:43:23,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:43:23,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d85c8dd6b39fd1aeb337/log.txt.gz 2025-09-27 20:43:23,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:43:23,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:43:23,367 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d85c8dd6b39fd1aeb337/lava_callback.json.gz 2025-09-27 20:43:23,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:23,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d85c8dd6b39fd1aeb337 HTTP/1.1" 200 None 2025-09-27 20:43:23,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:23,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 20:43:23,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:43:23,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d85c8dd6b39fd1aeb337 HTTP/1.1" 200 None 2025-09-27 20:43:23,449 - lava_callback - INFO - Completed processing callback for node 68d7d85c8dd6b39fd1aeb337 INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:44:04,194 - lava_callback - INFO - Received callback for node 68d77d4aa6a7b6615d4c5137 INFO: 172.21.0.1:54256 - "POST /node/68d77d4aa6a7b6615d4c5137 HTTP/1.0" 202 Accepted 2025-09-27 20:44:04,200 - lava_callback - INFO - Starting async job submit for node 68d77d4aa6a7b6615d4c5137 2025-09-27 20:44:04,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:04,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d4aa6a7b6615d4c5137 HTTP/1.1" 200 None 2025-09-27 20:44:04,252 - lava_callback - DEBUG - Processing node 68d77d4aa6a7b6615d4c5137: baseline-arm64 2025-09-27 20:44:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:44:04,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:44:04,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d4aa6a7b6615d4c5137/log.txt.gz 2025-09-27 20:44:04,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:44:04,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:44:04,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d4aa6a7b6615d4c5137/lava_callback.json.gz 2025-09-27 20:44:04,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:04,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d4aa6a7b6615d4c5137 HTTP/1.1" 200 None 2025-09-27 20:44:04,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:04,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:44:04,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:04,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d4aa6a7b6615d4c5137 HTTP/1.1" 200 None 2025-09-27 20:44:04,986 - lava_callback - INFO - Completed processing callback for node 68d77d4aa6a7b6615d4c5137 INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59458 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:44:17,957 - lava_callback - INFO - Received callback for node 68d77d4da6a7b6615d4c513d INFO: 172.21.0.1:59464 - "POST /node/68d77d4da6a7b6615d4c513d HTTP/1.0" 202 Accepted 2025-09-27 20:44:17,963 - lava_callback - INFO - Starting async job submit for node 68d77d4da6a7b6615d4c513d 2025-09-27 20:44:17,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:18,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d4da6a7b6615d4c513d HTTP/1.1" 200 None 2025-09-27 20:44:18,019 - lava_callback - DEBUG - Processing node 68d77d4da6a7b6615d4c513d: baseline-arm64 2025-09-27 20:44:18,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:44:18,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:44:18,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d4da6a7b6615d4c513d/log.txt.gz 2025-09-27 20:44:18,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:44:18,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:44:18,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d4da6a7b6615d4c513d/lava_callback.json.gz 2025-09-27 20:44:18,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:18,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d4da6a7b6615d4c513d HTTP/1.1" 200 None 2025-09-27 20:44:18,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:18,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:44:18,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:18,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d4da6a7b6615d4c513d HTTP/1.1" 200 None 2025-09-27 20:44:18,700 - lava_callback - INFO - Completed processing callback for node 68d77d4da6a7b6615d4c513d 2025-09-27 20:44:19,430 - lava_callback - INFO - Received callback for node 68d77d4da6a7b6615d4c513a INFO: 172.21.0.1:54290 - "POST /node/68d77d4da6a7b6615d4c513a HTTP/1.0" 202 Accepted 2025-09-27 20:44:19,436 - lava_callback - INFO - Starting async job submit for node 68d77d4da6a7b6615d4c513a 2025-09-27 20:44:19,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:19,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d4da6a7b6615d4c513a HTTP/1.1" 200 None 2025-09-27 20:44:19,480 - lava_callback - DEBUG - Processing node 68d77d4da6a7b6615d4c513a: baseline-arm64 2025-09-27 20:44:19,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:44:19,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:44:19,960 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d4da6a7b6615d4c513a/log.txt.gz 2025-09-27 20:44:19,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:44:20,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:44:20,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d4da6a7b6615d4c513a/lava_callback.json.gz 2025-09-27 20:44:20,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:20,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d4da6a7b6615d4c513a HTTP/1.1" 200 None 2025-09-27 20:44:20,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:20,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:44:20,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:20,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d4da6a7b6615d4c513a HTTP/1.1" 200 None 2025-09-27 20:44:20,147 - lava_callback - INFO - Completed processing callback for node 68d77d4da6a7b6615d4c513a INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:44:41,799 - lava_callback - INFO - Received callback for node 68d7e0348dd6b39fd1aeb4c6 INFO: 172.21.0.1:46056 - "POST /node/68d7e0348dd6b39fd1aeb4c6 HTTP/1.0" 202 Accepted 2025-09-27 20:44:41,806 - lava_callback - INFO - Starting async job submit for node 68d7e0348dd6b39fd1aeb4c6 2025-09-27 20:44:41,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:41,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0348dd6b39fd1aeb4c6 HTTP/1.1" 200 None 2025-09-27 20:44:41,836 - lava_callback - DEBUG - Processing node 68d7e0348dd6b39fd1aeb4c6: baseline-arm64-broonie 2025-09-27 20:44:42,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:44:42,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:44:42,261 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7e0348dd6b39fd1aeb4c6/log.txt.gz 2025-09-27 20:44:42,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:44:42,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:44:42,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7e0348dd6b39fd1aeb4c6/lava_callback.json.gz 2025-09-27 20:44:42,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:42,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0348dd6b39fd1aeb4c6 HTTP/1.1" 200 None 2025-09-27 20:44:42,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:42,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 20:44:42,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:44:42,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e0348dd6b39fd1aeb4c6 HTTP/1.1" 200 None 2025-09-27 20:44:42,495 - lava_callback - INFO - Completed processing callback for node 68d7e0348dd6b39fd1aeb4c6 INFO: 172.21.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:45:20,033 - lava_callback - INFO - Received callback for node 68d77d50a6a7b6615d4c5140 INFO: 172.21.0.1:39186 - "POST /node/68d77d50a6a7b6615d4c5140 HTTP/1.0" 202 Accepted 2025-09-27 20:45:20,039 - lava_callback - INFO - Starting async job submit for node 68d77d50a6a7b6615d4c5140 2025-09-27 20:45:20,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:20,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d50a6a7b6615d4c5140 HTTP/1.1" 200 None 2025-09-27 20:45:20,073 - lava_callback - DEBUG - Processing node 68d77d50a6a7b6615d4c5140: baseline-arm64 2025-09-27 20:45:20,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:45:20,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:45:20,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d50a6a7b6615d4c5140/log.txt.gz 2025-09-27 20:45:20,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:45:20,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:45:20,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d50a6a7b6615d4c5140/lava_callback.json.gz 2025-09-27 20:45:20,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:20,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d50a6a7b6615d4c5140 HTTP/1.1" 200 None 2025-09-27 20:45:20,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:20,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:45:20,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:20,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d50a6a7b6615d4c5140 HTTP/1.1" 200 None 2025-09-27 20:45:20,772 - lava_callback - INFO - Completed processing callback for node 68d77d50a6a7b6615d4c5140 INFO: 172.21.0.1:39188 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:45:31,131 - lava_callback - INFO - Received callback for node 68d77d53a6a7b6615d4c5146 INFO: 172.21.0.1:37470 - "POST /node/68d77d53a6a7b6615d4c5146 HTTP/1.0" 202 Accepted 2025-09-27 20:45:31,138 - lava_callback - INFO - Starting async job submit for node 68d77d53a6a7b6615d4c5146 2025-09-27 20:45:31,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:31,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d53a6a7b6615d4c5146 HTTP/1.1" 200 None 2025-09-27 20:45:31,171 - lava_callback - DEBUG - Processing node 68d77d53a6a7b6615d4c5146: baseline-arm64 2025-09-27 20:45:31,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:45:31,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:45:31,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d53a6a7b6615d4c5146/log.txt.gz 2025-09-27 20:45:31,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:45:31,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:45:31,772 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d53a6a7b6615d4c5146/lava_callback.json.gz 2025-09-27 20:45:31,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:31,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d53a6a7b6615d4c5146 HTTP/1.1" 200 None 2025-09-27 20:45:31,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:31,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:45:31,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:31,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d53a6a7b6615d4c5146 HTTP/1.1" 200 None 2025-09-27 20:45:31,854 - lava_callback - INFO - Completed processing callback for node 68d77d53a6a7b6615d4c5146 INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:45:40,181 - lava_callback - INFO - Received callback for node 68d7d85c8dd6b39fd1aeb33a INFO: 172.21.0.1:38682 - "POST /node/68d7d85c8dd6b39fd1aeb33a HTTP/1.0" 202 Accepted 2025-09-27 20:45:40,187 - lava_callback - INFO - Starting async job submit for node 68d7d85c8dd6b39fd1aeb33a 2025-09-27 20:45:40,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:40,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d85c8dd6b39fd1aeb33a HTTP/1.1" 200 None 2025-09-27 20:45:40,220 - lava_callback - DEBUG - Processing node 68d7d85c8dd6b39fd1aeb33a: baseline-arm 2025-09-27 20:45:40,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:45:40,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:45:40,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d85c8dd6b39fd1aeb33a/log.txt.gz 2025-09-27 20:45:40,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:45:40,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:45:40,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d85c8dd6b39fd1aeb33a/lava_callback.json.gz 2025-09-27 20:45:40,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:40,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d85c8dd6b39fd1aeb33a HTTP/1.1" 200 None 2025-09-27 20:45:40,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:40,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 20:45:40,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:40,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d85c8dd6b39fd1aeb33a HTTP/1.1" 200 None 2025-09-27 20:45:40,802 - lava_callback - INFO - Completed processing callback for node 68d7d85c8dd6b39fd1aeb33a 2025-09-27 20:45:44,946 - lava_callback - INFO - Received callback for node 68d77d50a6a7b6615d4c5143 INFO: 172.21.0.1:38686 - "POST /node/68d77d50a6a7b6615d4c5143 HTTP/1.0" 202 Accepted 2025-09-27 20:45:44,953 - lava_callback - INFO - Starting async job submit for node 68d77d50a6a7b6615d4c5143 2025-09-27 20:45:44,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:44,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d50a6a7b6615d4c5143 HTTP/1.1" 200 None 2025-09-27 20:45:44,991 - lava_callback - DEBUG - Processing node 68d77d50a6a7b6615d4c5143: baseline-arm64 2025-09-27 20:45:45,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:45:45,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:45:45,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d50a6a7b6615d4c5143/log.txt.gz 2025-09-27 20:45:45,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:45:45,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:45:45,622 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d50a6a7b6615d4c5143/lava_callback.json.gz 2025-09-27 20:45:45,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:45,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d50a6a7b6615d4c5143 HTTP/1.1" 200 None 2025-09-27 20:45:45,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:45,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:45:45,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:45:45,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d50a6a7b6615d4c5143 HTTP/1.1" 200 None 2025-09-27 20:45:45,699 - lava_callback - INFO - Completed processing callback for node 68d77d50a6a7b6615d4c5143 INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:46:30,621 - lava_callback - INFO - Received callback for node 68d78b65a6a7b6615d4c52bc INFO: 172.21.0.1:58754 - "POST /node/68d78b65a6a7b6615d4c52bc HTTP/1.0" 202 Accepted 2025-09-27 20:46:30,627 - lava_callback - INFO - Starting async job submit for node 68d78b65a6a7b6615d4c52bc 2025-09-27 20:46:30,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:46:30,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b65a6a7b6615d4c52bc HTTP/1.1" 200 None 2025-09-27 20:46:30,662 - lava_callback - DEBUG - Processing node 68d78b65a6a7b6615d4c52bc: baseline-arm64 2025-09-27 20:46:30,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:46:31,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:46:31,093 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b65a6a7b6615d4c52bc/log.txt.gz 2025-09-27 20:46:31,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:46:31,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:46:31,239 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b65a6a7b6615d4c52bc/lava_callback.json.gz 2025-09-27 20:46:31,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:46:31,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b65a6a7b6615d4c52bc HTTP/1.1" 200 None 2025-09-27 20:46:31,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:46:31,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 20:46:31,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:46:31,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b65a6a7b6615d4c52bc HTTP/1.1" 200 None 2025-09-27 20:46:31,312 - lava_callback - INFO - Completed processing callback for node 68d78b65a6a7b6615d4c52bc INFO: 172.21.0.1:58756 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:46:39,798 - lava_callback - INFO - Received callback for node 68d77d53a6a7b6615d4c5149 INFO: 172.21.0.1:50240 - "POST /node/68d77d53a6a7b6615d4c5149 HTTP/1.0" 202 Accepted 2025-09-27 20:46:39,804 - lava_callback - INFO - Starting async job submit for node 68d77d53a6a7b6615d4c5149 2025-09-27 20:46:39,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:46:39,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d53a6a7b6615d4c5149 HTTP/1.1" 200 None 2025-09-27 20:46:39,838 - lava_callback - DEBUG - Processing node 68d77d53a6a7b6615d4c5149: baseline-arm64 2025-09-27 20:46:40,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:46:40,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:46:40,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d53a6a7b6615d4c5149/log.txt.gz 2025-09-27 20:46:40,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:46:40,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:46:40,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d77d53a6a7b6615d4c5149/lava_callback.json.gz 2025-09-27 20:46:40,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:46:40,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d77d53a6a7b6615d4c5149 HTTP/1.1" 200 None 2025-09-27 20:46:40,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:46:40,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:46:40,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:46:40,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d77d53a6a7b6615d4c5149 HTTP/1.1" 200 None 2025-09-27 20:46:40,533 - lava_callback - INFO - Completed processing callback for node 68d77d53a6a7b6615d4c5149 INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:47:01,609 - lava_callback - INFO - Received callback for node 68d78b66a6a7b6615d4c52c6 INFO: 172.21.0.1:41314 - "POST /node/68d78b66a6a7b6615d4c52c6 HTTP/1.0" 202 Accepted 2025-09-27 20:47:01,616 - lava_callback - INFO - Starting async job submit for node 68d78b66a6a7b6615d4c52c6 2025-09-27 20:47:01,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:47:01,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b66a6a7b6615d4c52c6 HTTP/1.1" 200 None 2025-09-27 20:47:01,648 - lava_callback - DEBUG - Processing node 68d78b66a6a7b6615d4c52c6: baseline-arm64 2025-09-27 20:47:02,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:47:02,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:47:02,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b66a6a7b6615d4c52c6/log.txt.gz 2025-09-27 20:47:02,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:47:02,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:47:02,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b66a6a7b6615d4c52c6/lava_callback.json.gz 2025-09-27 20:47:02,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:47:03,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b66a6a7b6615d4c52c6 HTTP/1.1" 200 None 2025-09-27 20:47:03,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:47:03,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 20:47:03,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:47:03,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b66a6a7b6615d4c52c6 HTTP/1.1" 200 None 2025-09-27 20:47:03,037 - lava_callback - INFO - Completed processing callback for node 68d78b66a6a7b6615d4c52c6 INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:47:32,952 - lava_callback - INFO - Received callback for node 68d78b69a6a7b6615d4c52c9 INFO: 172.21.0.1:37308 - "POST /node/68d78b69a6a7b6615d4c52c9 HTTP/1.0" 202 Accepted 2025-09-27 20:47:32,959 - lava_callback - INFO - Starting async job submit for node 68d78b69a6a7b6615d4c52c9 2025-09-27 20:47:32,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:47:32,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b69a6a7b6615d4c52c9 HTTP/1.1" 200 None 2025-09-27 20:47:32,997 - lava_callback - DEBUG - Processing node 68d78b69a6a7b6615d4c52c9: baseline-arm64 2025-09-27 20:47:33,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:47:33,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:47:33,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b69a6a7b6615d4c52c9/log.txt.gz 2025-09-27 20:47:33,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:47:33,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:47:33,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b69a6a7b6615d4c52c9/lava_callback.json.gz 2025-09-27 20:47:33,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:47:33,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b69a6a7b6615d4c52c9 HTTP/1.1" 200 None 2025-09-27 20:47:33,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:47:33,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 20:47:33,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:47:33,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b69a6a7b6615d4c52c9 HTTP/1.1" 200 None 2025-09-27 20:47:33,668 - lava_callback - INFO - Completed processing callback for node 68d78b69a6a7b6615d4c52c9 INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54280 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:48:03,050 - lava_callback - INFO - Received callback for node 68d7d85e8dd6b39fd1aeb33d INFO: 172.21.0.1:54282 - "POST /node/68d7d85e8dd6b39fd1aeb33d HTTP/1.0" 202 Accepted 2025-09-27 20:48:03,056 - lava_callback - INFO - Starting async job submit for node 68d7d85e8dd6b39fd1aeb33d 2025-09-27 20:48:03,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:03,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d85e8dd6b39fd1aeb33d HTTP/1.1" 200 None 2025-09-27 20:48:03,090 - lava_callback - DEBUG - Processing node 68d7d85e8dd6b39fd1aeb33d: baseline-arm 2025-09-27 20:48:03,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:48:03,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:48:03,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d85e8dd6b39fd1aeb33d/log.txt.gz 2025-09-27 20:48:03,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:48:03,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:48:03,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d85e8dd6b39fd1aeb33d/lava_callback.json.gz 2025-09-27 20:48:03,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:03,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d85e8dd6b39fd1aeb33d HTTP/1.1" 200 None 2025-09-27 20:48:03,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:03,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 20:48:03,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:03,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d85e8dd6b39fd1aeb33d HTTP/1.1" 200 None 2025-09-27 20:48:03,826 - lava_callback - INFO - Completed processing callback for node 68d7d85e8dd6b39fd1aeb33d 2025-09-27 20:48:04,282 - lava_callback - INFO - Received callback for node 68d78b6aa6a7b6615d4c52cc INFO: 172.21.0.1:54290 - "POST /node/68d78b6aa6a7b6615d4c52cc HTTP/1.0" 202 Accepted 2025-09-27 20:48:04,288 - lava_callback - INFO - Starting async job submit for node 68d78b6aa6a7b6615d4c52cc 2025-09-27 20:48:04,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:04,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b6aa6a7b6615d4c52cc HTTP/1.1" 200 None 2025-09-27 20:48:04,322 - lava_callback - DEBUG - Processing node 68d78b6aa6a7b6615d4c52cc: baseline-arm64 2025-09-27 20:48:04,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:48:04,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:48:04,760 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b6aa6a7b6615d4c52cc/log.txt.gz 2025-09-27 20:48:04,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:48:04,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:48:04,876 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b6aa6a7b6615d4c52cc/lava_callback.json.gz 2025-09-27 20:48:04,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:04,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b6aa6a7b6615d4c52cc HTTP/1.1" 200 None 2025-09-27 20:48:04,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:04,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 20:48:04,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:04,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b6aa6a7b6615d4c52cc HTTP/1.1" 200 None 2025-09-27 20:48:04,955 - lava_callback - INFO - Completed processing callback for node 68d78b6aa6a7b6615d4c52cc INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40334 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:48:19,791 - lava_callback - INFO - Received callback for node 68d78b8ca6a7b6615d4c52ed INFO: 172.21.0.1:39966 - "POST /node/68d78b8ca6a7b6615d4c52ed HTTP/1.0" 202 Accepted 2025-09-27 20:48:19,799 - lava_callback - INFO - Starting async job submit for node 68d78b8ca6a7b6615d4c52ed 2025-09-27 20:48:19,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:19,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b8ca6a7b6615d4c52ed HTTP/1.1" 200 None 2025-09-27 20:48:19,840 - lava_callback - DEBUG - Processing node 68d78b8ca6a7b6615d4c52ed: baseline-arm64 2025-09-27 20:48:20,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:48:20,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:48:20,343 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b8ca6a7b6615d4c52ed/log.txt.gz 2025-09-27 20:48:20,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:48:20,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:48:20,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b8ca6a7b6615d4c52ed/lava_callback.json.gz 2025-09-27 20:48:20,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:20,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b8ca6a7b6615d4c52ed HTTP/1.1" 200 None 2025-09-27 20:48:20,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:20,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 20:48:20,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:20,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b8ca6a7b6615d4c52ed HTTP/1.1" 200 None 2025-09-27 20:48:20,549 - lava_callback - INFO - Completed processing callback for node 68d78b8ca6a7b6615d4c52ed INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:48:51,003 - lava_callback - INFO - Received callback for node 68d78b8da6a7b6615d4c52f0 INFO: 172.21.0.1:40702 - "POST /node/68d78b8da6a7b6615d4c52f0 HTTP/1.0" 202 Accepted 2025-09-27 20:48:51,009 - lava_callback - INFO - Starting async job submit for node 68d78b8da6a7b6615d4c52f0 2025-09-27 20:48:51,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:51,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b8da6a7b6615d4c52f0 HTTP/1.1" 200 None 2025-09-27 20:48:51,073 - lava_callback - DEBUG - Processing node 68d78b8da6a7b6615d4c52f0: baseline-arm64 2025-09-27 20:48:51,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:48:51,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:48:51,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b8da6a7b6615d4c52f0/log.txt.gz 2025-09-27 20:48:51,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:48:51,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:48:51,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b8da6a7b6615d4c52f0/lava_callback.json.gz 2025-09-27 20:48:51,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:51,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b8da6a7b6615d4c52f0 HTTP/1.1" 200 None 2025-09-27 20:48:51,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:51,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 20:48:51,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:48:51,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b8da6a7b6615d4c52f0 HTTP/1.1" 200 None 2025-09-27 20:48:51,757 - lava_callback - INFO - Completed processing callback for node 68d78b8da6a7b6615d4c52f0 INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:49:25,644 - lava_callback - INFO - Received callback for node 68d78b8fa6a7b6615d4c52f3 INFO: 172.21.0.1:59092 - "POST /node/68d78b8fa6a7b6615d4c52f3 HTTP/1.0" 202 Accepted 2025-09-27 20:49:25,650 - lava_callback - INFO - Starting async job submit for node 68d78b8fa6a7b6615d4c52f3 2025-09-27 20:49:25,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:49:25,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b8fa6a7b6615d4c52f3 HTTP/1.1" 200 None 2025-09-27 20:49:25,707 - lava_callback - DEBUG - Processing node 68d78b8fa6a7b6615d4c52f3: baseline-arm64 2025-09-27 20:49:26,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:49:26,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:49:26,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b8fa6a7b6615d4c52f3/log.txt.gz 2025-09-27 20:49:26,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:49:26,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:49:26,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b8fa6a7b6615d4c52f3/lava_callback.json.gz 2025-09-27 20:49:26,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:49:26,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b8fa6a7b6615d4c52f3 HTTP/1.1" 200 None 2025-09-27 20:49:26,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:49:26,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 20:49:26,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:49:26,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b8fa6a7b6615d4c52f3 HTTP/1.1" 200 None 2025-09-27 20:49:26,535 - lava_callback - INFO - Completed processing callback for node 68d78b8fa6a7b6615d4c52f3 INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:49:39,783 - lava_callback - INFO - Received callback for node 68d78b90a6a7b6615d4c52f6 INFO: 172.21.0.1:58738 - "POST /node/68d78b90a6a7b6615d4c52f6 HTTP/1.0" 202 Accepted 2025-09-27 20:49:39,790 - lava_callback - INFO - Starting async job submit for node 68d78b90a6a7b6615d4c52f6 2025-09-27 20:49:39,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:49:39,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b90a6a7b6615d4c52f6 HTTP/1.1" 200 None 2025-09-27 20:49:39,833 - lava_callback - DEBUG - Processing node 68d78b90a6a7b6615d4c52f6: baseline-arm64 2025-09-27 20:49:40,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:49:40,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:49:40,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b90a6a7b6615d4c52f6/log.txt.gz 2025-09-27 20:49:40,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:49:40,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:49:40,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d78b90a6a7b6615d4c52f6/lava_callback.json.gz 2025-09-27 20:49:40,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:49:40,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d78b90a6a7b6615d4c52f6 HTTP/1.1" 200 None 2025-09-27 20:49:40,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:49:40,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 20:49:40,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:49:40,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d78b90a6a7b6615d4c52f6 HTTP/1.1" 200 None 2025-09-27 20:49:40,562 - lava_callback - INFO - Completed processing callback for node 68d78b90a6a7b6615d4c52f6 INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:50:21,905 - lava_callback - INFO - Received callback for node 68d7fb1e8dd6b39fd1aeb817 INFO: 172.21.0.1:41736 - "POST /node/68d7fb1e8dd6b39fd1aeb817 HTTP/1.0" 202 Accepted 2025-09-27 20:50:21,911 - lava_callback - INFO - Starting async job submit for node 68d7fb1e8dd6b39fd1aeb817 2025-09-27 20:50:21,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:21,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7fb1e8dd6b39fd1aeb817 HTTP/1.1" 200 None 2025-09-27 20:50:21,941 - lava_callback - DEBUG - Processing node 68d7fb1e8dd6b39fd1aeb817: baseline-arm64-broonie 2025-09-27 20:50:22,052 - lava_callback - INFO - Received callback for node 68d7d85e8dd6b39fd1aeb340 INFO: 172.21.0.1:41746 - "POST /node/68d7d85e8dd6b39fd1aeb340 HTTP/1.0" 202 Accepted 2025-09-27 20:50:22,069 - lava_callback - INFO - Starting async job submit for node 68d7d85e8dd6b39fd1aeb340 2025-09-27 20:50:22,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:22,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d85e8dd6b39fd1aeb340 HTTP/1.1" 200 None 2025-09-27 20:50:22,244 - lava_callback - DEBUG - Processing node 68d7d85e8dd6b39fd1aeb340: baseline-arm 2025-09-27 20:50:22,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:50:22,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:50:22,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:50:22,586 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7fb1e8dd6b39fd1aeb817/log.txt.gz 2025-09-27 20:50:22,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:50:22,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:50:22,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d85e8dd6b39fd1aeb340/log.txt.gz 2025-09-27 20:50:22,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:50:22,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:50:22,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7fb1e8dd6b39fd1aeb817/lava_callback.json.gz 2025-09-27 20:50:22,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:22,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7fb1e8dd6b39fd1aeb817 HTTP/1.1" 200 None 2025-09-27 20:50:22,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:22,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eda8dd6b39fd1aea2de HTTP/1.1" 200 None 2025-09-27 20:50:22,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:22,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7fb1e8dd6b39fd1aeb817 HTTP/1.1" 200 None 2025-09-27 20:50:22,849 - lava_callback - INFO - Completed processing callback for node 68d7fb1e8dd6b39fd1aeb817 2025-09-27 20:50:22,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:50:22,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7d85e8dd6b39fd1aeb340/lava_callback.json.gz 2025-09-27 20:50:22,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:22,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d85e8dd6b39fd1aeb340 HTTP/1.1" 200 None 2025-09-27 20:50:22,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:22,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 20:50:22,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:23,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d85e8dd6b39fd1aeb340 HTTP/1.1" 200 None 2025-09-27 20:50:23,025 - lava_callback - INFO - Completed processing callback for node 68d7d85e8dd6b39fd1aeb340 2025-09-27 20:50:24,022 - lava_callback - INFO - Received callback for node 68d7a1a48dd6b39fd1aea6b0 INFO: 172.21.0.1:41754 - "POST /node/68d7a1a48dd6b39fd1aea6b0 HTTP/1.0" 202 Accepted 2025-09-27 20:50:24,030 - lava_callback - INFO - Starting async job submit for node 68d7a1a48dd6b39fd1aea6b0 2025-09-27 20:50:24,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:24,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1a48dd6b39fd1aea6b0 HTTP/1.1" 200 None 2025-09-27 20:50:24,065 - lava_callback - DEBUG - Processing node 68d7a1a48dd6b39fd1aea6b0: baseline-arm64 2025-09-27 20:50:24,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:50:24,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:50:24,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a1a48dd6b39fd1aea6b0/log.txt.gz 2025-09-27 20:50:24,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:50:24,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:50:24,859 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a1a48dd6b39fd1aea6b0/lava_callback.json.gz 2025-09-27 20:50:24,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:24,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1a48dd6b39fd1aea6b0 HTTP/1.1" 200 None 2025-09-27 20:50:24,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:24,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79ae2a6a7b6615d4c53f2 HTTP/1.1" 200 None 2025-09-27 20:50:24,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:24,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a1a48dd6b39fd1aea6b0 HTTP/1.1" 200 None 2025-09-27 20:50:24,954 - lava_callback - INFO - Completed processing callback for node 68d7a1a48dd6b39fd1aea6b0 INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:50:40,518 - lava_callback - INFO - Received callback for node 68d7a1af8dd6b39fd1aea6cd INFO: 172.21.0.1:47140 - "POST /node/68d7a1af8dd6b39fd1aea6cd HTTP/1.0" 202 Accepted 2025-09-27 20:50:40,524 - lava_callback - INFO - Starting async job submit for node 68d7a1af8dd6b39fd1aea6cd 2025-09-27 20:50:40,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:40,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1af8dd6b39fd1aea6cd HTTP/1.1" 200 None 2025-09-27 20:50:40,558 - lava_callback - DEBUG - Processing node 68d7a1af8dd6b39fd1aea6cd: baseline-arm64 2025-09-27 20:50:40,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:50:41,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:50:41,049 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a1af8dd6b39fd1aea6cd/log.txt.gz 2025-09-27 20:50:41,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:50:41,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:50:41,199 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a1af8dd6b39fd1aea6cd/lava_callback.json.gz 2025-09-27 20:50:41,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:41,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a1af8dd6b39fd1aea6cd HTTP/1.1" 200 None 2025-09-27 20:50:41,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:41,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79ae2a6a7b6615d4c53f2 HTTP/1.1" 200 None 2025-09-27 20:50:41,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:41,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a1af8dd6b39fd1aea6cd HTTP/1.1" 200 None 2025-09-27 20:50:41,274 - lava_callback - INFO - Completed processing callback for node 68d7a1af8dd6b39fd1aea6cd 2025-09-27 20:50:44,305 - lava_callback - INFO - Received callback for node 68d5a8672be2da466069a20f INFO: 172.21.0.1:47154 - "POST /node/68d5a8672be2da466069a20f HTTP/1.0" 202 Accepted 2025-09-27 20:50:44,312 - lava_callback - INFO - Starting async job submit for node 68d5a8672be2da466069a20f 2025-09-27 20:50:44,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:50:44,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5a8672be2da466069a20f HTTP/1.1" 200 None 2025-09-27 20:50:44,355 - lava_callback - DEBUG - Processing node 68d5a8672be2da466069a20f: baseline-arm 2025-09-27 20:50:44,618 - lava_callback - ERROR - Error processing callback for node 68d5a8672be2da466069a20f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:52:40,014 - lava_callback - INFO - Received callback for node 68d7dc8d8dd6b39fd1aeb3af INFO: 172.21.0.1:43344 - "POST /node/68d7dc8d8dd6b39fd1aeb3af HTTP/1.0" 202 Accepted 2025-09-27 20:52:40,020 - lava_callback - INFO - Starting async job submit for node 68d7dc8d8dd6b39fd1aeb3af 2025-09-27 20:52:40,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:52:40,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc8d8dd6b39fd1aeb3af HTTP/1.1" 200 None 2025-09-27 20:52:40,054 - lava_callback - DEBUG - Processing node 68d7dc8d8dd6b39fd1aeb3af: baseline-arm 2025-09-27 20:52:40,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:52:40,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:52:40,430 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc8d8dd6b39fd1aeb3af/log.txt.gz 2025-09-27 20:52:40,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:52:40,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:52:40,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc8d8dd6b39fd1aeb3af/lava_callback.json.gz 2025-09-27 20:52:40,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:52:40,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc8d8dd6b39fd1aeb3af HTTP/1.1" 200 None 2025-09-27 20:52:40,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:52:40,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 20:52:40,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:52:40,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc8d8dd6b39fd1aeb3af HTTP/1.1" 200 None 2025-09-27 20:52:40,665 - lava_callback - INFO - Completed processing callback for node 68d7dc8d8dd6b39fd1aeb3af INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:53:40,269 - lava_callback - INFO - Received callback for node 68d7fcb58dd6b39fd1aeb841 INFO: 172.21.0.1:33352 - "POST /node/68d7fcb58dd6b39fd1aeb841 HTTP/1.0" 202 Accepted 2025-09-27 20:53:40,275 - lava_callback - INFO - Starting async job submit for node 68d7fcb58dd6b39fd1aeb841 2025-09-27 20:53:40,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:53:40,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7fcb58dd6b39fd1aeb841 HTTP/1.1" 200 None 2025-09-27 20:53:40,305 - lava_callback - DEBUG - Processing node 68d7fcb58dd6b39fd1aeb841: baseline-arm64-broonie 2025-09-27 20:53:40,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:53:40,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:53:40,797 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7fcb58dd6b39fd1aeb841/log.txt.gz 2025-09-27 20:53:40,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:53:40,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:53:40,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7fcb58dd6b39fd1aeb841/lava_callback.json.gz 2025-09-27 20:53:40,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:53:40,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7fcb58dd6b39fd1aeb841 HTTP/1.1" 200 None 2025-09-27 20:53:40,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:53:40,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 20:53:40,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:53:41,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7fcb58dd6b39fd1aeb841 HTTP/1.1" 200 None 2025-09-27 20:53:41,045 - lava_callback - INFO - Completed processing callback for node 68d7fcb58dd6b39fd1aeb841 INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:53:52,327 - lava_callback - INFO - Received callback for node 68d5abdc2be2da466069a55f INFO: 172.21.0.1:56780 - "POST /node/68d5abdc2be2da466069a55f HTTP/1.0" 202 Accepted 2025-09-27 20:53:52,332 - lava_callback - INFO - Starting async job submit for node 68d5abdc2be2da466069a55f 2025-09-27 20:53:52,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:53:52,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5abdc2be2da466069a55f HTTP/1.1" 200 None 2025-09-27 20:53:52,355 - lava_callback - DEBUG - Processing node 68d5abdc2be2da466069a55f: baseline-arm64-baylibre 2025-09-27 20:53:52,355 - lava_callback - ERROR - Error processing callback for node 68d5abdc2be2da466069a55f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:54:32,339 - lava_callback - INFO - Received callback for node 68d5abf42be2da466069a577 INFO: 172.21.0.1:57978 - "POST /node/68d5abf42be2da466069a577 HTTP/1.0" 202 Accepted 2025-09-27 20:54:32,344 - lava_callback - INFO - Starting async job submit for node 68d5abf42be2da466069a577 2025-09-27 20:54:32,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:54:32,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5abf42be2da466069a577 HTTP/1.1" 200 None 2025-09-27 20:54:32,357 - lava_callback - DEBUG - Processing node 68d5abf42be2da466069a577: baseline-arm64-baylibre 2025-09-27 20:54:32,357 - lava_callback - ERROR - Error processing callback for node 68d5abf42be2da466069a577: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:55:02,493 - lava_callback - INFO - Received callback for node 68d7dc8f8dd6b39fd1aeb3b5 INFO: 172.21.0.1:59778 - "POST /node/68d7dc8f8dd6b39fd1aeb3b5 HTTP/1.0" 202 Accepted 2025-09-27 20:55:02,499 - lava_callback - INFO - Starting async job submit for node 68d7dc8f8dd6b39fd1aeb3b5 2025-09-27 20:55:02,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:02,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc8f8dd6b39fd1aeb3b5 HTTP/1.1" 200 None 2025-09-27 20:55:02,532 - lava_callback - DEBUG - Processing node 68d7dc8f8dd6b39fd1aeb3b5: baseline-arm 2025-09-27 20:55:02,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:55:02,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:55:02,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc8f8dd6b39fd1aeb3b5/log.txt.gz 2025-09-27 20:55:02,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:55:03,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:55:03,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc8f8dd6b39fd1aeb3b5/lava_callback.json.gz 2025-09-27 20:55:03,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:03,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc8f8dd6b39fd1aeb3b5 HTTP/1.1" 200 None 2025-09-27 20:55:03,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:03,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 20:55:03,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:03,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc8f8dd6b39fd1aeb3b5 HTTP/1.1" 200 None 2025-09-27 20:55:03,149 - lava_callback - INFO - Completed processing callback for node 68d7dc8f8dd6b39fd1aeb3b5 2025-09-27 20:55:03,852 - lava_callback - INFO - Received callback for node 68d5ac212be2da466069a5a1 INFO: 172.21.0.1:59782 - "POST /node/68d5ac212be2da466069a5a1 HTTP/1.0" 202 Accepted 2025-09-27 20:55:03,857 - lava_callback - INFO - Starting async job submit for node 68d5ac212be2da466069a5a1 2025-09-27 20:55:03,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:03,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ac212be2da466069a5a1 HTTP/1.1" 200 None 2025-09-27 20:55:03,884 - lava_callback - DEBUG - Processing node 68d5ac212be2da466069a5a1: baseline-arm64-clabbe 2025-09-27 20:55:03,884 - lava_callback - ERROR - Error processing callback for node 68d5ac212be2da466069a5a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:55:23,829 - lava_callback - INFO - Received callback for node 68d5ac292be2da466069a5a7 INFO: 172.21.0.1:43036 - "POST /node/68d5ac292be2da466069a5a7 HTTP/1.0" 202 Accepted 2025-09-27 20:55:23,836 - lava_callback - INFO - Starting async job submit for node 68d5ac292be2da466069a5a7 2025-09-27 20:55:23,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:23,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ac292be2da466069a5a7 HTTP/1.1" 200 None 2025-09-27 20:55:23,852 - lava_callback - DEBUG - Processing node 68d5ac292be2da466069a5a7: baseline-arm64-clabbe 2025-09-27 20:55:23,852 - lava_callback - ERROR - Error processing callback for node 68d5ac292be2da466069a5a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:55:24,501 - lava_callback - INFO - Received callback for node 68d5ac2b2be2da466069a5aa INFO: 172.21.0.1:43040 - "POST /node/68d5ac2b2be2da466069a5aa HTTP/1.0" 202 Accepted 2025-09-27 20:55:24,506 - lava_callback - INFO - Starting async job submit for node 68d5ac2b2be2da466069a5aa 2025-09-27 20:55:24,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:24,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ac2b2be2da466069a5aa HTTP/1.1" 200 None 2025-09-27 20:55:24,521 - lava_callback - DEBUG - Processing node 68d5ac2b2be2da466069a5aa: baseline-arm64-clabbe 2025-09-27 20:55:24,521 - lava_callback - ERROR - Error processing callback for node 68d5ac2b2be2da466069a5aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:55:25,175 - lava_callback - INFO - Received callback for node 68d5ac2e2be2da466069a5ad INFO: 172.21.0.1:43046 - "POST /node/68d5ac2e2be2da466069a5ad HTTP/1.0" 202 Accepted 2025-09-27 20:55:25,181 - lava_callback - INFO - Starting async job submit for node 68d5ac2e2be2da466069a5ad 2025-09-27 20:55:25,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:25,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ac2e2be2da466069a5ad HTTP/1.1" 200 None 2025-09-27 20:55:25,202 - lava_callback - DEBUG - Processing node 68d5ac2e2be2da466069a5ad: baseline-arm64-clabbe 2025-09-27 20:55:25,203 - lava_callback - ERROR - Error processing callback for node 68d5ac2e2be2da466069a5ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:55:25,822 - lava_callback - INFO - Received callback for node 68d5ac312be2da466069a5b0 INFO: 172.21.0.1:43050 - "POST /node/68d5ac312be2da466069a5b0 HTTP/1.0" 202 Accepted 2025-09-27 20:55:25,828 - lava_callback - INFO - Starting async job submit for node 68d5ac312be2da466069a5b0 2025-09-27 20:55:25,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:25,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ac312be2da466069a5b0 HTTP/1.1" 200 None 2025-09-27 20:55:25,842 - lava_callback - DEBUG - Processing node 68d5ac312be2da466069a5b0: baseline-arm64-clabbe 2025-09-27 20:55:25,842 - lava_callback - ERROR - Error processing callback for node 68d5ac312be2da466069a5b0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 20:55:26,489 - lava_callback - INFO - Received callback for node 68d5ac352be2da466069a5b3 INFO: 172.21.0.1:43064 - "POST /node/68d5ac352be2da466069a5b3 HTTP/1.0" 202 Accepted 2025-09-27 20:55:26,495 - lava_callback - INFO - Starting async job submit for node 68d5ac352be2da466069a5b3 2025-09-27 20:55:26,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:55:26,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ac352be2da466069a5b3 HTTP/1.1" 200 None 2025-09-27 20:55:26,507 - lava_callback - DEBUG - Processing node 68d5ac352be2da466069a5b3: baseline-arm64-clabbe 2025-09-27 20:55:26,507 - lava_callback - ERROR - Error processing callback for node 68d5ac352be2da466069a5b3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37118 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:56:49,324 - lava_callback - INFO - Received callback for node 68d7fefe8dd6b39fd1aeb88d INFO: 172.21.0.1:59340 - "POST /node/68d7fefe8dd6b39fd1aeb88d HTTP/1.0" 202 Accepted 2025-09-27 20:56:49,330 - lava_callback - INFO - Starting async job submit for node 68d7fefe8dd6b39fd1aeb88d 2025-09-27 20:56:49,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:56:49,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7fefe8dd6b39fd1aeb88d HTTP/1.1" 200 None 2025-09-27 20:56:49,361 - lava_callback - DEBUG - Processing node 68d7fefe8dd6b39fd1aeb88d: baseline-arm64-broonie 2025-09-27 20:56:49,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:56:49,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:56:49,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7fefe8dd6b39fd1aeb88d/log.txt.gz 2025-09-27 20:56:49,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:56:49,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:56:49,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7fefe8dd6b39fd1aeb88d/lava_callback.json.gz 2025-09-27 20:56:49,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:56:50,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7fefe8dd6b39fd1aeb88d HTTP/1.1" 200 None 2025-09-27 20:56:50,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:56:50,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 20:56:50,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:56:50,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7fefe8dd6b39fd1aeb88d HTTP/1.1" 200 None 2025-09-27 20:56:50,054 - lava_callback - INFO - Completed processing callback for node 68d7fefe8dd6b39fd1aeb88d INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:57:17,629 - lava_callback - INFO - Received callback for node 68d7dc908dd6b39fd1aeb3b8 INFO: 172.21.0.1:43856 - "POST /node/68d7dc908dd6b39fd1aeb3b8 HTTP/1.0" 202 Accepted 2025-09-27 20:57:17,635 - lava_callback - INFO - Starting async job submit for node 68d7dc908dd6b39fd1aeb3b8 2025-09-27 20:57:17,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:57:17,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc908dd6b39fd1aeb3b8 HTTP/1.1" 200 None 2025-09-27 20:57:17,677 - lava_callback - DEBUG - Processing node 68d7dc908dd6b39fd1aeb3b8: baseline-arm 2025-09-27 20:57:17,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:57:18,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:57:18,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc908dd6b39fd1aeb3b8/log.txt.gz 2025-09-27 20:57:18,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:57:18,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:57:18,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc908dd6b39fd1aeb3b8/lava_callback.json.gz 2025-09-27 20:57:18,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:57:18,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc908dd6b39fd1aeb3b8 HTTP/1.1" 200 None 2025-09-27 20:57:18,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:57:18,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 20:57:18,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:57:18,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc908dd6b39fd1aeb3b8 HTTP/1.1" 200 None 2025-09-27 20:57:18,226 - lava_callback - INFO - Completed processing callback for node 68d7dc908dd6b39fd1aeb3b8 INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK 2025-09-27 20:59:43,204 - lava_callback - INFO - Received callback for node 68d7dc918dd6b39fd1aeb3bb INFO: 172.21.0.1:56786 - "POST /node/68d7dc918dd6b39fd1aeb3bb HTTP/1.0" 202 Accepted 2025-09-27 20:59:43,210 - lava_callback - INFO - Starting async job submit for node 68d7dc918dd6b39fd1aeb3bb 2025-09-27 20:59:43,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:59:43,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc918dd6b39fd1aeb3bb HTTP/1.1" 200 None 2025-09-27 20:59:43,263 - lava_callback - DEBUG - Processing node 68d7dc918dd6b39fd1aeb3bb: baseline-arm 2025-09-27 20:59:43,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:59:43,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:59:43,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc918dd6b39fd1aeb3bb/log.txt.gz 2025-09-27 20:59:43,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 20:59:43,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 20:59:43,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc918dd6b39fd1aeb3bb/lava_callback.json.gz 2025-09-27 20:59:43,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:59:43,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc918dd6b39fd1aeb3bb HTTP/1.1" 200 None 2025-09-27 20:59:43,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:59:43,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 20:59:43,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 20:59:43,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc918dd6b39fd1aeb3bb HTTP/1.1" 200 None 2025-09-27 20:59:43,901 - lava_callback - INFO - Completed processing callback for node 68d7dc918dd6b39fd1aeb3bb INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:00:14,509 - lava_callback - INFO - Received callback for node 68d801518dd6b39fd1aeb8b8 INFO: 172.21.0.1:34174 - "POST /node/68d801518dd6b39fd1aeb8b8 HTTP/1.0" 202 Accepted 2025-09-27 21:00:14,515 - lava_callback - INFO - Starting async job submit for node 68d801518dd6b39fd1aeb8b8 2025-09-27 21:00:14,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:00:14,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d801518dd6b39fd1aeb8b8 HTTP/1.1" 200 None 2025-09-27 21:00:14,547 - lava_callback - DEBUG - Processing node 68d801518dd6b39fd1aeb8b8: baseline-arm64-broonie 2025-09-27 21:00:14,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:00:15,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:00:15,011 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d801518dd6b39fd1aeb8b8/log.txt.gz 2025-09-27 21:00:15,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34184 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 21:00:15,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:00:15,165 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d801518dd6b39fd1aeb8b8/lava_callback.json.gz 2025-09-27 21:00:15,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:00:15,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d801518dd6b39fd1aeb8b8 HTTP/1.1" 200 None 2025-09-27 21:00:15,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:00:15,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 21:00:15,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:00:15,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d801518dd6b39fd1aeb8b8 HTTP/1.1" 200 None 2025-09-27 21:00:15,260 - lava_callback - INFO - Completed processing callback for node 68d801518dd6b39fd1aeb8b8 INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:02:03,038 - lava_callback - INFO - Received callback for node 68d7dc968dd6b39fd1aeb3ca INFO: 172.21.0.1:54904 - "POST /node/68d7dc968dd6b39fd1aeb3ca HTTP/1.0" 202 Accepted 2025-09-27 21:02:03,044 - lava_callback - INFO - Starting async job submit for node 68d7dc968dd6b39fd1aeb3ca 2025-09-27 21:02:03,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:02:03,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc968dd6b39fd1aeb3ca HTTP/1.1" 200 None 2025-09-27 21:02:03,078 - lava_callback - DEBUG - Processing node 68d7dc968dd6b39fd1aeb3ca: baseline-arm 2025-09-27 21:02:03,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:02:03,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:02:03,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc968dd6b39fd1aeb3ca/log.txt.gz 2025-09-27 21:02:03,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:02:03,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:02:03,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc968dd6b39fd1aeb3ca/lava_callback.json.gz 2025-09-27 21:02:03,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:02:03,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc968dd6b39fd1aeb3ca HTTP/1.1" 200 None 2025-09-27 21:02:03,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:02:03,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 21:02:03,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:02:03,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc968dd6b39fd1aeb3ca HTTP/1.1" 200 None 2025-09-27 21:02:03,703 - lava_callback - INFO - Completed processing callback for node 68d7dc968dd6b39fd1aeb3ca INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:03:49,285 - lava_callback - INFO - Received callback for node 68d804228dd6b39fd1aeb919 INFO: 172.21.0.1:51506 - "POST /node/68d804228dd6b39fd1aeb919 HTTP/1.0" 202 Accepted 2025-09-27 21:03:49,290 - lava_callback - INFO - Starting async job submit for node 68d804228dd6b39fd1aeb919 2025-09-27 21:03:49,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:03:49,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d804228dd6b39fd1aeb919 HTTP/1.1" 200 None 2025-09-27 21:03:49,328 - lava_callback - DEBUG - Processing node 68d804228dd6b39fd1aeb919: baseline-arm64-broonie 2025-09-27 21:03:49,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:03:49,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:03:49,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d804228dd6b39fd1aeb919/log.txt.gz 2025-09-27 21:03:49,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:03:49,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:03:49,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d804228dd6b39fd1aeb919/lava_callback.json.gz 2025-09-27 21:03:49,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:03:49,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d804228dd6b39fd1aeb919 HTTP/1.1" 200 None 2025-09-27 21:03:49,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:03:49,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 21:03:49,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:03:50,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d804228dd6b39fd1aeb919 HTTP/1.1" 200 None 2025-09-27 21:03:50,011 - lava_callback - INFO - Completed processing callback for node 68d804228dd6b39fd1aeb919 INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:05:07,398 - lava_callback - INFO - Received callback for node 68d7dc968dd6b39fd1aeb3cd INFO: 172.21.0.1:41302 - "POST /node/68d7dc968dd6b39fd1aeb3cd HTTP/1.0" 202 Accepted 2025-09-27 21:05:07,404 - lava_callback - INFO - Starting async job submit for node 68d7dc968dd6b39fd1aeb3cd 2025-09-27 21:05:07,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:05:07,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc968dd6b39fd1aeb3cd HTTP/1.1" 200 None 2025-09-27 21:05:07,438 - lava_callback - DEBUG - Processing node 68d7dc968dd6b39fd1aeb3cd: baseline-arm 2025-09-27 21:05:07,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:05:07,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:05:07,855 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc968dd6b39fd1aeb3cd/log.txt.gz 2025-09-27 21:05:07,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:05:07,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:05:07,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc968dd6b39fd1aeb3cd/lava_callback.json.gz 2025-09-27 21:05:08,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:05:08,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc968dd6b39fd1aeb3cd HTTP/1.1" 200 None 2025-09-27 21:05:08,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:05:08,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 21:05:08,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:05:08,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc968dd6b39fd1aeb3cd HTTP/1.1" 200 None 2025-09-27 21:05:08,101 - lava_callback - INFO - Completed processing callback for node 68d7dc968dd6b39fd1aeb3cd INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:06:49,775 - lava_callback - INFO - Received callback for node 68d804788dd6b39fd1aeb925 INFO: 172.21.0.1:33896 - "POST /node/68d804788dd6b39fd1aeb925 HTTP/1.0" 202 Accepted 2025-09-27 21:06:49,780 - lava_callback - INFO - Starting async job submit for node 68d804788dd6b39fd1aeb925 2025-09-27 21:06:49,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:06:49,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d804788dd6b39fd1aeb925 HTTP/1.1" 200 None 2025-09-27 21:06:49,810 - lava_callback - DEBUG - Processing node 68d804788dd6b39fd1aeb925: baseline-arm64-broonie 2025-09-27 21:06:50,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:06:50,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:06:50,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d804788dd6b39fd1aeb925/log.txt.gz 2025-09-27 21:06:50,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:06:50,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:06:50,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d804788dd6b39fd1aeb925/lava_callback.json.gz 2025-09-27 21:06:50,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:06:50,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d804788dd6b39fd1aeb925 HTTP/1.1" 200 None 2025-09-27 21:06:50,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:06:50,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 21:06:50,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:06:50,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d804788dd6b39fd1aeb925 HTTP/1.1" 200 None 2025-09-27 21:06:50,500 - lava_callback - INFO - Completed processing callback for node 68d804788dd6b39fd1aeb925 INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41850 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:07:23,127 - lava_callback - INFO - Received callback for node 68d7dc998dd6b39fd1aeb3d0 INFO: 172.21.0.1:58550 - "POST /node/68d7dc998dd6b39fd1aeb3d0 HTTP/1.0" 202 Accepted 2025-09-27 21:07:23,133 - lava_callback - INFO - Starting async job submit for node 68d7dc998dd6b39fd1aeb3d0 2025-09-27 21:07:23,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:07:23,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc998dd6b39fd1aeb3d0 HTTP/1.1" 200 None 2025-09-27 21:07:23,166 - lava_callback - DEBUG - Processing node 68d7dc998dd6b39fd1aeb3d0: baseline-arm 2025-09-27 21:07:23,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:07:23,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:07:23,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc998dd6b39fd1aeb3d0/log.txt.gz 2025-09-27 21:07:23,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:07:23,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:07:23,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc998dd6b39fd1aeb3d0/lava_callback.json.gz 2025-09-27 21:07:23,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:07:23,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc998dd6b39fd1aeb3d0 HTTP/1.1" 200 None 2025-09-27 21:07:23,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:07:23,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 21:07:23,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:07:23,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc998dd6b39fd1aeb3d0 HTTP/1.1" 200 None 2025-09-27 21:07:23,755 - lava_callback - INFO - Completed processing callback for node 68d7dc998dd6b39fd1aeb3d0 INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:09:30,343 - lava_callback - INFO - Received callback for node 68d7dc9a8dd6b39fd1aeb3d3 INFO: 172.21.0.1:49526 - "POST /node/68d7dc9a8dd6b39fd1aeb3d3 HTTP/1.0" 202 Accepted 2025-09-27 21:09:30,349 - lava_callback - INFO - Starting async job submit for node 68d7dc9a8dd6b39fd1aeb3d3 2025-09-27 21:09:30,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:09:30,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc9a8dd6b39fd1aeb3d3 HTTP/1.1" 200 None 2025-09-27 21:09:30,382 - lava_callback - DEBUG - Processing node 68d7dc9a8dd6b39fd1aeb3d3: baseline-arm 2025-09-27 21:09:30,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:09:30,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:09:30,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc9a8dd6b39fd1aeb3d3/log.txt.gz 2025-09-27 21:09:30,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:09:30,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:09:30,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dc9a8dd6b39fd1aeb3d3/lava_callback.json.gz 2025-09-27 21:09:30,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:09:30,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dc9a8dd6b39fd1aeb3d3 HTTP/1.1" 200 None 2025-09-27 21:09:30,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:09:30,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 21:09:30,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:09:31,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dc9a8dd6b39fd1aeb3d3 HTTP/1.1" 200 None 2025-09-27 21:09:31,013 - lava_callback - INFO - Completed processing callback for node 68d7dc9a8dd6b39fd1aeb3d3 INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:09:50,382 - lava_callback - INFO - Received callback for node 68d804d68dd6b39fd1aeb92c INFO: 172.21.0.1:42630 - "POST /node/68d804d68dd6b39fd1aeb92c HTTP/1.0" 202 Accepted 2025-09-27 21:09:50,388 - lava_callback - INFO - Starting async job submit for node 68d804d68dd6b39fd1aeb92c 2025-09-27 21:09:50,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:09:50,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d804d68dd6b39fd1aeb92c HTTP/1.1" 200 None 2025-09-27 21:09:50,419 - lava_callback - DEBUG - Processing node 68d804d68dd6b39fd1aeb92c: baseline-arm64-broonie 2025-09-27 21:09:50,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:09:50,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:09:50,874 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d804d68dd6b39fd1aeb92c/log.txt.gz 2025-09-27 21:09:50,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:09:51,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:09:51,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d804d68dd6b39fd1aeb92c/lava_callback.json.gz 2025-09-27 21:09:51,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:09:51,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d804d68dd6b39fd1aeb92c HTTP/1.1" 200 None 2025-09-27 21:09:51,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:09:51,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 21:09:51,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:09:51,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d804d68dd6b39fd1aeb92c HTTP/1.1" 200 None 2025-09-27 21:09:51,130 - lava_callback - INFO - Completed processing callback for node 68d804d68dd6b39fd1aeb92c INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:10:14,208 - lava_callback - INFO - Received callback for node 68d7a4528dd6b39fd1aea9d0 INFO: 172.21.0.1:53274 - "POST /node/68d7a4528dd6b39fd1aea9d0 HTTP/1.0" 202 Accepted 2025-09-27 21:10:14,215 - lava_callback - INFO - Starting async job submit for node 68d7a4528dd6b39fd1aea9d0 2025-09-27 21:10:14,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:10:14,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a4528dd6b39fd1aea9d0 HTTP/1.1" 200 None 2025-09-27 21:10:14,291 - lava_callback - DEBUG - Processing node 68d7a4528dd6b39fd1aea9d0: baseline-arm64 INFO: 172.21.0.1:53280 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 21:10:15,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:10:15,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:10:15,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a4528dd6b39fd1aea9d0/log.txt.gz 2025-09-27 21:10:15,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:10:15,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:10:15,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a4528dd6b39fd1aea9d0/lava_callback.json.gz DEBUG: Setup failed for 68d7a4528dd6b39fd1aea9d0. Transitting job node result: incomplete -> fail 2025-09-27 21:10:15,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:10:15,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a4528dd6b39fd1aea9d0 HTTP/1.1" 200 None 2025-09-27 21:10:15,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:10:15,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 21:10:15,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:10:15,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a4528dd6b39fd1aea9d0 HTTP/1.1" 200 None 2025-09-27 21:10:15,713 - lava_callback - INFO - Completed processing callback for node 68d7a4528dd6b39fd1aea9d0 INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46138 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:10:45,598 - lava_callback - INFO - Received callback for node 68d7a4538dd6b39fd1aea9d3 INFO: 172.21.0.1:54120 - "POST /node/68d7a4538dd6b39fd1aea9d3 HTTP/1.0" 202 Accepted 2025-09-27 21:10:45,605 - lava_callback - INFO - Starting async job submit for node 68d7a4538dd6b39fd1aea9d3 2025-09-27 21:10:45,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:10:45,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a4538dd6b39fd1aea9d3 HTTP/1.1" 200 None 2025-09-27 21:10:45,663 - lava_callback - DEBUG - Processing node 68d7a4538dd6b39fd1aea9d3: baseline-arm64 INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:10:46,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:10:46,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:10:46,690 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a4538dd6b39fd1aea9d3/log.txt.gz 2025-09-27 21:10:46,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:10:46,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:10:46,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a4538dd6b39fd1aea9d3/lava_callback.json.gz DEBUG: Setup failed for 68d7a4538dd6b39fd1aea9d3. Transitting job node result: incomplete -> fail 2025-09-27 21:10:46,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:10:47,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a4538dd6b39fd1aea9d3 HTTP/1.1" 200 None 2025-09-27 21:10:47,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:10:47,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 21:10:47,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:10:47,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a4538dd6b39fd1aea9d3 HTTP/1.1" 200 None 2025-09-27 21:10:47,042 - lava_callback - INFO - Completed processing callback for node 68d7a4538dd6b39fd1aea9d3 INFO: 172.21.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:11:14,973 - lava_callback - INFO - Received callback for node 68d7a4848dd6b39fd1aea9e4 INFO: 172.21.0.1:44770 - "POST /node/68d7a4848dd6b39fd1aea9e4 HTTP/1.0" 202 Accepted 2025-09-27 21:11:14,980 - lava_callback - INFO - Starting async job submit for node 68d7a4848dd6b39fd1aea9e4 2025-09-27 21:11:15,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:11:15,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a4848dd6b39fd1aea9e4 HTTP/1.1" 200 None 2025-09-27 21:11:15,051 - lava_callback - DEBUG - Processing node 68d7a4848dd6b39fd1aea9e4: baseline-arm64 INFO: 172.21.0.1:44774 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 21:11:15,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:11:16,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:11:16,197 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a4848dd6b39fd1aea9e4/log.txt.gz 2025-09-27 21:11:16,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:11:16,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:11:16,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a4848dd6b39fd1aea9e4/lava_callback.json.gz DEBUG: Setup failed for 68d7a4848dd6b39fd1aea9e4. Transitting job node result: incomplete -> fail 2025-09-27 21:11:16,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:11:16,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a4848dd6b39fd1aea9e4 HTTP/1.1" 200 None 2025-09-27 21:11:16,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:11:16,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 21:11:16,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:11:16,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a4848dd6b39fd1aea9e4 HTTP/1.1" 200 None 2025-09-27 21:11:16,560 - lava_callback - INFO - Completed processing callback for node 68d7a4848dd6b39fd1aea9e4 INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:11:43,978 - lava_callback - INFO - Received callback for node 68d7dd208dd6b39fd1aeb44a INFO: 172.21.0.1:32784 - "POST /node/68d7dd208dd6b39fd1aeb44a HTTP/1.0" 202 Accepted 2025-09-27 21:11:43,984 - lava_callback - INFO - Starting async job submit for node 68d7dd208dd6b39fd1aeb44a 2025-09-27 21:11:44,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:11:44,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dd208dd6b39fd1aeb44a HTTP/1.1" 200 None 2025-09-27 21:11:44,038 - lava_callback - DEBUG - Processing node 68d7dd208dd6b39fd1aeb44a: baseline-arm 2025-09-27 21:11:44,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:11:44,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:11:44,450 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dd208dd6b39fd1aeb44a/log.txt.gz 2025-09-27 21:11:44,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:11:44,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:11:44,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dd208dd6b39fd1aeb44a/lava_callback.json.gz 2025-09-27 21:11:44,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:11:44,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dd208dd6b39fd1aeb44a HTTP/1.1" 200 None 2025-09-27 21:11:44,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:11:44,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-27 21:11:44,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:11:44,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dd208dd6b39fd1aeb44a HTTP/1.1" 200 None 2025-09-27 21:11:44,675 - lava_callback - INFO - Completed processing callback for node 68d7dd208dd6b39fd1aeb44a INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:13:10,093 - lava_callback - INFO - Received callback for node 68d805a58dd6b39fd1aeb939 INFO: 172.21.0.1:52040 - "POST /node/68d805a58dd6b39fd1aeb939 HTTP/1.0" 202 Accepted 2025-09-27 21:13:10,099 - lava_callback - INFO - Starting async job submit for node 68d805a58dd6b39fd1aeb939 2025-09-27 21:13:10,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:13:10,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d805a58dd6b39fd1aeb939 HTTP/1.1" 200 None 2025-09-27 21:13:10,129 - lava_callback - DEBUG - Processing node 68d805a58dd6b39fd1aeb939: baseline-arm64-broonie 2025-09-27 21:13:10,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:13:10,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:13:10,615 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d805a58dd6b39fd1aeb939/log.txt.gz 2025-09-27 21:13:10,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:13:10,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:13:10,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d805a58dd6b39fd1aeb939/lava_callback.json.gz 2025-09-27 21:13:10,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:13:10,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d805a58dd6b39fd1aeb939 HTTP/1.1" 200 None 2025-09-27 21:13:10,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:13:10,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-27 21:13:10,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:13:10,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d805a58dd6b39fd1aeb939 HTTP/1.1" 200 None 2025-09-27 21:13:10,850 - lava_callback - INFO - Completed processing callback for node 68d805a58dd6b39fd1aeb939 INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:14:03,303 - lava_callback - INFO - Received callback for node 68d7dd218dd6b39fd1aeb44d INFO: 172.21.0.1:37202 - "POST /node/68d7dd218dd6b39fd1aeb44d HTTP/1.0" 202 Accepted 2025-09-27 21:14:03,309 - lava_callback - INFO - Starting async job submit for node 68d7dd218dd6b39fd1aeb44d 2025-09-27 21:14:03,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:14:03,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dd218dd6b39fd1aeb44d HTTP/1.1" 200 None 2025-09-27 21:14:03,363 - lava_callback - DEBUG - Processing node 68d7dd218dd6b39fd1aeb44d: baseline-arm 2025-09-27 21:14:03,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:14:03,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:14:03,731 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dd218dd6b39fd1aeb44d/log.txt.gz 2025-09-27 21:14:03,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:14:03,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:14:03,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7dd218dd6b39fd1aeb44d/lava_callback.json.gz 2025-09-27 21:14:03,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:14:03,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dd218dd6b39fd1aeb44d HTTP/1.1" 200 None 2025-09-27 21:14:03,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:14:03,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-27 21:14:03,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:14:03,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dd218dd6b39fd1aeb44d HTTP/1.1" 200 None 2025-09-27 21:14:03,982 - lava_callback - INFO - Completed processing callback for node 68d7dd218dd6b39fd1aeb44d INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:16:41,046 - lava_callback - INFO - Received callback for node 68d811ee1fd44e101337f13a INFO: 172.21.0.1:42040 - "POST /node/68d811ee1fd44e101337f13a HTTP/1.0" 202 Accepted 2025-09-27 21:16:41,052 - lava_callback - INFO - Starting async job submit for node 68d811ee1fd44e101337f13a 2025-09-27 21:16:41,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:16:41,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ee1fd44e101337f13a HTTP/1.1" 200 None 2025-09-27 21:16:41,083 - lava_callback - DEBUG - Processing node 68d811ee1fd44e101337f13a: baseline-arm64-broonie 2025-09-27 21:16:41,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:16:41,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:16:41,538 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811ee1fd44e101337f13a/log.txt.gz 2025-09-27 21:16:41,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:16:41,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:16:41,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d811ee1fd44e101337f13a/lava_callback.json.gz 2025-09-27 21:16:41,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:16:41,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d811ee1fd44e101337f13a HTTP/1.1" 200 None 2025-09-27 21:16:41,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:16:41,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5e8dd6b39fd1aeb97b HTTP/1.1" 200 None 2025-09-27 21:16:41,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:16:41,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d811ee1fd44e101337f13a HTTP/1.1" 200 None 2025-09-27 21:16:41,776 - lava_callback - INFO - Completed processing callback for node 68d811ee1fd44e101337f13a INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:16:53,959 - lava_callback - INFO - Received callback for node 68d7f62b8dd6b39fd1aeb6a1 INFO: 172.21.0.1:57064 - "POST /node/68d7f62b8dd6b39fd1aeb6a1 HTTP/1.0" 202 Accepted 2025-09-27 21:16:53,966 - lava_callback - INFO - Starting async job submit for node 68d7f62b8dd6b39fd1aeb6a1 2025-09-27 21:16:53,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:16:53,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f62b8dd6b39fd1aeb6a1 HTTP/1.1" 200 None 2025-09-27 21:16:53,999 - lava_callback - DEBUG - Processing node 68d7f62b8dd6b39fd1aeb6a1: baseline-arm64-broonie 2025-09-27 21:16:54,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:16:54,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:16:54,326 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7f62b8dd6b39fd1aeb6a1/log.txt.gz 2025-09-27 21:16:54,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:16:54,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:16:54,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d7f62b8dd6b39fd1aeb6a1/lava_callback.json.gz 2025-09-27 21:16:54,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:16:54,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f62b8dd6b39fd1aeb6a1 HTTP/1.1" 200 None 2025-09-27 21:16:54,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:16:54,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79ae2a6a7b6615d4c53f2 HTTP/1.1" 200 None 2025-09-27 21:16:54,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:16:54,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f62b8dd6b39fd1aeb6a1 HTTP/1.1" 200 None 2025-09-27 21:16:54,542 - lava_callback - INFO - Completed processing callback for node 68d7f62b8dd6b39fd1aeb6a1 INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:21:03,484 - lava_callback - INFO - Received callback for node 68d7f1958dd6b39fd1aeb603 INFO: 172.21.0.1:44220 - "POST /node/68d7f1958dd6b39fd1aeb603 HTTP/1.0" 202 Accepted 2025-09-27 21:21:03,490 - lava_callback - INFO - Starting async job submit for node 68d7f1958dd6b39fd1aeb603 2025-09-27 21:21:03,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:21:03,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f1958dd6b39fd1aeb603 HTTP/1.1" 200 None 2025-09-27 21:21:03,533 - lava_callback - DEBUG - Processing node 68d7f1958dd6b39fd1aeb603: baseline-arm 2025-09-27 21:21:03,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:21:03,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:21:03,928 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f1958dd6b39fd1aeb603/log.txt.gz 2025-09-27 21:21:03,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:21:04,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:21:04,072 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f1958dd6b39fd1aeb603/lava_callback.json.gz 2025-09-27 21:21:04,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:21:04,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f1958dd6b39fd1aeb603 HTTP/1.1" 200 None 2025-09-27 21:21:04,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:21:04,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 21:21:04,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:21:04,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f1958dd6b39fd1aeb603 HTTP/1.1" 200 None 2025-09-27 21:21:04,154 - lava_callback - INFO - Completed processing callback for node 68d7f1958dd6b39fd1aeb603 INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:23:23,958 - lava_callback - INFO - Received callback for node 68d7f1958dd6b39fd1aeb606 INFO: 172.21.0.1:60614 - "POST /node/68d7f1958dd6b39fd1aeb606 HTTP/1.0" 202 Accepted 2025-09-27 21:23:23,965 - lava_callback - INFO - Starting async job submit for node 68d7f1958dd6b39fd1aeb606 2025-09-27 21:23:23,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:23:23,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f1958dd6b39fd1aeb606 HTTP/1.1" 200 None 2025-09-27 21:23:23,999 - lava_callback - DEBUG - Processing node 68d7f1958dd6b39fd1aeb606: baseline-arm 2025-09-27 21:23:24,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:23:24,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:23:24,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f1958dd6b39fd1aeb606/log.txt.gz 2025-09-27 21:23:24,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:23:24,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:23:24,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f1958dd6b39fd1aeb606/lava_callback.json.gz 2025-09-27 21:23:24,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:23:24,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f1958dd6b39fd1aeb606 HTTP/1.1" 200 None 2025-09-27 21:23:24,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:23:24,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 21:23:24,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:23:24,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f1958dd6b39fd1aeb606 HTTP/1.1" 200 None 2025-09-27 21:23:24,635 - lava_callback - INFO - Completed processing callback for node 68d7f1958dd6b39fd1aeb606 INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:25:43,896 - lava_callback - INFO - Received callback for node 68d7f47f8dd6b39fd1aeb669 INFO: 172.21.0.1:53494 - "POST /node/68d7f47f8dd6b39fd1aeb669 HTTP/1.0" 202 Accepted 2025-09-27 21:25:43,902 - lava_callback - INFO - Starting async job submit for node 68d7f47f8dd6b39fd1aeb669 2025-09-27 21:25:43,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:25:43,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f47f8dd6b39fd1aeb669 HTTP/1.1" 200 None 2025-09-27 21:25:43,956 - lava_callback - DEBUG - Processing node 68d7f47f8dd6b39fd1aeb669: baseline-arm 2025-09-27 21:25:44,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:25:44,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:25:44,339 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f47f8dd6b39fd1aeb669/log.txt.gz 2025-09-27 21:25:44,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:25:44,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:25:44,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f47f8dd6b39fd1aeb669/lava_callback.json.gz 2025-09-27 21:25:44,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:25:44,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f47f8dd6b39fd1aeb669 HTTP/1.1" 200 None 2025-09-27 21:25:44,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:25:44,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-27 21:25:44,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:25:44,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f47f8dd6b39fd1aeb669 HTTP/1.1" 200 None 2025-09-27 21:25:44,564 - lava_callback - INFO - Completed processing callback for node 68d7f47f8dd6b39fd1aeb669 INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:28:03,769 - lava_callback - INFO - Received callback for node 68d7f4808dd6b39fd1aeb66c INFO: 172.21.0.1:59306 - "POST /node/68d7f4808dd6b39fd1aeb66c HTTP/1.0" 202 Accepted 2025-09-27 21:28:03,775 - lava_callback - INFO - Starting async job submit for node 68d7f4808dd6b39fd1aeb66c 2025-09-27 21:28:03,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:28:03,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f4808dd6b39fd1aeb66c HTTP/1.1" 200 None 2025-09-27 21:28:03,809 - lava_callback - DEBUG - Processing node 68d7f4808dd6b39fd1aeb66c: baseline-arm 2025-09-27 21:28:04,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:28:04,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:28:04,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f4808dd6b39fd1aeb66c/log.txt.gz 2025-09-27 21:28:04,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:28:04,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:28:04,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f4808dd6b39fd1aeb66c/lava_callback.json.gz 2025-09-27 21:28:04,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:28:04,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f4808dd6b39fd1aeb66c HTTP/1.1" 200 None 2025-09-27 21:28:04,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:28:04,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-27 21:28:04,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:28:04,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f4808dd6b39fd1aeb66c HTTP/1.1" 200 None 2025-09-27 21:28:04,445 - lava_callback - INFO - Completed processing callback for node 68d7f4808dd6b39fd1aeb66c INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:30:17,167 - lava_callback - INFO - Received callback for node 68d826f41fd44e101337f91f INFO: 172.21.0.1:51574 - "POST /node/68d826f41fd44e101337f91f HTTP/1.0" 202 Accepted 2025-09-27 21:30:17,172 - lava_callback - INFO - Starting async job submit for node 68d826f41fd44e101337f91f 2025-09-27 21:30:17,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:30:17,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f41fd44e101337f91f HTTP/1.1" 200 None 2025-09-27 21:30:17,204 - lava_callback - DEBUG - Processing node 68d826f41fd44e101337f91f: baseline-arm64-broonie 2025-09-27 21:30:17,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:30:17,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:30:17,664 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f41fd44e101337f91f/log.txt.gz 2025-09-27 21:30:17,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:30:17,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:30:17,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d826f41fd44e101337f91f/lava_callback.json.gz 2025-09-27 21:30:17,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:30:17,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d826f41fd44e101337f91f HTTP/1.1" 200 None 2025-09-27 21:30:17,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:30:17,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f531fd44e101337efb0 HTTP/1.1" 200 None 2025-09-27 21:30:17,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:30:17,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d826f41fd44e101337f91f HTTP/1.1" 200 None 2025-09-27 21:30:17,898 - lava_callback - INFO - Completed processing callback for node 68d826f41fd44e101337f91f INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:30:55,533 - lava_callback - INFO - Received callback for node 68d7a4858dd6b39fd1aea9eb INFO: 172.21.0.1:44640 - "POST /node/68d7a4858dd6b39fd1aea9eb HTTP/1.0" 202 Accepted 2025-09-27 21:30:55,541 - lava_callback - INFO - Starting async job submit for node 68d7a4858dd6b39fd1aea9eb 2025-09-27 21:30:55,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:30:55,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a4858dd6b39fd1aea9eb HTTP/1.1" 200 None 2025-09-27 21:30:55,594 - lava_callback - DEBUG - Processing node 68d7a4858dd6b39fd1aea9eb: baseline-arm64 2025-09-27 21:30:56,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:30:56,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:30:56,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a4858dd6b39fd1aea9eb/log.txt.gz 2025-09-27 21:30:56,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:30:56,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:30:56,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a4858dd6b39fd1aea9eb/lava_callback.json.gz DEBUG: Setup failed for 68d7a4858dd6b39fd1aea9eb. Transitting job node result: incomplete -> fail 2025-09-27 21:30:56,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:30:56,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a4858dd6b39fd1aea9eb HTTP/1.1" 200 None 2025-09-27 21:30:56,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:30:56,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 21:30:56,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:30:56,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a4858dd6b39fd1aea9eb HTTP/1.1" 200 None 2025-09-27 21:30:56,938 - lava_callback - INFO - Completed processing callback for node 68d7a4858dd6b39fd1aea9eb INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:31:05,743 - lava_callback - INFO - Received callback for node 68d7a48e8dd6b39fd1aea9f3 INFO: 172.21.0.1:57082 - "POST /node/68d7a48e8dd6b39fd1aea9f3 HTTP/1.0" 202 Accepted 2025-09-27 21:31:05,750 - lava_callback - INFO - Starting async job submit for node 68d7a48e8dd6b39fd1aea9f3 2025-09-27 21:31:05,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:05,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a48e8dd6b39fd1aea9f3 HTTP/1.1" 200 None 2025-09-27 21:31:05,804 - lava_callback - DEBUG - Processing node 68d7a48e8dd6b39fd1aea9f3: baseline-arm64 2025-09-27 21:31:06,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:31:06,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:31:06,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a48e8dd6b39fd1aea9f3/log.txt.gz 2025-09-27 21:31:06,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:31:06,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:31:06,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a48e8dd6b39fd1aea9f3/lava_callback.json.gz DEBUG: Setup failed for 68d7a48e8dd6b39fd1aea9f3. Transitting job node result: incomplete -> fail 2025-09-27 21:31:07,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:07,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a48e8dd6b39fd1aea9f3 HTTP/1.1" 200 None 2025-09-27 21:31:07,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:07,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 21:31:07,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:07,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a48e8dd6b39fd1aea9f3 HTTP/1.1" 200 None 2025-09-27 21:31:07,139 - lava_callback - INFO - Completed processing callback for node 68d7a48e8dd6b39fd1aea9f3 INFO: 172.21.0.1:33806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:31:23,249 - lava_callback - INFO - Received callback for node 68d7f4818dd6b39fd1aeb66f INFO: 172.21.0.1:42594 - "POST /node/68d7f4818dd6b39fd1aeb66f HTTP/1.0" 202 Accepted 2025-09-27 21:31:23,255 - lava_callback - INFO - Starting async job submit for node 68d7f4818dd6b39fd1aeb66f 2025-09-27 21:31:23,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:23,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f4818dd6b39fd1aeb66f HTTP/1.1" 200 None 2025-09-27 21:31:23,290 - lava_callback - DEBUG - Processing node 68d7f4818dd6b39fd1aeb66f: baseline-arm 2025-09-27 21:31:23,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:31:23,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:31:23,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f4818dd6b39fd1aeb66f/log.txt.gz 2025-09-27 21:31:23,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:31:23,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:31:23,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f4818dd6b39fd1aeb66f/lava_callback.json.gz 2025-09-27 21:31:23,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:23,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f4818dd6b39fd1aeb66f HTTP/1.1" 200 None 2025-09-27 21:31:23,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:23,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-27 21:31:23,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:23,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f4818dd6b39fd1aeb66f HTTP/1.1" 200 None 2025-09-27 21:31:23,909 - lava_callback - INFO - Completed processing callback for node 68d7f4818dd6b39fd1aeb66f INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:31:54,395 - lava_callback - INFO - Received callback for node 68d7a48f8dd6b39fd1aea9f6 INFO: 172.21.0.1:57024 - "POST /node/68d7a48f8dd6b39fd1aea9f6 HTTP/1.0" 202 Accepted 2025-09-27 21:31:54,402 - lava_callback - INFO - Starting async job submit for node 68d7a48f8dd6b39fd1aea9f6 2025-09-27 21:31:54,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:54,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a48f8dd6b39fd1aea9f6 HTTP/1.1" 200 None 2025-09-27 21:31:54,455 - lava_callback - DEBUG - Processing node 68d7a48f8dd6b39fd1aea9f6: baseline-arm64 2025-09-27 21:31:55,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:31:55,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:31:55,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a48f8dd6b39fd1aea9f6/log.txt.gz 2025-09-27 21:31:55,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:31:55,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:31:55,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a48f8dd6b39fd1aea9f6/lava_callback.json.gz DEBUG: Setup failed for 68d7a48f8dd6b39fd1aea9f6. Transitting job node result: incomplete -> fail 2025-09-27 21:31:55,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:55,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a48f8dd6b39fd1aea9f6 HTTP/1.1" 200 None 2025-09-27 21:31:55,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:55,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 21:31:55,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:55,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a48f8dd6b39fd1aea9f6 HTTP/1.1" 200 None 2025-09-27 21:31:55,787 - lava_callback - INFO - Completed processing callback for node 68d7a48f8dd6b39fd1aea9f6 2025-09-27 21:31:56,072 - lava_callback - INFO - Received callback for node 68d5c2cd2be2da466069a645 INFO: 172.21.0.1:57026 - "POST /node/68d5c2cd2be2da466069a645 HTTP/1.0" 202 Accepted 2025-09-27 21:31:56,078 - lava_callback - INFO - Starting async job submit for node 68d5c2cd2be2da466069a645 2025-09-27 21:31:56,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:31:56,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2cd2be2da466069a645 HTTP/1.1" 200 None 2025-09-27 21:31:56,113 - lava_callback - DEBUG - Processing node 68d5c2cd2be2da466069a645: baseline-arm-broonie 2025-09-27 21:31:56,330 - lava_callback - ERROR - Error processing callback for node 68d5c2cd2be2da466069a645: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:33:34,799 - lava_callback - INFO - Received callback for node 68d82a601fd44e101337fad1 INFO: 172.21.0.1:55414 - "POST /node/68d82a601fd44e101337fad1 HTTP/1.0" 202 Accepted 2025-09-27 21:33:34,805 - lava_callback - INFO - Starting async job submit for node 68d82a601fd44e101337fad1 2025-09-27 21:33:34,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:33:34,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82a601fd44e101337fad1 HTTP/1.1" 200 None 2025-09-27 21:33:34,835 - lava_callback - DEBUG - Processing node 68d82a601fd44e101337fad1: baseline-arm64-broonie 2025-09-27 21:33:35,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:33:35,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:33:35,296 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d82a601fd44e101337fad1/log.txt.gz 2025-09-27 21:33:35,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:33:35,420 - lava_callback - INFO - Received callback for node 68d7f4828dd6b39fd1aeb672 INFO: 172.21.0.1:55424 - "POST /node/68d7f4828dd6b39fd1aeb672 HTTP/1.0" 202 Accepted 2025-09-27 21:33:35,427 - lava_callback - INFO - Starting async job submit for node 68d7f4828dd6b39fd1aeb672 2025-09-27 21:33:35,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:33:35,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:33:35,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d82a601fd44e101337fad1/lava_callback.json.gz 2025-09-27 21:33:35,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:33:35,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f4828dd6b39fd1aeb672 HTTP/1.1" 200 None 2025-09-27 21:33:35,493 - lava_callback - DEBUG - Processing node 68d7f4828dd6b39fd1aeb672: baseline-arm 2025-09-27 21:33:35,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82a601fd44e101337fad1 HTTP/1.1" 200 None 2025-09-27 21:33:35,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:33:35,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-27 21:33:35,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:33:35,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82a601fd44e101337fad1 HTTP/1.1" 200 None 2025-09-27 21:33:35,721 - lava_callback - INFO - Completed processing callback for node 68d82a601fd44e101337fad1 2025-09-27 21:33:35,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:33:35,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:33:35,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f4828dd6b39fd1aeb672/log.txt.gz 2025-09-27 21:33:35,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:33:36,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:33:36,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f4828dd6b39fd1aeb672/lava_callback.json.gz 2025-09-27 21:33:36,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:33:36,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f4828dd6b39fd1aeb672 HTTP/1.1" 200 None 2025-09-27 21:33:36,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:33:36,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-27 21:33:36,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:33:36,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f4828dd6b39fd1aeb672 HTTP/1.1" 200 None 2025-09-27 21:33:36,154 - lava_callback - INFO - Completed processing callback for node 68d7f4828dd6b39fd1aeb672 INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:36:03,040 - lava_callback - INFO - Received callback for node 68d7f6638dd6b39fd1aeb6b0 INFO: 172.21.0.1:33358 - "POST /node/68d7f6638dd6b39fd1aeb6b0 HTTP/1.0" 202 Accepted 2025-09-27 21:36:03,046 - lava_callback - INFO - Starting async job submit for node 68d7f6638dd6b39fd1aeb6b0 2025-09-27 21:36:03,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:03,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f6638dd6b39fd1aeb6b0 HTTP/1.1" 200 None 2025-09-27 21:36:03,100 - lava_callback - DEBUG - Processing node 68d7f6638dd6b39fd1aeb6b0: baseline-arm 2025-09-27 21:36:03,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:36:03,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:36:03,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f6638dd6b39fd1aeb6b0/log.txt.gz 2025-09-27 21:36:03,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:36:03,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:36:03,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f6638dd6b39fd1aeb6b0/lava_callback.json.gz 2025-09-27 21:36:03,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:03,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f6638dd6b39fd1aeb6b0 HTTP/1.1" 200 None 2025-09-27 21:36:03,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:03,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 21:36:03,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:03,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f6638dd6b39fd1aeb6b0 HTTP/1.1" 200 None 2025-09-27 21:36:03,764 - lava_callback - INFO - Completed processing callback for node 68d7f6638dd6b39fd1aeb6b0 INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60130 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:36:16,592 - lava_callback - INFO - Received callback for node 68d5c2de2be2da466069a660 INFO: 172.21.0.1:60134 - "POST /node/68d5c2de2be2da466069a660 HTTP/1.0" 202 Accepted 2025-09-27 21:36:16,599 - lava_callback - INFO - Starting async job submit for node 68d5c2de2be2da466069a660 2025-09-27 21:36:16,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:16,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2de2be2da466069a660 HTTP/1.1" 200 None 2025-09-27 21:36:16,637 - lava_callback - DEBUG - Processing node 68d5c2de2be2da466069a660: ltp-cap-bounds 2025-09-27 21:36:16,983 - lava_callback - ERROR - Error processing callback for node 68d5c2de2be2da466069a660: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:36:51,361 - lava_callback - INFO - Received callback for node 68d8307c1fd44e101337fc4e INFO: 172.21.0.1:54150 - "POST /node/68d8307c1fd44e101337fc4e HTTP/1.0" 202 Accepted 2025-09-27 21:36:51,367 - lava_callback - INFO - Starting async job submit for node 68d8307c1fd44e101337fc4e 2025-09-27 21:36:51,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:51,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8307c1fd44e101337fc4e HTTP/1.1" 200 None 2025-09-27 21:36:51,397 - lava_callback - DEBUG - Processing node 68d8307c1fd44e101337fc4e: baseline-arm64-broonie 2025-09-27 21:36:51,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:36:51,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:36:51,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8307c1fd44e101337fc4e/log.txt.gz 2025-09-27 21:36:51,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:36:51,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:36:51,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8307c1fd44e101337fc4e/lava_callback.json.gz 2025-09-27 21:36:52,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:52,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8307c1fd44e101337fc4e HTTP/1.1" 200 None 2025-09-27 21:36:52,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:52,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 21:36:52,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:36:52,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8307c1fd44e101337fc4e HTTP/1.1" 200 None 2025-09-27 21:36:52,104 - lava_callback - INFO - Completed processing callback for node 68d8307c1fd44e101337fc4e INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:38:25,102 - lava_callback - INFO - Received callback for node 68d7f6648dd6b39fd1aeb6b3 INFO: 172.21.0.1:42374 - "POST /node/68d7f6648dd6b39fd1aeb6b3 HTTP/1.0" 202 Accepted 2025-09-27 21:38:25,108 - lava_callback - INFO - Starting async job submit for node 68d7f6648dd6b39fd1aeb6b3 2025-09-27 21:38:25,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:38:25,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f6648dd6b39fd1aeb6b3 HTTP/1.1" 200 None 2025-09-27 21:38:25,141 - lava_callback - DEBUG - Processing node 68d7f6648dd6b39fd1aeb6b3: baseline-arm 2025-09-27 21:38:25,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:38:25,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:38:25,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f6648dd6b39fd1aeb6b3/log.txt.gz 2025-09-27 21:38:25,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:38:25,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:38:25,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f6648dd6b39fd1aeb6b3/lava_callback.json.gz 2025-09-27 21:38:25,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:38:25,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f6648dd6b39fd1aeb6b3 HTTP/1.1" 200 None 2025-09-27 21:38:25,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:38:25,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 21:38:25,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:38:25,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f6648dd6b39fd1aeb6b3 HTTP/1.1" 200 None 2025-09-27 21:38:25,762 - lava_callback - INFO - Completed processing callback for node 68d7f6648dd6b39fd1aeb6b3 INFO: 172.21.0.1:42382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:39:30,450 - lava_callback - INFO - Received callback for node 68d8348f1fd44e101337fd90 INFO: 172.21.0.1:52834 - "POST /node/68d8348f1fd44e101337fd90 HTTP/1.0" 202 Accepted 2025-09-27 21:39:30,456 - lava_callback - INFO - Starting async job submit for node 68d8348f1fd44e101337fd90 2025-09-27 21:39:30,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:39:30,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8348f1fd44e101337fd90 HTTP/1.1" 200 None 2025-09-27 21:39:30,500 - lava_callback - DEBUG - Processing node 68d8348f1fd44e101337fd90: baseline-arm64-broonie 2025-09-27 21:39:30,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:39:30,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:39:30,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8348f1fd44e101337fd90/log.txt.gz 2025-09-27 21:39:30,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:39:31,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:39:31,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8348f1fd44e101337fd90/lava_callback.json.gz 2025-09-27 21:39:31,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:39:31,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8348f1fd44e101337fd90 HTTP/1.1" 200 None 2025-09-27 21:39:31,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:39:31,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 21:39:31,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:39:31,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8348f1fd44e101337fd90 HTTP/1.1" 200 None 2025-09-27 21:39:31,275 - lava_callback - INFO - Completed processing callback for node 68d8348f1fd44e101337fd90 INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:40:31,545 - lava_callback - INFO - Received callback for node 68d5c2df2be2da466069a663 INFO: 172.21.0.1:47952 - "POST /node/68d5c2df2be2da466069a663 HTTP/1.0" 202 Accepted 2025-09-27 21:40:31,553 - lava_callback - INFO - Starting async job submit for node 68d5c2df2be2da466069a663 2025-09-27 21:40:31,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:40:31,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2df2be2da466069a663 HTTP/1.1" 200 None 2025-09-27 21:40:31,697 - lava_callback - DEBUG - Processing node 68d5c2df2be2da466069a663: ltp-containers 2025-09-27 21:40:32,500 - lava_callback - ERROR - Error processing callback for node 68d5c2df2be2da466069a663: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:40:44,447 - lava_callback - INFO - Received callback for node 68d7f6678dd6b39fd1aeb6bc INFO: 172.21.0.1:39536 - "POST /node/68d7f6678dd6b39fd1aeb6bc HTTP/1.0" 202 Accepted 2025-09-27 21:40:44,453 - lava_callback - INFO - Starting async job submit for node 68d7f6678dd6b39fd1aeb6bc 2025-09-27 21:40:44,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:40:44,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f6678dd6b39fd1aeb6bc HTTP/1.1" 200 None 2025-09-27 21:40:44,487 - lava_callback - DEBUG - Processing node 68d7f6678dd6b39fd1aeb6bc: baseline-arm 2025-09-27 21:40:44,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:40:44,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:40:44,903 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f6678dd6b39fd1aeb6bc/log.txt.gz 2025-09-27 21:40:44,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:40:45,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:40:45,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f6678dd6b39fd1aeb6bc/lava_callback.json.gz 2025-09-27 21:40:45,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:40:45,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f6678dd6b39fd1aeb6bc HTTP/1.1" 200 None 2025-09-27 21:40:45,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:40:45,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 21:40:45,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:40:45,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f6678dd6b39fd1aeb6bc HTTP/1.1" 200 None 2025-09-27 21:40:45,144 - lava_callback - INFO - Completed processing callback for node 68d7f6678dd6b39fd1aeb6bc INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:42:32,726 - lava_callback - INFO - Received callback for node 68d834de1fd44e101337fdea INFO: 172.21.0.1:48838 - "POST /node/68d834de1fd44e101337fdea HTTP/1.0" 202 Accepted 2025-09-27 21:42:32,733 - lava_callback - INFO - Starting async job submit for node 68d834de1fd44e101337fdea 2025-09-27 21:42:32,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:42:32,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d834de1fd44e101337fdea HTTP/1.1" 200 None 2025-09-27 21:42:32,776 - lava_callback - DEBUG - Processing node 68d834de1fd44e101337fdea: baseline-arm64-broonie 2025-09-27 21:42:33,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:42:33,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:42:33,226 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d834de1fd44e101337fdea/log.txt.gz 2025-09-27 21:42:33,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:42:33,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:42:33,490 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d834de1fd44e101337fdea/lava_callback.json.gz 2025-09-27 21:42:33,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:42:33,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d834de1fd44e101337fdea HTTP/1.1" 200 None 2025-09-27 21:42:33,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:42:33,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 21:42:33,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:42:33,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d834de1fd44e101337fdea HTTP/1.1" 200 None 2025-09-27 21:42:33,594 - lava_callback - INFO - Completed processing callback for node 68d834de1fd44e101337fdea INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:43:04,313 - lava_callback - INFO - Received callback for node 68d7f6688dd6b39fd1aeb6bf INFO: 172.21.0.1:59462 - "POST /node/68d7f6688dd6b39fd1aeb6bf HTTP/1.0" 202 Accepted 2025-09-27 21:43:04,319 - lava_callback - INFO - Starting async job submit for node 68d7f6688dd6b39fd1aeb6bf 2025-09-27 21:43:04,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:43:04,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f6688dd6b39fd1aeb6bf HTTP/1.1" 200 None 2025-09-27 21:43:04,352 - lava_callback - DEBUG - Processing node 68d7f6688dd6b39fd1aeb6bf: baseline-arm 2025-09-27 21:43:04,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:43:04,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:43:04,732 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f6688dd6b39fd1aeb6bf/log.txt.gz 2025-09-27 21:43:04,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:43:04,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:43:04,860 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f6688dd6b39fd1aeb6bf/lava_callback.json.gz 2025-09-27 21:43:04,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:43:04,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f6688dd6b39fd1aeb6bf HTTP/1.1" 200 None 2025-09-27 21:43:04,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:43:04,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 21:43:04,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:43:04,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f6688dd6b39fd1aeb6bf HTTP/1.1" 200 None 2025-09-27 21:43:04,937 - lava_callback - INFO - Completed processing callback for node 68d7f6688dd6b39fd1aeb6bf INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:45:20,889 - lava_callback - INFO - Received callback for node 68d7f7ca8dd6b39fd1aeb720 INFO: 172.21.0.1:37928 - "POST /node/68d7f7ca8dd6b39fd1aeb720 HTTP/1.0" 202 Accepted 2025-09-27 21:45:20,895 - lava_callback - INFO - Starting async job submit for node 68d7f7ca8dd6b39fd1aeb720 2025-09-27 21:45:20,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:45:20,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f7ca8dd6b39fd1aeb720 HTTP/1.1" 200 None 2025-09-27 21:45:20,928 - lava_callback - DEBUG - Processing node 68d7f7ca8dd6b39fd1aeb720: baseline-arm 2025-09-27 21:45:21,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:45:21,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:45:21,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f7ca8dd6b39fd1aeb720/log.txt.gz 2025-09-27 21:45:21,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:45:21,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:45:21,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f7ca8dd6b39fd1aeb720/lava_callback.json.gz 2025-09-27 21:45:21,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:45:21,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f7ca8dd6b39fd1aeb720 HTTP/1.1" 200 None 2025-09-27 21:45:21,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:45:21,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-27 21:45:21,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:45:21,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f7ca8dd6b39fd1aeb720 HTTP/1.1" 200 None 2025-09-27 21:45:21,602 - lava_callback - INFO - Completed processing callback for node 68d7f7ca8dd6b39fd1aeb720 INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:47:43,655 - lava_callback - INFO - Received callback for node 68d7f7ca8dd6b39fd1aeb723 INFO: 172.21.0.1:55348 - "POST /node/68d7f7ca8dd6b39fd1aeb723 HTTP/1.0" 202 Accepted 2025-09-27 21:47:43,660 - lava_callback - INFO - Starting async job submit for node 68d7f7ca8dd6b39fd1aeb723 2025-09-27 21:47:43,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:47:43,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f7ca8dd6b39fd1aeb723 HTTP/1.1" 200 None 2025-09-27 21:47:43,694 - lava_callback - DEBUG - Processing node 68d7f7ca8dd6b39fd1aeb723: baseline-arm 2025-09-27 21:47:43,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:47:44,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:47:44,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f7ca8dd6b39fd1aeb723/log.txt.gz 2025-09-27 21:47:44,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:47:44,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:47:44,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f7ca8dd6b39fd1aeb723/lava_callback.json.gz 2025-09-27 21:47:44,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:47:44,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f7ca8dd6b39fd1aeb723 HTTP/1.1" 200 None 2025-09-27 21:47:44,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:47:44,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-27 21:47:44,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:47:44,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f7ca8dd6b39fd1aeb723 HTTP/1.1" 200 None 2025-09-27 21:47:44,404 - lava_callback - INFO - Completed processing callback for node 68d7f7ca8dd6b39fd1aeb723 INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:48:28,308 - lava_callback - INFO - Received callback for node 68d5c2ea2be2da466069a66f INFO: 172.21.0.1:32828 - "POST /node/68d5c2ea2be2da466069a66f HTTP/1.0" 202 Accepted 2025-09-27 21:48:28,315 - lava_callback - INFO - Starting async job submit for node 68d5c2ea2be2da466069a66f 2025-09-27 21:48:28,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:48:28,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2ea2be2da466069a66f HTTP/1.1" 200 None 2025-09-27 21:48:28,438 - lava_callback - DEBUG - Processing node 68d5c2ea2be2da466069a66f: ltp-fs-bind 2025-09-27 21:48:28,972 - lava_callback - ERROR - Error processing callback for node 68d5c2ea2be2da466069a66f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:50:07,941 - lava_callback - INFO - Received callback for node 68d7f7ce8dd6b39fd1aeb72c INFO: 172.21.0.1:44778 - "POST /node/68d7f7ce8dd6b39fd1aeb72c HTTP/1.0" 202 Accepted 2025-09-27 21:50:07,947 - lava_callback - INFO - Starting async job submit for node 68d7f7ce8dd6b39fd1aeb72c 2025-09-27 21:50:07,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:50:08,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f7ce8dd6b39fd1aeb72c HTTP/1.1" 200 None 2025-09-27 21:50:08,001 - lava_callback - DEBUG - Processing node 68d7f7ce8dd6b39fd1aeb72c: baseline-arm 2025-09-27 21:50:08,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:50:08,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:50:08,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f7ce8dd6b39fd1aeb72c/log.txt.gz 2025-09-27 21:50:08,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:50:08,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:50:08,783 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f7ce8dd6b39fd1aeb72c/lava_callback.json.gz 2025-09-27 21:50:08,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:50:08,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f7ce8dd6b39fd1aeb72c HTTP/1.1" 200 None 2025-09-27 21:50:08,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:50:08,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-27 21:50:08,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:50:08,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f7ce8dd6b39fd1aeb72c HTTP/1.1" 200 None 2025-09-27 21:50:08,888 - lava_callback - INFO - Completed processing callback for node 68d7f7ce8dd6b39fd1aeb72c INFO: 172.21.0.1:43398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:50:56,849 - lava_callback - INFO - Received callback for node 68d5c2d32be2da466069a64e INFO: 172.21.0.1:44896 - "POST /node/68d5c2d32be2da466069a64e HTTP/1.0" 202 Accepted 2025-09-27 21:50:56,855 - lava_callback - INFO - Starting async job submit for node 68d5c2d32be2da466069a64e 2025-09-27 21:50:56,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:50:56,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2d32be2da466069a64e HTTP/1.1" 200 None 2025-09-27 21:50:56,890 - lava_callback - DEBUG - Processing node 68d5c2d32be2da466069a64e: baseline-arm-broonie 2025-09-27 21:50:57,106 - lava_callback - ERROR - Error processing callback for node 68d5c2d32be2da466069a64e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:51:26,683 - lava_callback - INFO - Received callback for node 68d7a67c8dd6b39fd1aeaab7 INFO: 172.21.0.1:56902 - "POST /node/68d7a67c8dd6b39fd1aeaab7 HTTP/1.0" 202 Accepted 2025-09-27 21:51:26,690 - lava_callback - INFO - Starting async job submit for node 68d7a67c8dd6b39fd1aeaab7 2025-09-27 21:51:26,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:51:26,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a67c8dd6b39fd1aeaab7 HTTP/1.1" 200 None 2025-09-27 21:51:26,768 - lava_callback - DEBUG - Processing node 68d7a67c8dd6b39fd1aeaab7: baseline-arm64 2025-09-27 21:51:27,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:51:27,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:51:27,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a67c8dd6b39fd1aeaab7/log.txt.gz 2025-09-27 21:51:27,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:51:28,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:51:28,031 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a67c8dd6b39fd1aeaab7/lava_callback.json.gz DEBUG: Setup failed for 68d7a67c8dd6b39fd1aeaab7. Transitting job node result: incomplete -> fail 2025-09-27 21:51:28,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:51:28,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a67c8dd6b39fd1aeaab7 HTTP/1.1" 200 None 2025-09-27 21:51:28,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:51:28,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eda8dd6b39fd1aea2de HTTP/1.1" 200 None 2025-09-27 21:51:28,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:51:28,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a67c8dd6b39fd1aeaab7 HTTP/1.1" 200 None 2025-09-27 21:51:28,163 - lava_callback - INFO - Completed processing callback for node 68d7a67c8dd6b39fd1aeaab7 INFO: 172.21.0.1:51326 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:51:36,773 - lava_callback - INFO - Received callback for node 68d7a6748dd6b39fd1aeaa99 INFO: 172.21.0.1:51330 - "POST /node/68d7a6748dd6b39fd1aeaa99 HTTP/1.0" 202 Accepted 2025-09-27 21:51:36,780 - lava_callback - INFO - Starting async job submit for node 68d7a6748dd6b39fd1aeaa99 2025-09-27 21:51:36,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:51:36,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a6748dd6b39fd1aeaa99 HTTP/1.1" 200 None 2025-09-27 21:51:36,842 - lava_callback - DEBUG - Processing node 68d7a6748dd6b39fd1aeaa99: baseline-arm64 2025-09-27 21:51:37,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:51:37,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:51:37,932 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a6748dd6b39fd1aeaa99/log.txt.gz 2025-09-27 21:51:37,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:51:38,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:51:38,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a6748dd6b39fd1aeaa99/lava_callback.json.gz DEBUG: Setup failed for 68d7a6748dd6b39fd1aeaa99. Transitting job node result: incomplete -> fail 2025-09-27 21:51:38,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:51:38,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a6748dd6b39fd1aeaa99 HTTP/1.1" 200 None 2025-09-27 21:51:38,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:51:38,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eda8dd6b39fd1aea2de HTTP/1.1" 200 None 2025-09-27 21:51:38,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:51:38,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a6748dd6b39fd1aeaa99 HTTP/1.1" 200 None 2025-09-27 21:51:38,271 - lava_callback - INFO - Completed processing callback for node 68d7a6748dd6b39fd1aeaa99 INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:52:19,571 - lava_callback - INFO - Received callback for node 68d7f7ce8dd6b39fd1aeb72f INFO: 172.21.0.1:44904 - "POST /node/68d7f7ce8dd6b39fd1aeb72f HTTP/1.0" 202 Accepted 2025-09-27 21:52:19,577 - lava_callback - INFO - Starting async job submit for node 68d7f7ce8dd6b39fd1aeb72f 2025-09-27 21:52:19,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:52:19,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f7ce8dd6b39fd1aeb72f HTTP/1.1" 200 None 2025-09-27 21:52:19,615 - lava_callback - DEBUG - Processing node 68d7f7ce8dd6b39fd1aeb72f: baseline-arm 2025-09-27 21:52:19,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:52:19,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:52:19,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f7ce8dd6b39fd1aeb72f/log.txt.gz 2025-09-27 21:52:20,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:52:20,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:52:20,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d7f7ce8dd6b39fd1aeb72f/lava_callback.json.gz 2025-09-27 21:52:20,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:52:20,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7f7ce8dd6b39fd1aeb72f HTTP/1.1" 200 None 2025-09-27 21:52:20,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:52:20,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-27 21:52:20,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:52:20,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7f7ce8dd6b39fd1aeb72f HTTP/1.1" 200 None 2025-09-27 21:52:20,192 - lava_callback - INFO - Completed processing callback for node 68d7f7ce8dd6b39fd1aeb72f INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:52:35,728 - lava_callback - INFO - Received callback for node 68d7a92a8dd6b39fd1aeac5b INFO: 172.21.0.1:39728 - "POST /node/68d7a92a8dd6b39fd1aeac5b HTTP/1.0" 202 Accepted 2025-09-27 21:52:35,736 - lava_callback - INFO - Starting async job submit for node 68d7a92a8dd6b39fd1aeac5b 2025-09-27 21:52:35,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:52:35,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a92a8dd6b39fd1aeac5b HTTP/1.1" 200 None 2025-09-27 21:52:35,789 - lava_callback - DEBUG - Processing node 68d7a92a8dd6b39fd1aeac5b: baseline-arm64 INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:52:36,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:52:36,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:52:36,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a92a8dd6b39fd1aeac5b/log.txt.gz 2025-09-27 21:52:36,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:52:37,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:52:37,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a92a8dd6b39fd1aeac5b/lava_callback.json.gz DEBUG: Setup failed for 68d7a92a8dd6b39fd1aeac5b. Transitting job node result: incomplete -> fail 2025-09-27 21:52:37,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:52:37,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a92a8dd6b39fd1aeac5b HTTP/1.1" 200 None 2025-09-27 21:52:37,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:52:37,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 21:52:37,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:52:37,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a92a8dd6b39fd1aeac5b HTTP/1.1" 200 None 2025-09-27 21:52:37,255 - lava_callback - INFO - Completed processing callback for node 68d7a92a8dd6b39fd1aeac5b INFO: 172.21.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:54:23,148 - lava_callback - INFO - Received callback for node 68d7bd718dd6b39fd1aeb040 INFO: 172.21.0.1:48038 - "POST /node/68d7bd718dd6b39fd1aeb040 HTTP/1.0" 202 Accepted 2025-09-27 21:54:23,155 - lava_callback - INFO - Starting async job submit for node 68d7bd718dd6b39fd1aeb040 2025-09-27 21:54:23,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:54:23,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bd718dd6b39fd1aeb040 HTTP/1.1" 200 None 2025-09-27 21:54:23,293 - lava_callback - DEBUG - Processing node 68d7bd718dd6b39fd1aeb040: baseline-arm64 2025-09-27 21:54:24,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:54:24,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:54:24,260 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7bd718dd6b39fd1aeb040/log.txt.gz 2025-09-27 21:54:24,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:54:24,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:54:24,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7bd718dd6b39fd1aeb040/lava_callback.json.gz 2025-09-27 21:54:24,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:54:24,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bd718dd6b39fd1aeb040 HTTP/1.1" 200 None 2025-09-27 21:54:24,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:54:24,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 21:54:24,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:54:24,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bd718dd6b39fd1aeb040 HTTP/1.1" 200 None 2025-09-27 21:54:24,696 - lava_callback - INFO - Completed processing callback for node 68d7bd718dd6b39fd1aeb040 INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:54:44,411 - lava_callback - INFO - Received callback for node 68d80f9a1fd44e101337efd4 INFO: 172.21.0.1:38726 - "POST /node/68d80f9a1fd44e101337efd4 HTTP/1.0" 202 Accepted 2025-09-27 21:54:44,417 - lava_callback - INFO - Starting async job submit for node 68d80f9a1fd44e101337efd4 2025-09-27 21:54:44,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:54:44,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9a1fd44e101337efd4 HTTP/1.1" 200 None 2025-09-27 21:54:44,466 - lava_callback - DEBUG - Processing node 68d80f9a1fd44e101337efd4: baseline-arm 2025-09-27 21:54:44,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:54:44,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:54:44,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9a1fd44e101337efd4/log.txt.gz 2025-09-27 21:54:44,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:54:44,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:54:44,960 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9a1fd44e101337efd4/lava_callback.json.gz 2025-09-27 21:54:44,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:54:44,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9a1fd44e101337efd4 HTTP/1.1" 200 None 2025-09-27 21:54:44,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:54:45,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 21:54:45,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:54:45,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9a1fd44e101337efd4 HTTP/1.1" 200 None 2025-09-27 21:54:45,053 - lava_callback - INFO - Completed processing callback for node 68d80f9a1fd44e101337efd4 INFO: 172.21.0.1:38728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:55:22,014 - lava_callback - INFO - Received callback for node 68d7bd728dd6b39fd1aeb043 INFO: 172.21.0.1:40616 - "POST /node/68d7bd728dd6b39fd1aeb043 HTTP/1.0" 202 Accepted 2025-09-27 21:55:22,020 - lava_callback - INFO - Starting async job submit for node 68d7bd728dd6b39fd1aeb043 2025-09-27 21:55:22,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:55:22,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bd728dd6b39fd1aeb043 HTTP/1.1" 200 None 2025-09-27 21:55:22,078 - lava_callback - DEBUG - Processing node 68d7bd728dd6b39fd1aeb043: baseline-arm64 2025-09-27 21:55:22,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:55:22,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:55:22,506 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7bd728dd6b39fd1aeb043/log.txt.gz 2025-09-27 21:55:22,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:55:22,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:55:22,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7bd728dd6b39fd1aeb043/lava_callback.json.gz 2025-09-27 21:55:22,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:55:22,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7bd728dd6b39fd1aeb043 HTTP/1.1" 200 None 2025-09-27 21:55:22,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:55:22,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-27 21:55:22,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:55:22,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7bd728dd6b39fd1aeb043 HTTP/1.1" 200 None 2025-09-27 21:55:22,728 - lava_callback - INFO - Completed processing callback for node 68d7bd728dd6b39fd1aeb043 INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:55:32,288 - lava_callback - INFO - Received callback for node 68d5c2ec2be2da466069a672 INFO: 172.21.0.1:36886 - "POST /node/68d5c2ec2be2da466069a672 HTTP/1.0" 202 Accepted 2025-09-27 21:55:32,295 - lava_callback - INFO - Starting async job submit for node 68d5c2ec2be2da466069a672 2025-09-27 21:55:32,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:55:32,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2ec2be2da466069a672 HTTP/1.1" 200 None 2025-09-27 21:55:32,340 - lava_callback - DEBUG - Processing node 68d5c2ec2be2da466069a672: ltp-fsx 2025-09-27 21:55:32,690 - lava_callback - ERROR - Error processing callback for node 68d5c2ec2be2da466069a672: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:55:37,707 - lava_callback - INFO - Received callback for node 68d5c2e52be2da466069a666 INFO: 172.21.0.1:36904 - "POST /node/68d5c2e52be2da466069a666 HTTP/1.0" 202 Accepted 2025-09-27 21:55:37,728 - lava_callback - INFO - Starting async job submit for node 68d5c2e52be2da466069a666 2025-09-27 21:55:38,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:55:38,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2e52be2da466069a666 HTTP/1.1" 200 None 2025-09-27 21:55:38,124 - lava_callback - DEBUG - Processing node 68d5c2e52be2da466069a666: ltp-controllers 2025-09-27 21:55:40,962 - lava_callback - ERROR - Error processing callback for node 68d5c2e52be2da466069a666: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:57:05,217 - lava_callback - INFO - Received callback for node 68d80f9c1fd44e101337efe0 INFO: 172.21.0.1:37676 - "POST /node/68d80f9c1fd44e101337efe0 HTTP/1.0" 202 Accepted 2025-09-27 21:57:05,223 - lava_callback - INFO - Starting async job submit for node 68d80f9c1fd44e101337efe0 2025-09-27 21:57:05,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:57:05,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9c1fd44e101337efe0 HTTP/1.1" 200 None 2025-09-27 21:57:05,278 - lava_callback - DEBUG - Processing node 68d80f9c1fd44e101337efe0: baseline-arm 2025-09-27 21:57:05,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:57:05,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:57:05,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9c1fd44e101337efe0/log.txt.gz 2025-09-27 21:57:05,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 21:57:05,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 21:57:05,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d80f9c1fd44e101337efe0/lava_callback.json.gz 2025-09-27 21:57:05,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:57:05,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f9c1fd44e101337efe0 HTTP/1.1" 200 None 2025-09-27 21:57:05,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:57:05,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80b5a8dd6b39fd1aeb978 HTTP/1.1" 200 None 2025-09-27 21:57:05,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:57:05,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d80f9c1fd44e101337efe0 HTTP/1.1" 200 None 2025-09-27 21:57:05,933 - lava_callback - INFO - Completed processing callback for node 68d80f9c1fd44e101337efe0 INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:57:57,430 - lava_callback - INFO - Received callback for node 68d5c2e72be2da466069a669 INFO: 172.21.0.1:53286 - "POST /node/68d5c2e72be2da466069a669 HTTP/1.0" 202 Accepted 2025-09-27 21:57:57,437 - lava_callback - INFO - Starting async job submit for node 68d5c2e72be2da466069a669 2025-09-27 21:57:57,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:57:57,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2e72be2da466069a669 HTTP/1.1" 200 None 2025-09-27 21:57:57,559 - lava_callback - DEBUG - Processing node 68d5c2e72be2da466069a669: ltp-cve 2025-09-27 21:57:58,322 - lava_callback - ERROR - Error processing callback for node 68d5c2e72be2da466069a669: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK 2025-09-27 21:59:57,567 - lava_callback - INFO - Received callback for node 68d5c2ef2be2da466069a678 INFO: 172.21.0.1:53654 - "POST /node/68d5c2ef2be2da466069a678 HTTP/1.0" 202 Accepted 2025-09-27 21:59:57,574 - lava_callback - INFO - Starting async job submit for node 68d5c2ef2be2da466069a678 2025-09-27 21:59:57,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 21:59:57,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2ef2be2da466069a678 HTTP/1.1" 200 None 2025-09-27 21:59:57,638 - lava_callback - DEBUG - Processing node 68d5c2ef2be2da466069a678: ltp-ipc 2025-09-27 21:59:57,961 - lava_callback - ERROR - Error processing callback for node 68d5c2ef2be2da466069a678: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:01:53,743 - lava_callback - INFO - Received callback for node 68d5c2ed2be2da466069a675 INFO: 172.21.0.1:57024 - "POST /node/68d5c2ed2be2da466069a675 HTTP/1.0" 202 Accepted 2025-09-27 22:01:53,750 - lava_callback - INFO - Starting async job submit for node 68d5c2ed2be2da466069a675 2025-09-27 22:01:53,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:01:53,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2ed2be2da466069a675 HTTP/1.1" 200 None 2025-09-27 22:01:53,820 - lava_callback - DEBUG - Processing node 68d5c2ed2be2da466069a675: ltp-input 2025-09-27 22:01:54,220 - lava_callback - ERROR - Error processing callback for node 68d5c2ed2be2da466069a675: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:11:22,101 - lava_callback - INFO - Received callback for node 68d5c2f42be2da466069a681 INFO: 172.21.0.1:33928 - "POST /node/68d5c2f42be2da466069a681 HTTP/1.0" 202 Accepted 2025-09-27 22:11:22,108 - lava_callback - INFO - Starting async job submit for node 68d5c2f42be2da466069a681 2025-09-27 22:11:22,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:11:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2f42be2da466069a681 HTTP/1.1" 200 None 2025-09-27 22:11:22,166 - lava_callback - DEBUG - Processing node 68d5c2f42be2da466069a681: ltp-smoketest 2025-09-27 22:11:22,589 - lava_callback - ERROR - Error processing callback for node 68d5c2f42be2da466069a681: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:11:48,001 - lava_callback - INFO - Received callback for node 68d7a92b8dd6b39fd1aeac5e INFO: 172.21.0.1:36210 - "POST /node/68d7a92b8dd6b39fd1aeac5e HTTP/1.0" 202 Accepted 2025-09-27 22:11:48,008 - lava_callback - INFO - Starting async job submit for node 68d7a92b8dd6b39fd1aeac5e 2025-09-27 22:11:48,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:11:48,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a92b8dd6b39fd1aeac5e HTTP/1.1" 200 None 2025-09-27 22:11:48,090 - lava_callback - DEBUG - Processing node 68d7a92b8dd6b39fd1aeac5e: baseline-arm64 2025-09-27 22:11:48,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:11:49,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:11:49,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a92b8dd6b39fd1aeac5e/log.txt.gz 2025-09-27 22:11:49,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:11:49,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:11:49,350 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7a92b8dd6b39fd1aeac5e/lava_callback.json.gz DEBUG: Setup failed for 68d7a92b8dd6b39fd1aeac5e. Transitting job node result: incomplete -> fail 2025-09-27 22:11:49,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:11:49,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7a92b8dd6b39fd1aeac5e HTTP/1.1" 200 None 2025-09-27 22:11:49,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:11:49,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 22:11:49,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:11:49,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7a92b8dd6b39fd1aeac5e HTTP/1.1" 200 None 2025-09-27 22:11:49,512 - lava_callback - INFO - Completed processing callback for node 68d7a92b8dd6b39fd1aeac5e INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:13:19,039 - lava_callback - INFO - Received callback for node 68d8431d1fd44e101337fe81 INFO: 172.21.0.1:53552 - "POST /node/68d8431d1fd44e101337fe81 HTTP/1.0" 202 Accepted 2025-09-27 22:13:19,044 - lava_callback - INFO - Starting async job submit for node 68d8431d1fd44e101337fe81 2025-09-27 22:13:19,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:13:19,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8431d1fd44e101337fe81 HTTP/1.1" 200 None 2025-09-27 22:13:19,080 - lava_callback - DEBUG - Processing node 68d8431d1fd44e101337fe81: baseline-arm64-broonie 2025-09-27 22:13:19,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:13:19,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:13:19,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8431d1fd44e101337fe81/log.txt.gz 2025-09-27 22:13:19,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:13:19,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:13:19,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8431d1fd44e101337fe81/lava_callback.json.gz 2025-09-27 22:13:19,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:13:19,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8431d1fd44e101337fe81 HTTP/1.1" 200 None 2025-09-27 22:13:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:13:19,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:13:19,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:13:19,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8431d1fd44e101337fe81 HTTP/1.1" 200 None 2025-09-27 22:13:19,777 - lava_callback - INFO - Completed processing callback for node 68d8431d1fd44e101337fe81 INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:14:05,447 - lava_callback - INFO - Received callback for node 68d816e01fd44e101337f5fa INFO: 172.21.0.1:44170 - "POST /node/68d816e01fd44e101337f5fa HTTP/1.0" 202 Accepted 2025-09-27 22:14:05,454 - lava_callback - INFO - Starting async job submit for node 68d816e01fd44e101337f5fa 2025-09-27 22:14:05,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:14:05,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e01fd44e101337f5fa HTTP/1.1" 200 None 2025-09-27 22:14:05,497 - lava_callback - DEBUG - Processing node 68d816e01fd44e101337f5fa: baseline-arm 2025-09-27 22:14:05,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:14:05,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:14:05,887 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e01fd44e101337f5fa/log.txt.gz 2025-09-27 22:14:05,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:14:06,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:14:06,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e01fd44e101337f5fa/lava_callback.json.gz 2025-09-27 22:14:06,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:14:06,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e01fd44e101337f5fa HTTP/1.1" 200 None 2025-09-27 22:14:06,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:14:06,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 22:14:06,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:14:06,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e01fd44e101337f5fa HTTP/1.1" 200 None 2025-09-27 22:14:06,105 - lava_callback - INFO - Completed processing callback for node 68d816e01fd44e101337f5fa INFO: 172.21.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:14:56,600 - lava_callback - INFO - Received callback for node 68d7c1d38dd6b39fd1aeb159 INFO: 172.21.0.1:57374 - "POST /node/68d7c1d38dd6b39fd1aeb159 HTTP/1.0" 202 Accepted 2025-09-27 22:14:56,607 - lava_callback - INFO - Starting async job submit for node 68d7c1d38dd6b39fd1aeb159 2025-09-27 22:14:56,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:14:56,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c1d38dd6b39fd1aeb159 HTTP/1.1" 200 None 2025-09-27 22:14:56,671 - lava_callback - DEBUG - Processing node 68d7c1d38dd6b39fd1aeb159: baseline-arm64 2025-09-27 22:14:57,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:14:57,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:14:57,725 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c1d38dd6b39fd1aeb159/log.txt.gz 2025-09-27 22:14:57,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:14:57,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:14:57,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c1d38dd6b39fd1aeb159/lava_callback.json.gz DEBUG: Setup failed for 68d7c1d38dd6b39fd1aeb159. Transitting job node result: incomplete -> fail 2025-09-27 22:14:58,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:14:58,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c1d38dd6b39fd1aeb159 HTTP/1.1" 200 None 2025-09-27 22:14:58,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:14:58,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 22:14:58,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:14:58,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c1d38dd6b39fd1aeb159 HTTP/1.1" 200 None 2025-09-27 22:14:58,152 - lava_callback - INFO - Completed processing callback for node 68d7c1d38dd6b39fd1aeb159 INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:15:57,463 - lava_callback - INFO - Received callback for node 68d7c1d48dd6b39fd1aeb15c INFO: 172.21.0.1:43218 - "POST /node/68d7c1d48dd6b39fd1aeb15c HTTP/1.0" 202 Accepted 2025-09-27 22:15:57,471 - lava_callback - INFO - Starting async job submit for node 68d7c1d48dd6b39fd1aeb15c 2025-09-27 22:15:57,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:15:57,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c1d48dd6b39fd1aeb15c HTTP/1.1" 200 None 2025-09-27 22:15:57,525 - lava_callback - DEBUG - Processing node 68d7c1d48dd6b39fd1aeb15c: baseline-arm64 2025-09-27 22:15:58,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:15:58,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:15:58,688 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c1d48dd6b39fd1aeb15c/log.txt.gz 2025-09-27 22:15:58,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:15:58,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:15:58,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c1d48dd6b39fd1aeb15c/lava_callback.json.gz DEBUG: Setup failed for 68d7c1d48dd6b39fd1aeb15c. Transitting job node result: incomplete -> fail 2025-09-27 22:15:58,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:15:59,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c1d48dd6b39fd1aeb15c HTTP/1.1" 200 None 2025-09-27 22:15:59,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:15:59,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 22:15:59,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:15:59,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c1d48dd6b39fd1aeb15c HTTP/1.1" 200 None 2025-09-27 22:15:59,052 - lava_callback - INFO - Completed processing callback for node 68d7c1d48dd6b39fd1aeb15c INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:16:25,421 - lava_callback - INFO - Received callback for node 68d816e21fd44e101337f606 INFO: 172.21.0.1:55300 - "POST /node/68d816e21fd44e101337f606 HTTP/1.0" 202 Accepted 2025-09-27 22:16:25,427 - lava_callback - INFO - Starting async job submit for node 68d816e21fd44e101337f606 2025-09-27 22:16:25,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:16:25,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e21fd44e101337f606 HTTP/1.1" 200 None 2025-09-27 22:16:25,475 - lava_callback - DEBUG - Processing node 68d816e21fd44e101337f606: baseline-arm 2025-09-27 22:16:25,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:16:25,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:16:25,842 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e21fd44e101337f606/log.txt.gz 2025-09-27 22:16:25,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:16:25,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:16:25,980 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d816e21fd44e101337f606/lava_callback.json.gz 2025-09-27 22:16:26,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:16:26,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d816e21fd44e101337f606 HTTP/1.1" 200 None 2025-09-27 22:16:26,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:16:26,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d80f3f1fd44e101337efa1 HTTP/1.1" 200 None 2025-09-27 22:16:26,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:16:26,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d816e21fd44e101337f606 HTTP/1.1" 200 None 2025-09-27 22:16:26,071 - lava_callback - INFO - Completed processing callback for node 68d816e21fd44e101337f606 INFO: 172.21.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:18:46,087 - lava_callback - INFO - Received callback for node 68d82cb81fd44e101337fb32 INFO: 172.21.0.1:50768 - "POST /node/68d82cb81fd44e101337fb32 HTTP/1.0" 202 Accepted 2025-09-27 22:18:46,093 - lava_callback - INFO - Starting async job submit for node 68d82cb81fd44e101337fb32 2025-09-27 22:18:46,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:18:46,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cb81fd44e101337fb32 HTTP/1.1" 200 None 2025-09-27 22:18:46,133 - lava_callback - DEBUG - Processing node 68d82cb81fd44e101337fb32: baseline-arm 2025-09-27 22:18:46,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:18:46,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:18:46,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cb81fd44e101337fb32/log.txt.gz 2025-09-27 22:18:46,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:18:46,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:18:46,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cb81fd44e101337fb32/lava_callback.json.gz 2025-09-27 22:18:46,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:18:46,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cb81fd44e101337fb32 HTTP/1.1" 200 None 2025-09-27 22:18:46,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:18:46,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:18:46,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:18:46,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cb81fd44e101337fb32 HTTP/1.1" 200 None 2025-09-27 22:18:46,799 - lava_callback - INFO - Completed processing callback for node 68d82cb81fd44e101337fb32 INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:18:58,036 - lava_callback - INFO - Received callback for node 68d5c2f22be2da466069a67e INFO: 172.21.0.1:43542 - "POST /node/68d5c2f22be2da466069a67e HTTP/1.0" 202 Accepted 2025-09-27 22:18:58,043 - lava_callback - INFO - Starting async job submit for node 68d5c2f22be2da466069a67e 2025-09-27 22:18:58,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:18:58,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2f22be2da466069a67e HTTP/1.1" 200 None 2025-09-27 22:18:58,104 - lava_callback - DEBUG - Processing node 68d5c2f22be2da466069a67e: ltp-sched 2025-09-27 22:18:58,442 - lava_callback - ERROR - Error processing callback for node 68d5c2f22be2da466069a67e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:21:00,902 - lava_callback - INFO - Received callback for node 68d82cb91fd44e101337fb35 INFO: 172.21.0.1:55958 - "POST /node/68d82cb91fd44e101337fb35 HTTP/1.0" 202 Accepted 2025-09-27 22:21:00,908 - lava_callback - INFO - Starting async job submit for node 68d82cb91fd44e101337fb35 2025-09-27 22:21:00,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:21:00,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cb91fd44e101337fb35 HTTP/1.1" 200 None 2025-09-27 22:21:00,942 - lava_callback - DEBUG - Processing node 68d82cb91fd44e101337fb35: baseline-arm 2025-09-27 22:21:01,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:21:01,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:21:01,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cb91fd44e101337fb35/log.txt.gz 2025-09-27 22:21:01,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:21:01,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:21:01,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cb91fd44e101337fb35/lava_callback.json.gz 2025-09-27 22:21:01,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:21:01,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cb91fd44e101337fb35 HTTP/1.1" 200 None 2025-09-27 22:21:01,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:21:01,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:21:01,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:21:01,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cb91fd44e101337fb35 HTTP/1.1" 200 None 2025-09-27 22:21:01,594 - lava_callback - INFO - Completed processing callback for node 68d82cb91fd44e101337fb35 INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:23:18,243 - lava_callback - INFO - Received callback for node 68d5c2f92be2da466069a68a INFO: 172.21.0.1:54940 - "POST /node/68d5c2f92be2da466069a68a HTTP/1.0" 202 Accepted 2025-09-27 22:23:18,250 - lava_callback - INFO - Starting async job submit for node 68d5c2f92be2da466069a68a 2025-09-27 22:23:18,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:23:18,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2f92be2da466069a68a HTTP/1.1" 200 None 2025-09-27 22:23:18,315 - lava_callback - DEBUG - Processing node 68d5c2f92be2da466069a68a: ltp-timers 2025-09-27 22:23:18,680 - lava_callback - ERROR - Error processing callback for node 68d5c2f92be2da466069a68a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 22:23:25,742 - lava_callback - INFO - Received callback for node 68d82cbb1fd44e101337fb38 INFO: 172.21.0.1:53526 - "POST /node/68d82cbb1fd44e101337fb38 HTTP/1.0" 202 Accepted 2025-09-27 22:23:25,748 - lava_callback - INFO - Starting async job submit for node 68d82cbb1fd44e101337fb38 2025-09-27 22:23:25,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:23:25,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbb1fd44e101337fb38 HTTP/1.1" 200 None 2025-09-27 22:23:25,782 - lava_callback - DEBUG - Processing node 68d82cbb1fd44e101337fb38: baseline-arm 2025-09-27 22:23:26,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:23:26,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:23:26,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbb1fd44e101337fb38/log.txt.gz 2025-09-27 22:23:26,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:23:26,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:23:26,382 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbb1fd44e101337fb38/lava_callback.json.gz 2025-09-27 22:23:26,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:23:26,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbb1fd44e101337fb38 HTTP/1.1" 200 None 2025-09-27 22:23:26,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:23:26,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:23:26,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:23:26,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cbb1fd44e101337fb38 HTTP/1.1" 200 None 2025-09-27 22:23:26,459 - lava_callback - INFO - Completed processing callback for node 68d82cbb1fd44e101337fb38 INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:25:40,399 - lava_callback - INFO - Received callback for node 68d82cbb1fd44e101337fb3b INFO: 172.21.0.1:50912 - "POST /node/68d82cbb1fd44e101337fb3b HTTP/1.0" 202 Accepted 2025-09-27 22:25:40,405 - lava_callback - INFO - Starting async job submit for node 68d82cbb1fd44e101337fb3b 2025-09-27 22:25:40,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:25:40,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbb1fd44e101337fb3b HTTP/1.1" 200 None 2025-09-27 22:25:40,439 - lava_callback - DEBUG - Processing node 68d82cbb1fd44e101337fb3b: baseline-arm 2025-09-27 22:25:40,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:25:40,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:25:40,822 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbb1fd44e101337fb3b/log.txt.gz 2025-09-27 22:25:40,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:25:40,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:25:40,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbb1fd44e101337fb3b/lava_callback.json.gz 2025-09-27 22:25:40,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:25:40,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbb1fd44e101337fb3b HTTP/1.1" 200 None 2025-09-27 22:25:40,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:25:41,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:25:41,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:25:41,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cbb1fd44e101337fb3b HTTP/1.1" 200 None 2025-09-27 22:25:41,048 - lava_callback - INFO - Completed processing callback for node 68d82cbb1fd44e101337fb3b INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:27:38,426 - lava_callback - INFO - Received callback for node 68d5c2fb2be2da466069a68d INFO: 172.21.0.1:55960 - "POST /node/68d5c2fb2be2da466069a68d HTTP/1.0" 202 Accepted 2025-09-27 22:27:38,435 - lava_callback - INFO - Starting async job submit for node 68d5c2fb2be2da466069a68d 2025-09-27 22:27:38,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:27:38,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2fb2be2da466069a68d HTTP/1.1" 200 None 2025-09-27 22:27:38,486 - lava_callback - DEBUG - Processing node 68d5c2fb2be2da466069a68d: ltp-watchqueue 2025-09-27 22:27:38,900 - lava_callback - ERROR - Error processing callback for node 68d5c2fb2be2da466069a68d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34602 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:28:06,177 - lava_callback - INFO - Received callback for node 68d82cbc1fd44e101337fb3e INFO: 172.21.0.1:34614 - "POST /node/68d82cbc1fd44e101337fb3e HTTP/1.0" 202 Accepted 2025-09-27 22:28:06,183 - lava_callback - INFO - Starting async job submit for node 68d82cbc1fd44e101337fb3e 2025-09-27 22:28:06,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:28:06,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbc1fd44e101337fb3e HTTP/1.1" 200 None 2025-09-27 22:28:06,221 - lava_callback - DEBUG - Processing node 68d82cbc1fd44e101337fb3e: baseline-arm 2025-09-27 22:28:06,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:28:06,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:28:06,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbc1fd44e101337fb3e/log.txt.gz 2025-09-27 22:28:06,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:28:06,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:28:06,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbc1fd44e101337fb3e/lava_callback.json.gz 2025-09-27 22:28:06,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:28:06,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbc1fd44e101337fb3e HTTP/1.1" 200 None 2025-09-27 22:28:06,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:28:06,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:28:06,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:28:06,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cbc1fd44e101337fb3e HTTP/1.1" 200 None 2025-09-27 22:28:06,827 - lava_callback - INFO - Completed processing callback for node 68d82cbc1fd44e101337fb3e INFO: 172.21.0.1:45064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:29:18,511 - lava_callback - INFO - Received callback for node 68d5c2f12be2da466069a67b INFO: 172.21.0.1:43474 - "POST /node/68d5c2f12be2da466069a67b HTTP/1.0" 202 Accepted 2025-09-27 22:29:18,518 - lava_callback - INFO - Starting async job submit for node 68d5c2f12be2da466069a67b 2025-09-27 22:29:18,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:29:18,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2f12be2da466069a67b HTTP/1.1" 200 None 2025-09-27 22:29:18,585 - lava_callback - DEBUG - Processing node 68d5c2f12be2da466069a67b: ltp-pty 2025-09-27 22:29:18,982 - lava_callback - ERROR - Error processing callback for node 68d5c2f12be2da466069a67b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:29:38,564 - lava_callback - INFO - Received callback for node 68d5c5ae2be2da466069a7d0 INFO: 172.21.0.1:51066 - "POST /node/68d5c5ae2be2da466069a7d0 HTTP/1.0" 202 Accepted 2025-09-27 22:29:38,570 - lava_callback - INFO - Starting async job submit for node 68d5c5ae2be2da466069a7d0 2025-09-27 22:29:38,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:29:38,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5ae2be2da466069a7d0 HTTP/1.1" 200 None 2025-09-27 22:29:38,611 - lava_callback - DEBUG - Processing node 68d5c5ae2be2da466069a7d0: baseline-arm-broonie 2025-09-27 22:29:38,809 - lava_callback - ERROR - Error processing callback for node 68d5c5ae2be2da466069a7d0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41004 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:29:49,503 - lava_callback - INFO - Received callback for node 68d5c2c12be2da466069a621 INFO: 172.21.0.1:40888 - "POST /node/68d5c2c12be2da466069a621 HTTP/1.0" 202 Accepted 2025-09-27 22:29:49,509 - lava_callback - INFO - Starting async job submit for node 68d5c2c12be2da466069a621 2025-09-27 22:29:49,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:29:49,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2c12be2da466069a621 HTTP/1.1" 200 None 2025-09-27 22:29:49,553 - lava_callback - DEBUG - Processing node 68d5c2c12be2da466069a621: baseline-arm 2025-09-27 22:29:49,824 - lava_callback - ERROR - Error processing callback for node 68d5c2c12be2da466069a621: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:30:26,453 - lava_callback - INFO - Received callback for node 68d82cbd1fd44e101337fb41 INFO: 172.21.0.1:45888 - "POST /node/68d82cbd1fd44e101337fb41 HTTP/1.0" 202 Accepted 2025-09-27 22:30:26,459 - lava_callback - INFO - Starting async job submit for node 68d82cbd1fd44e101337fb41 2025-09-27 22:30:26,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:30:26,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbd1fd44e101337fb41 HTTP/1.1" 200 None 2025-09-27 22:30:26,509 - lava_callback - DEBUG - Processing node 68d82cbd1fd44e101337fb41: baseline-arm INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:30:26,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:30:26,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:30:26,909 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbd1fd44e101337fb41/log.txt.gz 2025-09-27 22:30:26,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:30:27,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:30:27,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbd1fd44e101337fb41/lava_callback.json.gz 2025-09-27 22:30:27,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:30:27,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbd1fd44e101337fb41 HTTP/1.1" 200 None 2025-09-27 22:30:27,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:30:27,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:30:27,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:30:27,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cbd1fd44e101337fb41 HTTP/1.1" 200 None 2025-09-27 22:30:27,149 - lava_callback - INFO - Completed processing callback for node 68d82cbd1fd44e101337fb41 INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:30:41,811 - lava_callback - INFO - Received callback for node 68d5c2f72be2da466069a687 INFO: 172.21.0.1:36230 - "POST /node/68d5c2f72be2da466069a687 HTTP/1.0" 202 Accepted 2025-09-27 22:30:41,818 - lava_callback - INFO - Starting async job submit for node 68d5c2f72be2da466069a687 2025-09-27 22:30:41,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:30:41,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2f72be2da466069a687 HTTP/1.1" 200 None 2025-09-27 22:30:41,860 - lava_callback - DEBUG - Processing node 68d5c2f72be2da466069a687: ltp-syscalls-ipc 2025-09-27 22:30:42,688 - lava_callback - ERROR - Error processing callback for node 68d5c2f72be2da466069a687: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:31:57,119 - lava_callback - INFO - Received callback for node 68d5c2c92be2da466069a639 INFO: 172.21.0.1:59130 - "POST /node/68d5c2c92be2da466069a639 HTTP/1.0" 202 Accepted 2025-09-27 22:31:57,124 - lava_callback - INFO - Starting async job submit for node 68d5c2c92be2da466069a639 2025-09-27 22:31:57,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:31:57,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2c92be2da466069a639 HTTP/1.1" 200 None 2025-09-27 22:31:57,142 - lava_callback - DEBUG - Processing node 68d5c2c92be2da466069a639: baseline-arm 2025-09-27 22:31:57,142 - lava_callback - ERROR - Error processing callback for node 68d5c2c92be2da466069a639: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:31:57,792 - lava_callback - INFO - Received callback for node 68d5c2c92be2da466069a63c INFO: 172.21.0.1:59142 - "POST /node/68d5c2c92be2da466069a63c HTTP/1.0" 202 Accepted 2025-09-27 22:31:57,798 - lava_callback - INFO - Starting async job submit for node 68d5c2c92be2da466069a63c 2025-09-27 22:31:57,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:31:57,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2c92be2da466069a63c HTTP/1.1" 200 None 2025-09-27 22:31:57,823 - lava_callback - DEBUG - Processing node 68d5c2c92be2da466069a63c: baseline-arm 2025-09-27 22:31:57,823 - lava_callback - ERROR - Error processing callback for node 68d5c2c92be2da466069a63c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:32:08,832 - lava_callback - INFO - Received callback for node 68d7c2058dd6b39fd1aeb162 INFO: 172.21.0.1:57938 - "POST /node/68d7c2058dd6b39fd1aeb162 HTTP/1.0" 202 Accepted 2025-09-27 22:32:08,839 - lava_callback - INFO - Starting async job submit for node 68d7c2058dd6b39fd1aeb162 2025-09-27 22:32:08,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:32:08,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c2058dd6b39fd1aeb162 HTTP/1.1" 200 None 2025-09-27 22:32:08,912 - lava_callback - DEBUG - Processing node 68d7c2058dd6b39fd1aeb162: baseline-arm64 2025-09-27 22:32:09,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:32:10,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:32:10,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c2058dd6b39fd1aeb162/log.txt.gz 2025-09-27 22:32:10,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:32:10,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:32:10,206 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c2058dd6b39fd1aeb162/lava_callback.json.gz DEBUG: Setup failed for 68d7c2058dd6b39fd1aeb162. Transitting job node result: incomplete -> fail 2025-09-27 22:32:10,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:32:10,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c2058dd6b39fd1aeb162 HTTP/1.1" 200 None 2025-09-27 22:32:10,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:32:10,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 22:32:10,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:32:10,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c2058dd6b39fd1aeb162 HTTP/1.1" 200 None 2025-09-27 22:32:10,397 - lava_callback - INFO - Completed processing callback for node 68d7c2058dd6b39fd1aeb162 INFO: 172.21.0.1:42948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:32:45,724 - lava_callback - INFO - Received callback for node 68d82cbe1fd44e101337fb44 INFO: 172.21.0.1:32776 - "POST /node/68d82cbe1fd44e101337fb44 HTTP/1.0" 202 Accepted 2025-09-27 22:32:45,733 - lava_callback - INFO - Starting async job submit for node 68d82cbe1fd44e101337fb44 2025-09-27 22:32:45,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:32:45,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbe1fd44e101337fb44 HTTP/1.1" 200 None 2025-09-27 22:32:45,768 - lava_callback - DEBUG - Processing node 68d82cbe1fd44e101337fb44: baseline-arm 2025-09-27 22:32:46,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:32:46,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:32:46,148 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbe1fd44e101337fb44/log.txt.gz 2025-09-27 22:32:46,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:32:46,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:32:46,292 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbe1fd44e101337fb44/lava_callback.json.gz 2025-09-27 22:32:46,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:32:46,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbe1fd44e101337fb44 HTTP/1.1" 200 None 2025-09-27 22:32:46,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:32:46,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:32:46,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:32:46,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cbe1fd44e101337fb44 HTTP/1.1" 200 None 2025-09-27 22:32:46,390 - lava_callback - INFO - Completed processing callback for node 68d82cbe1fd44e101337fb44 INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:35:05,718 - lava_callback - INFO - Received callback for node 68d82cbf1fd44e101337fb47 INFO: 172.21.0.1:56756 - "POST /node/68d82cbf1fd44e101337fb47 HTTP/1.0" 202 Accepted 2025-09-27 22:35:05,724 - lava_callback - INFO - Starting async job submit for node 68d82cbf1fd44e101337fb47 2025-09-27 22:35:05,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:05,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbf1fd44e101337fb47 HTTP/1.1" 200 None 2025-09-27 22:35:05,763 - lava_callback - DEBUG - Processing node 68d82cbf1fd44e101337fb47: baseline-arm 2025-09-27 22:35:06,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:35:06,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:35:06,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbf1fd44e101337fb47/log.txt.gz 2025-09-27 22:35:06,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:35:06,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:35:06,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cbf1fd44e101337fb47/lava_callback.json.gz 2025-09-27 22:35:06,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:06,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cbf1fd44e101337fb47 HTTP/1.1" 200 None 2025-09-27 22:35:06,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:06,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:35:06,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:06,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cbf1fd44e101337fb47 HTTP/1.1" 200 None 2025-09-27 22:35:06,503 - lava_callback - INFO - Completed processing callback for node 68d82cbf1fd44e101337fb47 INFO: 172.21.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:35:18,917 - lava_callback - INFO - Received callback for node 68d5c5d02be2da466069a80b INFO: 172.21.0.1:40474 - "POST /node/68d5c5d02be2da466069a80b HTTP/1.0" 202 Accepted 2025-09-27 22:35:18,925 - lava_callback - INFO - Starting async job submit for node 68d5c5d02be2da466069a80b 2025-09-27 22:35:19,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:19,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5d02be2da466069a80b HTTP/1.1" 200 None 2025-09-27 22:35:19,046 - lava_callback - DEBUG - Processing node 68d5c5d02be2da466069a80b: ltp-containers 2025-09-27 22:35:19,837 - lava_callback - ERROR - Error processing callback for node 68d5c5d02be2da466069a80b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:35:36,445 - lava_callback - INFO - Received callback for node 68d7c2068dd6b39fd1aeb165 INFO: 172.21.0.1:42102 - "POST /node/68d7c2068dd6b39fd1aeb165 HTTP/1.0" 202 Accepted 2025-09-27 22:35:36,453 - lava_callback - INFO - Starting async job submit for node 68d7c2068dd6b39fd1aeb165 2025-09-27 22:35:36,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:36,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c2068dd6b39fd1aeb165 HTTP/1.1" 200 None 2025-09-27 22:35:36,509 - lava_callback - DEBUG - Processing node 68d7c2068dd6b39fd1aeb165: baseline-arm64 INFO: 172.21.0.1:42110 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:35:37,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:35:37,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:35:37,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c2068dd6b39fd1aeb165/log.txt.gz 2025-09-27 22:35:37,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:35:37,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:35:37,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c2068dd6b39fd1aeb165/lava_callback.json.gz DEBUG: Setup failed for 68d7c2068dd6b39fd1aeb165. Transitting job node result: incomplete -> fail 2025-09-27 22:35:37,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:37,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c2068dd6b39fd1aeb165 HTTP/1.1" 200 None 2025-09-27 22:35:37,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:37,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 22:35:37,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:35:37,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c2068dd6b39fd1aeb165 HTTP/1.1" 200 None 2025-09-27 22:35:37,966 - lava_callback - INFO - Completed processing callback for node 68d7c2068dd6b39fd1aeb165 INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:36:37,077 - lava_callback - INFO - Received callback for node 68d7c22d8dd6b39fd1aeb16b INFO: 172.21.0.1:35584 - "POST /node/68d7c22d8dd6b39fd1aeb16b HTTP/1.0" 202 Accepted 2025-09-27 22:36:37,085 - lava_callback - INFO - Starting async job submit for node 68d7c22d8dd6b39fd1aeb16b 2025-09-27 22:36:37,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:36:37,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c22d8dd6b39fd1aeb16b HTTP/1.1" 200 None 2025-09-27 22:36:37,139 - lava_callback - DEBUG - Processing node 68d7c22d8dd6b39fd1aeb16b: baseline-arm64 2025-09-27 22:36:38,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:36:38,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:36:38,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c22d8dd6b39fd1aeb16b/log.txt.gz 2025-09-27 22:36:38,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:36:38,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:36:38,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c22d8dd6b39fd1aeb16b/lava_callback.json.gz DEBUG: Setup failed for 68d7c22d8dd6b39fd1aeb16b. Transitting job node result: incomplete -> fail 2025-09-27 22:36:38,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:36:38,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c22d8dd6b39fd1aeb16b HTTP/1.1" 200 None 2025-09-27 22:36:38,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:36:38,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 22:36:38,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:36:38,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c22d8dd6b39fd1aeb16b HTTP/1.1" 200 None 2025-09-27 22:36:38,516 - lava_callback - INFO - Completed processing callback for node 68d7c22d8dd6b39fd1aeb16b INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:37:09,524 - lava_callback - INFO - Received callback for node 68d7c4d88dd6b39fd1aeb1ad INFO: 172.21.0.1:49756 - "POST /node/68d7c4d88dd6b39fd1aeb1ad HTTP/1.0" 202 Accepted 2025-09-27 22:37:09,530 - lava_callback - INFO - Starting async job submit for node 68d7c4d88dd6b39fd1aeb1ad 2025-09-27 22:37:09,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:37:09,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4d88dd6b39fd1aeb1ad HTTP/1.1" 200 None 2025-09-27 22:37:09,566 - lava_callback - DEBUG - Processing node 68d7c4d88dd6b39fd1aeb1ad: baseline-arm64 2025-09-27 22:37:09,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:37:10,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:37:10,083 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4d88dd6b39fd1aeb1ad/log.txt.gz 2025-09-27 22:37:10,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:37:10,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:37:10,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4d88dd6b39fd1aeb1ad/lava_callback.json.gz 2025-09-27 22:37:10,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:37:10,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4d88dd6b39fd1aeb1ad HTTP/1.1" 200 None 2025-09-27 22:37:10,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:37:10,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:37:10,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:37:10,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4d88dd6b39fd1aeb1ad HTTP/1.1" 200 None 2025-09-27 22:37:10,356 - lava_callback - INFO - Completed processing callback for node 68d7c4d88dd6b39fd1aeb1ad INFO: 172.21.0.1:49764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:37:25,732 - lava_callback - INFO - Received callback for node 68d82cfc1fd44e101337fb87 INFO: 172.21.0.1:59886 - "POST /node/68d82cfc1fd44e101337fb87 HTTP/1.0" 202 Accepted 2025-09-27 22:37:25,738 - lava_callback - INFO - Starting async job submit for node 68d82cfc1fd44e101337fb87 2025-09-27 22:37:25,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:37:25,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cfc1fd44e101337fb87 HTTP/1.1" 200 None 2025-09-27 22:37:25,772 - lava_callback - DEBUG - Processing node 68d82cfc1fd44e101337fb87: baseline-arm 2025-09-27 22:37:26,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:37:26,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:37:26,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cfc1fd44e101337fb87/log.txt.gz 2025-09-27 22:37:26,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:37:26,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:37:26,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cfc1fd44e101337fb87/lava_callback.json.gz 2025-09-27 22:37:26,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:37:26,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cfc1fd44e101337fb87 HTTP/1.1" 200 None 2025-09-27 22:37:26,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:37:26,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:37:26,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:37:26,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cfc1fd44e101337fb87 HTTP/1.1" 200 None 2025-09-27 22:37:26,346 - lava_callback - INFO - Completed processing callback for node 68d82cfc1fd44e101337fb87 INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:38:04,398 - lava_callback - INFO - Received callback for node 68d7c4d98dd6b39fd1aeb1b3 INFO: 172.21.0.1:40210 - "POST /node/68d7c4d98dd6b39fd1aeb1b3 HTTP/1.0" 202 Accepted 2025-09-27 22:38:04,405 - lava_callback - INFO - Starting async job submit for node 68d7c4d98dd6b39fd1aeb1b3 2025-09-27 22:38:04,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:38:04,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4d98dd6b39fd1aeb1b3 HTTP/1.1" 200 None 2025-09-27 22:38:04,440 - lava_callback - DEBUG - Processing node 68d7c4d98dd6b39fd1aeb1b3: baseline-arm64 2025-09-27 22:38:04,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:38:04,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:38:04,960 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4d98dd6b39fd1aeb1b3/log.txt.gz 2025-09-27 22:38:04,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:38:05,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:38:05,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4d98dd6b39fd1aeb1b3/lava_callback.json.gz 2025-09-27 22:38:05,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:38:05,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4d98dd6b39fd1aeb1b3 HTTP/1.1" 200 None 2025-09-27 22:38:05,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:38:05,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:38:05,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:38:05,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4d98dd6b39fd1aeb1b3 HTTP/1.1" 200 None 2025-09-27 22:38:05,201 - lava_callback - INFO - Completed processing callback for node 68d7c4d98dd6b39fd1aeb1b3 INFO: 172.21.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:38:28,873 - lava_callback - INFO - Received callback for node 68d7c4db8dd6b39fd1aeb1b6 INFO: 172.21.0.1:48496 - "POST /node/68d7c4db8dd6b39fd1aeb1b6 HTTP/1.0" 202 Accepted 2025-09-27 22:38:28,879 - lava_callback - INFO - Starting async job submit for node 68d7c4db8dd6b39fd1aeb1b6 2025-09-27 22:38:28,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:38:28,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4db8dd6b39fd1aeb1b6 HTTP/1.1" 200 None 2025-09-27 22:38:28,919 - lava_callback - DEBUG - Processing node 68d7c4db8dd6b39fd1aeb1b6: baseline-arm64 2025-09-27 22:38:29,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:38:29,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:38:29,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4db8dd6b39fd1aeb1b6/log.txt.gz 2025-09-27 22:38:29,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:38:29,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:38:29,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4db8dd6b39fd1aeb1b6/lava_callback.json.gz 2025-09-27 22:38:29,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:38:29,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4db8dd6b39fd1aeb1b6 HTTP/1.1" 200 None 2025-09-27 22:38:29,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:38:29,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:38:29,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:38:29,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4db8dd6b39fd1aeb1b6 HTTP/1.1" 200 None 2025-09-27 22:38:29,611 - lava_callback - INFO - Completed processing callback for node 68d7c4db8dd6b39fd1aeb1b6 INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:39:24,056 - lava_callback - INFO - Received callback for node 68d7c4dc8dd6b39fd1aeb1b9 INFO: 172.21.0.1:43974 - "POST /node/68d7c4dc8dd6b39fd1aeb1b9 HTTP/1.0" 202 Accepted 2025-09-27 22:39:24,063 - lava_callback - INFO - Starting async job submit for node 68d7c4dc8dd6b39fd1aeb1b9 2025-09-27 22:39:24,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:24,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4dc8dd6b39fd1aeb1b9 HTTP/1.1" 200 None 2025-09-27 22:39:24,100 - lava_callback - DEBUG - Processing node 68d7c4dc8dd6b39fd1aeb1b9: baseline-arm64 2025-09-27 22:39:24,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:39:24,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:39:24,587 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4dc8dd6b39fd1aeb1b9/log.txt.gz 2025-09-27 22:39:24,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:39:24,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:39:24,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4dc8dd6b39fd1aeb1b9/lava_callback.json.gz 2025-09-27 22:39:24,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:24,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4dc8dd6b39fd1aeb1b9 HTTP/1.1" 200 None 2025-09-27 22:39:24,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:24,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:39:24,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:24,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4dc8dd6b39fd1aeb1b9 HTTP/1.1" 200 None 2025-09-27 22:39:24,815 - lava_callback - INFO - Completed processing callback for node 68d7c4dc8dd6b39fd1aeb1b9 INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:39:45,513 - lava_callback - INFO - Received callback for node 68d82cfc1fd44e101337fb8a INFO: 172.21.0.1:57874 - "POST /node/68d82cfc1fd44e101337fb8a HTTP/1.0" 202 Accepted 2025-09-27 22:39:45,519 - lava_callback - INFO - Starting async job submit for node 68d82cfc1fd44e101337fb8a 2025-09-27 22:39:45,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:45,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cfc1fd44e101337fb8a HTTP/1.1" 200 None 2025-09-27 22:39:45,570 - lava_callback - DEBUG - Processing node 68d82cfc1fd44e101337fb8a: baseline-arm 2025-09-27 22:39:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:39:46,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:39:46,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cfc1fd44e101337fb8a/log.txt.gz 2025-09-27 22:39:46,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:39:46,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:39:46,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cfc1fd44e101337fb8a/lava_callback.json.gz 2025-09-27 22:39:46,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:46,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cfc1fd44e101337fb8a HTTP/1.1" 200 None 2025-09-27 22:39:46,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:46,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:39:46,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:46,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cfc1fd44e101337fb8a HTTP/1.1" 200 None 2025-09-27 22:39:46,229 - lava_callback - INFO - Completed processing callback for node 68d82cfc1fd44e101337fb8a INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:39:51,446 - lava_callback - INFO - Received callback for node 68d7c4df8dd6b39fd1aeb1bc INFO: 172.21.0.1:44976 - "POST /node/68d7c4df8dd6b39fd1aeb1bc HTTP/1.0" 202 Accepted 2025-09-27 22:39:51,453 - lava_callback - INFO - Starting async job submit for node 68d7c4df8dd6b39fd1aeb1bc 2025-09-27 22:39:51,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:51,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4df8dd6b39fd1aeb1bc HTTP/1.1" 200 None 2025-09-27 22:39:51,486 - lava_callback - DEBUG - Processing node 68d7c4df8dd6b39fd1aeb1bc: baseline-arm64 2025-09-27 22:39:51,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:39:51,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:39:51,942 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4df8dd6b39fd1aeb1bc/log.txt.gz 2025-09-27 22:39:51,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:39:52,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:39:52,088 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4df8dd6b39fd1aeb1bc/lava_callback.json.gz 2025-09-27 22:39:52,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:52,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4df8dd6b39fd1aeb1bc HTTP/1.1" 200 None 2025-09-27 22:39:52,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:52,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:39:52,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:39:52,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4df8dd6b39fd1aeb1bc HTTP/1.1" 200 None 2025-09-27 22:39:52,164 - lava_callback - INFO - Completed processing callback for node 68d7c4df8dd6b39fd1aeb1bc INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:40:38,964 - lava_callback - INFO - Received callback for node 68d5c5ce2be2da466069a806 INFO: 172.21.0.1:44232 - "POST /node/68d5c5ce2be2da466069a806 HTTP/1.0" 202 Accepted 2025-09-27 22:40:38,974 - lava_callback - INFO - Starting async job submit for node 68d5c5ce2be2da466069a806 2025-09-27 22:40:39,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:40:39,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5ce2be2da466069a806 HTTP/1.1" 200 None 2025-09-27 22:40:39,031 - lava_callback - DEBUG - Processing node 68d5c5ce2be2da466069a806: ltp-cap-bounds 2025-09-27 22:40:39,680 - lava_callback - ERROR - Error processing callback for node 68d5c5ce2be2da466069a806: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:40:47,198 - lava_callback - INFO - Received callback for node 68d7c4df8dd6b39fd1aeb1bf INFO: 172.21.0.1:59252 - "POST /node/68d7c4df8dd6b39fd1aeb1bf HTTP/1.0" 202 Accepted 2025-09-27 22:40:47,204 - lava_callback - INFO - Starting async job submit for node 68d7c4df8dd6b39fd1aeb1bf 2025-09-27 22:40:47,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:40:47,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4df8dd6b39fd1aeb1bf HTTP/1.1" 200 None 2025-09-27 22:40:47,240 - lava_callback - DEBUG - Processing node 68d7c4df8dd6b39fd1aeb1bf: baseline-arm64 2025-09-27 22:40:47,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:40:47,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:40:47,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4df8dd6b39fd1aeb1bf/log.txt.gz 2025-09-27 22:40:47,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:40:47,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:40:47,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4df8dd6b39fd1aeb1bf/lava_callback.json.gz 2025-09-27 22:40:47,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:40:47,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4df8dd6b39fd1aeb1bf HTTP/1.1" 200 None 2025-09-27 22:40:47,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:40:47,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:40:47,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:40:47,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4df8dd6b39fd1aeb1bf HTTP/1.1" 200 None 2025-09-27 22:40:47,993 - lava_callback - INFO - Completed processing callback for node 68d7c4df8dd6b39fd1aeb1bf INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:41:09,182 - lava_callback - INFO - Received callback for node 68d7c4e28dd6b39fd1aeb1c2 INFO: 172.21.0.1:36416 - "POST /node/68d7c4e28dd6b39fd1aeb1c2 HTTP/1.0" 202 Accepted 2025-09-27 22:41:09,188 - lava_callback - INFO - Starting async job submit for node 68d7c4e28dd6b39fd1aeb1c2 2025-09-27 22:41:09,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:41:09,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e28dd6b39fd1aeb1c2 HTTP/1.1" 200 None 2025-09-27 22:41:09,223 - lava_callback - DEBUG - Processing node 68d7c4e28dd6b39fd1aeb1c2: baseline-arm64 2025-09-27 22:41:09,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:41:09,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:41:09,695 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e28dd6b39fd1aeb1c2/log.txt.gz 2025-09-27 22:41:09,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:41:09,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:41:09,847 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e28dd6b39fd1aeb1c2/lava_callback.json.gz 2025-09-27 22:41:09,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:41:09,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e28dd6b39fd1aeb1c2 HTTP/1.1" 200 None 2025-09-27 22:41:09,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:41:09,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:41:09,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:41:09,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4e28dd6b39fd1aeb1c2 HTTP/1.1" 200 None 2025-09-27 22:41:09,924 - lava_callback - INFO - Completed processing callback for node 68d7c4e28dd6b39fd1aeb1c2 INFO: 172.21.0.1:46772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:42:04,366 - lava_callback - INFO - Received callback for node 68d7c4e28dd6b39fd1aeb1c5 INFO: 172.21.0.1:37788 - "POST /node/68d7c4e28dd6b39fd1aeb1c5 HTTP/1.0" 202 Accepted 2025-09-27 22:42:04,372 - lava_callback - INFO - Starting async job submit for node 68d7c4e28dd6b39fd1aeb1c5 2025-09-27 22:42:04,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:04,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e28dd6b39fd1aeb1c5 HTTP/1.1" 200 None 2025-09-27 22:42:04,430 - lava_callback - DEBUG - Processing node 68d7c4e28dd6b39fd1aeb1c5: baseline-arm64 2025-09-27 22:42:04,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:42:04,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:42:04,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e28dd6b39fd1aeb1c5/log.txt.gz 2025-09-27 22:42:04,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:42:05,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:42:05,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e28dd6b39fd1aeb1c5/lava_callback.json.gz 2025-09-27 22:42:05,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:05,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e28dd6b39fd1aeb1c5 HTTP/1.1" 200 None 2025-09-27 22:42:05,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:05,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:42:05,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:05,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4e28dd6b39fd1aeb1c5 HTTP/1.1" 200 None 2025-09-27 22:42:05,199 - lava_callback - INFO - Completed processing callback for node 68d7c4e28dd6b39fd1aeb1c5 2025-09-27 22:42:06,400 - lava_callback - INFO - Received callback for node 68d82cfe1fd44e101337fb8d INFO: 172.21.0.1:37790 - "POST /node/68d82cfe1fd44e101337fb8d HTTP/1.0" 202 Accepted 2025-09-27 22:42:06,406 - lava_callback - INFO - Starting async job submit for node 68d82cfe1fd44e101337fb8d 2025-09-27 22:42:06,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:06,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cfe1fd44e101337fb8d HTTP/1.1" 200 None 2025-09-27 22:42:06,439 - lava_callback - DEBUG - Processing node 68d82cfe1fd44e101337fb8d: baseline-arm INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:42:06,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:42:06,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:42:06,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cfe1fd44e101337fb8d/log.txt.gz 2025-09-27 22:42:06,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:42:06,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:42:06,999 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cfe1fd44e101337fb8d/lava_callback.json.gz 2025-09-27 22:42:07,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:07,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cfe1fd44e101337fb8d HTTP/1.1" 200 None 2025-09-27 22:42:07,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:07,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:42:07,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:07,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cfe1fd44e101337fb8d HTTP/1.1" 200 None 2025-09-27 22:42:07,078 - lava_callback - INFO - Completed processing callback for node 68d82cfe1fd44e101337fb8d INFO: 172.21.0.1:40784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:42:28,266 - lava_callback - INFO - Received callback for node 68d7c4e58dd6b39fd1aeb1c8 INFO: 172.21.0.1:47414 - "POST /node/68d7c4e58dd6b39fd1aeb1c8 HTTP/1.0" 202 Accepted 2025-09-27 22:42:28,273 - lava_callback - INFO - Starting async job submit for node 68d7c4e58dd6b39fd1aeb1c8 2025-09-27 22:42:28,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:28,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e58dd6b39fd1aeb1c8 HTTP/1.1" 200 None 2025-09-27 22:42:28,306 - lava_callback - DEBUG - Processing node 68d7c4e58dd6b39fd1aeb1c8: baseline-arm64 2025-09-27 22:42:28,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:42:28,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:42:28,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e58dd6b39fd1aeb1c8/log.txt.gz 2025-09-27 22:42:28,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:42:28,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:42:28,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e58dd6b39fd1aeb1c8/lava_callback.json.gz 2025-09-27 22:42:28,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:28,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e58dd6b39fd1aeb1c8 HTTP/1.1" 200 None 2025-09-27 22:42:29,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:29,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:42:29,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:42:29,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4e58dd6b39fd1aeb1c8 HTTP/1.1" 200 None 2025-09-27 22:42:29,048 - lava_callback - INFO - Completed processing callback for node 68d7c4e58dd6b39fd1aeb1c8 INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:43:24,470 - lava_callback - INFO - Received callback for node 68d7c4e58dd6b39fd1aeb1cb INFO: 172.21.0.1:47082 - "POST /node/68d7c4e58dd6b39fd1aeb1cb HTTP/1.0" 202 Accepted 2025-09-27 22:43:24,476 - lava_callback - INFO - Starting async job submit for node 68d7c4e58dd6b39fd1aeb1cb 2025-09-27 22:43:24,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:24,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e58dd6b39fd1aeb1cb HTTP/1.1" 200 None 2025-09-27 22:43:24,638 - lava_callback - DEBUG - Processing node 68d7c4e58dd6b39fd1aeb1cb: baseline-arm64 2025-09-27 22:43:25,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:43:25,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:43:25,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e58dd6b39fd1aeb1cb/log.txt.gz 2025-09-27 22:43:25,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:43:25,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:43:25,296 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e58dd6b39fd1aeb1cb/lava_callback.json.gz 2025-09-27 22:43:25,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:25,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e58dd6b39fd1aeb1cb HTTP/1.1" 200 None 2025-09-27 22:43:25,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:25,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:43:25,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:25,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4e58dd6b39fd1aeb1cb HTTP/1.1" 200 None 2025-09-27 22:43:25,500 - lava_callback - INFO - Completed processing callback for node 68d7c4e58dd6b39fd1aeb1cb INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:43:37,417 - lava_callback - INFO - Received callback for node 68d5c5962be2da466069a794 INFO: 172.21.0.1:58492 - "POST /node/68d5c5962be2da466069a794 HTTP/1.0" 202 Accepted 2025-09-27 22:43:37,422 - lava_callback - INFO - Starting async job submit for node 68d5c5962be2da466069a794 2025-09-27 22:43:37,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:37,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5962be2da466069a794 HTTP/1.1" 200 None 2025-09-27 22:43:37,436 - lava_callback - DEBUG - Processing node 68d5c5962be2da466069a794: baseline-arm 2025-09-27 22:43:37,436 - lava_callback - ERROR - Error processing callback for node 68d5c5962be2da466069a794: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:43:38,054 - lava_callback - INFO - Received callback for node 68d5c5972be2da466069a797 INFO: 172.21.0.1:58504 - "POST /node/68d5c5972be2da466069a797 HTTP/1.0" 202 Accepted 2025-09-27 22:43:38,060 - lava_callback - INFO - Starting async job submit for node 68d5c5972be2da466069a797 2025-09-27 22:43:38,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:38,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5972be2da466069a797 HTTP/1.1" 200 None 2025-09-27 22:43:38,078 - lava_callback - DEBUG - Processing node 68d5c5972be2da466069a797: baseline-arm 2025-09-27 22:43:38,078 - lava_callback - ERROR - Error processing callback for node 68d5c5972be2da466069a797: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:43:40,012 - lava_callback - INFO - Received callback for node 68d5c2f62be2da466069a684 INFO: 172.21.0.1:51350 - "POST /node/68d5c2f62be2da466069a684 HTTP/1.0" 202 Accepted 2025-09-27 22:43:40,030 - lava_callback - INFO - Starting async job submit for node 68d5c2f62be2da466069a684 2025-09-27 22:43:41,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:41,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2f62be2da466069a684 HTTP/1.1" 200 None 2025-09-27 22:43:41,368 - lava_callback - DEBUG - Processing node 68d5c2f62be2da466069a684: ltp-syscalls INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:43:48,239 - lava_callback - ERROR - Error processing callback for node 68d5c2f62be2da466069a684: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 22:43:51,631 - lava_callback - INFO - Received callback for node 68d7c4e88dd6b39fd1aeb1ce INFO: 172.21.0.1:42056 - "POST /node/68d7c4e88dd6b39fd1aeb1ce HTTP/1.0" 202 Accepted 2025-09-27 22:43:51,637 - lava_callback - INFO - Starting async job submit for node 68d7c4e88dd6b39fd1aeb1ce 2025-09-27 22:43:51,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:51,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e88dd6b39fd1aeb1ce HTTP/1.1" 200 None 2025-09-27 22:43:51,684 - lava_callback - DEBUG - Processing node 68d7c4e88dd6b39fd1aeb1ce: baseline-arm64 2025-09-27 22:43:52,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:43:52,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:43:52,195 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e88dd6b39fd1aeb1ce/log.txt.gz 2025-09-27 22:43:52,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:43:52,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:43:52,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e88dd6b39fd1aeb1ce/lava_callback.json.gz 2025-09-27 22:43:52,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:52,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e88dd6b39fd1aeb1ce HTTP/1.1" 200 None 2025-09-27 22:43:52,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:52,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:43:52,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:52,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4e88dd6b39fd1aeb1ce HTTP/1.1" 200 None 2025-09-27 22:43:52,415 - lava_callback - INFO - Completed processing callback for node 68d7c4e88dd6b39fd1aeb1ce INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:43:57,368 - lava_callback - INFO - Received callback for node 68d5c59f2be2da466069a7ac INFO: 172.21.0.1:42074 - "POST /node/68d5c59f2be2da466069a7ac HTTP/1.0" 202 Accepted 2025-09-27 22:43:57,373 - lava_callback - INFO - Starting async job submit for node 68d5c59f2be2da466069a7ac 2025-09-27 22:43:57,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:57,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c59f2be2da466069a7ac HTTP/1.1" 200 None 2025-09-27 22:43:57,387 - lava_callback - DEBUG - Processing node 68d5c59f2be2da466069a7ac: baseline-arm 2025-09-27 22:43:57,387 - lava_callback - ERROR - Error processing callback for node 68d5c59f2be2da466069a7ac: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:43:58,028 - lava_callback - INFO - Received callback for node 68d5c59f2be2da466069a7af INFO: 172.21.0.1:42086 - "POST /node/68d5c59f2be2da466069a7af HTTP/1.0" 202 Accepted 2025-09-27 22:43:58,034 - lava_callback - INFO - Starting async job submit for node 68d5c59f2be2da466069a7af 2025-09-27 22:43:58,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:43:58,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c59f2be2da466069a7af HTTP/1.1" 200 None 2025-09-27 22:43:58,049 - lava_callback - DEBUG - Processing node 68d5c59f2be2da466069a7af: baseline-arm 2025-09-27 22:43:58,049 - lava_callback - ERROR - Error processing callback for node 68d5c59f2be2da466069a7af: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:44:25,580 - lava_callback - INFO - Received callback for node 68d82cfe1fd44e101337fb90 INFO: 172.21.0.1:36368 - "POST /node/68d82cfe1fd44e101337fb90 HTTP/1.0" 202 Accepted 2025-09-27 22:44:25,586 - lava_callback - INFO - Starting async job submit for node 68d82cfe1fd44e101337fb90 2025-09-27 22:44:25,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:25,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cfe1fd44e101337fb90 HTTP/1.1" 200 None 2025-09-27 22:44:25,624 - lava_callback - DEBUG - Processing node 68d82cfe1fd44e101337fb90: baseline-arm 2025-09-27 22:44:25,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:44:26,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:44:26,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cfe1fd44e101337fb90/log.txt.gz 2025-09-27 22:44:26,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:44:26,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:44:26,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82cfe1fd44e101337fb90/lava_callback.json.gz 2025-09-27 22:44:26,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:26,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82cfe1fd44e101337fb90 HTTP/1.1" 200 None 2025-09-27 22:44:26,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:26,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:44:26,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:26,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82cfe1fd44e101337fb90 HTTP/1.1" 200 None 2025-09-27 22:44:26,271 - lava_callback - INFO - Completed processing callback for node 68d82cfe1fd44e101337fb90 INFO: 172.21.0.1:36382 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:44:28,637 - lava_callback - INFO - Received callback for node 68d5c5b82be2da466069a7e2 INFO: 172.21.0.1:36398 - "POST /node/68d5c5b82be2da466069a7e2 HTTP/1.0" 202 Accepted 2025-09-27 22:44:28,642 - lava_callback - INFO - Starting async job submit for node 68d5c5b82be2da466069a7e2 2025-09-27 22:44:28,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:28,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5b82be2da466069a7e2 HTTP/1.1" 200 None 2025-09-27 22:44:28,655 - lava_callback - DEBUG - Processing node 68d5c5b82be2da466069a7e2: baseline-arm-clabbe 2025-09-27 22:44:28,655 - lava_callback - ERROR - Error processing callback for node 68d5c5b82be2da466069a7e2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:29,289 - lava_callback - INFO - Received callback for node 68d5c5bb2be2da466069a7e5 INFO: 172.21.0.1:36412 - "POST /node/68d5c5bb2be2da466069a7e5 HTTP/1.0" 202 Accepted 2025-09-27 22:44:29,294 - lava_callback - INFO - Starting async job submit for node 68d5c5bb2be2da466069a7e5 2025-09-27 22:44:29,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:29,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5bb2be2da466069a7e5 HTTP/1.1" 200 None 2025-09-27 22:44:29,308 - lava_callback - DEBUG - Processing node 68d5c5bb2be2da466069a7e5: baseline-arm-clabbe 2025-09-27 22:44:29,308 - lava_callback - ERROR - Error processing callback for node 68d5c5bb2be2da466069a7e5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:29,934 - lava_callback - INFO - Received callback for node 68d5c5be2be2da466069a7eb INFO: 172.21.0.1:51828 - "POST /node/68d5c5be2be2da466069a7eb HTTP/1.0" 202 Accepted 2025-09-27 22:44:29,942 - lava_callback - INFO - Starting async job submit for node 68d5c5be2be2da466069a7eb 2025-09-27 22:44:29,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:29,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5be2be2da466069a7eb HTTP/1.1" 200 None 2025-09-27 22:44:29,980 - lava_callback - DEBUG - Processing node 68d5c5be2be2da466069a7eb: baseline-arm-clabbe 2025-09-27 22:44:29,980 - lava_callback - ERROR - Error processing callback for node 68d5c5be2be2da466069a7eb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:30,591 - lava_callback - INFO - Received callback for node 68d5c5c72be2da466069a7fa INFO: 172.21.0.1:51830 - "POST /node/68d5c5c72be2da466069a7fa HTTP/1.0" 202 Accepted 2025-09-27 22:44:30,597 - lava_callback - INFO - Starting async job submit for node 68d5c5c72be2da466069a7fa 2025-09-27 22:44:30,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:30,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5c72be2da466069a7fa HTTP/1.1" 200 None 2025-09-27 22:44:30,610 - lava_callback - DEBUG - Processing node 68d5c5c72be2da466069a7fa: baseline-arm-clabbe 2025-09-27 22:44:30,611 - lava_callback - ERROR - Error processing callback for node 68d5c5c72be2da466069a7fa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:31,258 - lava_callback - INFO - Received callback for node 68d5c5c02be2da466069a7ee INFO: 172.21.0.1:51846 - "POST /node/68d5c5c02be2da466069a7ee HTTP/1.0" 202 Accepted 2025-09-27 22:44:31,264 - lava_callback - INFO - Starting async job submit for node 68d5c5c02be2da466069a7ee 2025-09-27 22:44:31,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:31,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5c02be2da466069a7ee HTTP/1.1" 200 None 2025-09-27 22:44:31,277 - lava_callback - DEBUG - Processing node 68d5c5c02be2da466069a7ee: baseline-arm-clabbe 2025-09-27 22:44:31,277 - lava_callback - ERROR - Error processing callback for node 68d5c5c02be2da466069a7ee: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:31,933 - lava_callback - INFO - Received callback for node 68d5c5c22be2da466069a7f1 INFO: 172.21.0.1:51850 - "POST /node/68d5c5c22be2da466069a7f1 HTTP/1.0" 202 Accepted 2025-09-27 22:44:31,938 - lava_callback - INFO - Starting async job submit for node 68d5c5c22be2da466069a7f1 2025-09-27 22:44:31,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:31,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5c22be2da466069a7f1 HTTP/1.1" 200 None 2025-09-27 22:44:31,952 - lava_callback - DEBUG - Processing node 68d5c5c22be2da466069a7f1: baseline-arm-clabbe 2025-09-27 22:44:31,952 - lava_callback - ERROR - Error processing callback for node 68d5c5c22be2da466069a7f1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:44:47,704 - lava_callback - INFO - Received callback for node 68d7c4e98dd6b39fd1aeb1d1 INFO: 172.21.0.1:57294 - "POST /node/68d7c4e98dd6b39fd1aeb1d1 HTTP/1.0" 202 Accepted 2025-09-27 22:44:47,710 - lava_callback - INFO - Starting async job submit for node 68d7c4e98dd6b39fd1aeb1d1 2025-09-27 22:44:47,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:47,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e98dd6b39fd1aeb1d1 HTTP/1.1" 200 None 2025-09-27 22:44:47,752 - lava_callback - DEBUG - Processing node 68d7c4e98dd6b39fd1aeb1d1: baseline-arm64 2025-09-27 22:44:48,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:44:48,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:44:48,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e98dd6b39fd1aeb1d1/log.txt.gz 2025-09-27 22:44:48,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:44:48,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:44:48,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4e98dd6b39fd1aeb1d1/lava_callback.json.gz 2025-09-27 22:44:48,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:48,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4e98dd6b39fd1aeb1d1 HTTP/1.1" 200 None 2025-09-27 22:44:48,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:48,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:44:48,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:48,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4e98dd6b39fd1aeb1d1 HTTP/1.1" 200 None 2025-09-27 22:44:48,479 - lava_callback - INFO - Completed processing callback for node 68d7c4e98dd6b39fd1aeb1d1 2025-09-27 22:44:56,233 - lava_callback - INFO - Received callback for node 68d5c5d92be2da466069a81a INFO: 172.21.0.1:54970 - "POST /node/68d5c5d92be2da466069a81a HTTP/1.0" 202 Accepted 2025-09-27 22:44:56,239 - lava_callback - INFO - Starting async job submit for node 68d5c5d92be2da466069a81a 2025-09-27 22:44:56,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:56,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5d92be2da466069a81a HTTP/1.1" 200 None 2025-09-27 22:44:56,254 - lava_callback - DEBUG - Processing node 68d5c5d92be2da466069a81a: ltp-fsx 2025-09-27 22:44:56,254 - lava_callback - ERROR - Error processing callback for node 68d5c5d92be2da466069a81a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:44:57,014 - lava_callback - INFO - Received callback for node 68d5c5da2be2da466069a81d INFO: 172.21.0.1:54996 - "POST /node/68d5c5da2be2da466069a81d HTTP/1.0" 202 Accepted 2025-09-27 22:44:57,020 - lava_callback - INFO - Starting async job submit for node 68d5c5da2be2da466069a81d 2025-09-27 22:44:57,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:57,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5da2be2da466069a81d HTTP/1.1" 200 None 2025-09-27 22:44:57,034 - lava_callback - DEBUG - Processing node 68d5c5da2be2da466069a81d: ltp-input 2025-09-27 22:44:57,034 - lava_callback - ERROR - Error processing callback for node 68d5c5da2be2da466069a81d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:57,775 - lava_callback - INFO - Received callback for node 68d5c5dc2be2da466069a820 INFO: 172.21.0.1:55012 - "POST /node/68d5c5dc2be2da466069a820 HTTP/1.0" 202 Accepted 2025-09-27 22:44:57,781 - lava_callback - INFO - Starting async job submit for node 68d5c5dc2be2da466069a820 2025-09-27 22:44:57,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:57,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5dc2be2da466069a820 HTTP/1.1" 200 None 2025-09-27 22:44:57,795 - lava_callback - DEBUG - Processing node 68d5c5dc2be2da466069a820: ltp-ipc 2025-09-27 22:44:57,795 - lava_callback - ERROR - Error processing callback for node 68d5c5dc2be2da466069a820: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:58,494 - lava_callback - INFO - Received callback for node 68d5c5de2be2da466069a823 INFO: 172.21.0.1:55016 - "POST /node/68d5c5de2be2da466069a823 HTTP/1.0" 202 Accepted 2025-09-27 22:44:58,499 - lava_callback - INFO - Starting async job submit for node 68d5c5de2be2da466069a823 2025-09-27 22:44:58,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:58,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5de2be2da466069a823 HTTP/1.1" 200 None 2025-09-27 22:44:58,512 - lava_callback - DEBUG - Processing node 68d5c5de2be2da466069a823: ltp-pty 2025-09-27 22:44:58,513 - lava_callback - ERROR - Error processing callback for node 68d5c5de2be2da466069a823: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:58,871 - lava_callback - INFO - Received callback for node 68d5c5b32be2da466069a7d9 INFO: 172.21.0.1:55032 - "POST /node/68d5c5b32be2da466069a7d9 HTTP/1.0" 202 Accepted 2025-09-27 22:44:58,877 - lava_callback - INFO - Starting async job submit for node 68d5c5b32be2da466069a7d9 2025-09-27 22:44:58,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:58,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5b32be2da466069a7d9 HTTP/1.1" 200 None 2025-09-27 22:44:58,913 - lava_callback - DEBUG - Processing node 68d5c5b32be2da466069a7d9: baseline-arm-broonie 2025-09-27 22:44:59,132 - lava_callback - ERROR - Error processing callback for node 68d5c5b32be2da466069a7d9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 22:44:59,213 - lava_callback - INFO - Received callback for node 68d5c5df2be2da466069a826 INFO: 172.21.0.1:55034 - "POST /node/68d5c5df2be2da466069a826 HTTP/1.0" 202 Accepted 2025-09-27 22:44:59,219 - lava_callback - INFO - Starting async job submit for node 68d5c5df2be2da466069a826 2025-09-27 22:44:59,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:44:59,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5df2be2da466069a826 HTTP/1.1" 200 None 2025-09-27 22:44:59,237 - lava_callback - DEBUG - Processing node 68d5c5df2be2da466069a826: ltp-sched 2025-09-27 22:44:59,237 - lava_callback - ERROR - Error processing callback for node 68d5c5df2be2da466069a826: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:44:59,995 - lava_callback - INFO - Received callback for node 68d5c5e12be2da466069a829 INFO: 172.21.0.1:45856 - "POST /node/68d5c5e12be2da466069a829 HTTP/1.0" 202 Accepted 2025-09-27 22:45:00,001 - lava_callback - INFO - Starting async job submit for node 68d5c5e12be2da466069a829 2025-09-27 22:45:00,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:00,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5e12be2da466069a829 HTTP/1.1" 200 None 2025-09-27 22:45:00,014 - lava_callback - DEBUG - Processing node 68d5c5e12be2da466069a829: ltp-smoketest 2025-09-27 22:45:00,014 - lava_callback - ERROR - Error processing callback for node 68d5c5e12be2da466069a829: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:45:00,720 - lava_callback - INFO - Received callback for node 68d5c5e32be2da466069a82c INFO: 172.21.0.1:45866 - "POST /node/68d5c5e32be2da466069a82c HTTP/1.0" 202 Accepted 2025-09-27 22:45:00,726 - lava_callback - INFO - Starting async job submit for node 68d5c5e32be2da466069a82c 2025-09-27 22:45:00,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:00,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5e32be2da466069a82c HTTP/1.1" 200 None 2025-09-27 22:45:00,741 - lava_callback - DEBUG - Processing node 68d5c5e32be2da466069a82c: ltp-syscalls 2025-09-27 22:45:00,741 - lava_callback - ERROR - Error processing callback for node 68d5c5e32be2da466069a82c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:45:01,517 - lava_callback - INFO - Received callback for node 68d5c5e42be2da466069a82f INFO: 172.21.0.1:45876 - "POST /node/68d5c5e42be2da466069a82f HTTP/1.0" 202 Accepted 2025-09-27 22:45:01,523 - lava_callback - INFO - Starting async job submit for node 68d5c5e42be2da466069a82f 2025-09-27 22:45:01,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:01,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5e42be2da466069a82f HTTP/1.1" 200 None 2025-09-27 22:45:01,543 - lava_callback - DEBUG - Processing node 68d5c5e42be2da466069a82f: ltp-syscalls-ipc 2025-09-27 22:45:01,543 - lava_callback - ERROR - Error processing callback for node 68d5c5e42be2da466069a82f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:45:02,249 - lava_callback - INFO - Received callback for node 68d5c5e62be2da466069a832 INFO: 172.21.0.1:45892 - "POST /node/68d5c5e62be2da466069a832 HTTP/1.0" 202 Accepted 2025-09-27 22:45:02,255 - lava_callback - INFO - Starting async job submit for node 68d5c5e62be2da466069a832 INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:45:02,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:02,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5e62be2da466069a832 HTTP/1.1" 200 None 2025-09-27 22:45:02,271 - lava_callback - DEBUG - Processing node 68d5c5e62be2da466069a832: ltp-timers 2025-09-27 22:45:02,271 - lava_callback - ERROR - Error processing callback for node 68d5c5e62be2da466069a832: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:45:02,962 - lava_callback - INFO - Received callback for node 68d5c5e82be2da466069a835 INFO: 172.21.0.1:45920 - "POST /node/68d5c5e82be2da466069a835 HTTP/1.0" 202 Accepted 2025-09-27 22:45:02,968 - lava_callback - INFO - Starting async job submit for node 68d5c5e82be2da466069a835 2025-09-27 22:45:02,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:02,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5e82be2da466069a835 HTTP/1.1" 200 None 2025-09-27 22:45:02,981 - lava_callback - DEBUG - Processing node 68d5c5e82be2da466069a835: ltp-watchqueue 2025-09-27 22:45:02,981 - lava_callback - ERROR - Error processing callback for node 68d5c5e82be2da466069a835: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:45:03,963 - lava_callback - INFO - Received callback for node 68d7c4eb8dd6b39fd1aeb1d4 INFO: 172.21.0.1:45922 - "POST /node/68d7c4eb8dd6b39fd1aeb1d4 HTTP/1.0" 202 Accepted 2025-09-27 22:45:03,969 - lava_callback - INFO - Starting async job submit for node 68d7c4eb8dd6b39fd1aeb1d4 2025-09-27 22:45:03,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:04,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4eb8dd6b39fd1aeb1d4 HTTP/1.1" 200 None 2025-09-27 22:45:04,007 - lava_callback - DEBUG - Processing node 68d7c4eb8dd6b39fd1aeb1d4: baseline-arm64 2025-09-27 22:45:04,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:45:04,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:45:04,512 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4eb8dd6b39fd1aeb1d4/log.txt.gz 2025-09-27 22:45:04,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:45:04,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:45:04,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4eb8dd6b39fd1aeb1d4/lava_callback.json.gz 2025-09-27 22:45:04,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:04,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4eb8dd6b39fd1aeb1d4 HTTP/1.1" 200 None 2025-09-27 22:45:04,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:04,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:45:04,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:45:04,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4eb8dd6b39fd1aeb1d4 HTTP/1.1" 200 None 2025-09-27 22:45:04,737 - lava_callback - INFO - Completed processing callback for node 68d7c4eb8dd6b39fd1aeb1d4 INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:46:04,737 - lava_callback - INFO - Received callback for node 68d7c4ec8dd6b39fd1aeb1d7 INFO: 172.21.0.1:36252 - "POST /node/68d7c4ec8dd6b39fd1aeb1d7 HTTP/1.0" 202 Accepted 2025-09-27 22:46:04,744 - lava_callback - INFO - Starting async job submit for node 68d7c4ec8dd6b39fd1aeb1d7 2025-09-27 22:46:04,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:04,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4ec8dd6b39fd1aeb1d7 HTTP/1.1" 200 None 2025-09-27 22:46:04,777 - lava_callback - DEBUG - Processing node 68d7c4ec8dd6b39fd1aeb1d7: baseline-arm64 2025-09-27 22:46:05,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:46:05,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:46:05,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4ec8dd6b39fd1aeb1d7/log.txt.gz 2025-09-27 22:46:05,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:46:05,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:46:05,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4ec8dd6b39fd1aeb1d7/lava_callback.json.gz 2025-09-27 22:46:05,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:05,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4ec8dd6b39fd1aeb1d7 HTTP/1.1" 200 None 2025-09-27 22:46:05,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:05,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:46:05,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:05,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4ec8dd6b39fd1aeb1d7 HTTP/1.1" 200 None 2025-09-27 22:46:05,548 - lava_callback - INFO - Completed processing callback for node 68d7c4ec8dd6b39fd1aeb1d7 INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:46:39,001 - lava_callback - INFO - Received callback for node 68d5c8732be2da466069a8da INFO: 172.21.0.1:54450 - "POST /node/68d5c8732be2da466069a8da HTTP/1.0" 202 Accepted 2025-09-27 22:46:39,007 - lava_callback - INFO - Starting async job submit for node 68d5c8732be2da466069a8da 2025-09-27 22:46:39,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:39,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8732be2da466069a8da HTTP/1.1" 200 None 2025-09-27 22:46:39,046 - lava_callback - DEBUG - Processing node 68d5c8732be2da466069a8da: baseline-arm-broonie 2025-09-27 22:46:39,268 - lava_callback - ERROR - Error processing callback for node 68d5c8732be2da466069a8da: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 22:46:46,025 - lava_callback - INFO - Received callback for node 68d82d001fd44e101337fb93 INFO: 172.21.0.1:43670 - "POST /node/68d82d001fd44e101337fb93 HTTP/1.0" 202 Accepted 2025-09-27 22:46:46,031 - lava_callback - INFO - Starting async job submit for node 68d82d001fd44e101337fb93 2025-09-27 22:46:46,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:46,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82d001fd44e101337fb93 HTTP/1.1" 200 None 2025-09-27 22:46:46,065 - lava_callback - DEBUG - Processing node 68d82d001fd44e101337fb93: baseline-arm 2025-09-27 22:46:46,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:46:46,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:46:46,431 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82d001fd44e101337fb93/log.txt.gz 2025-09-27 22:46:46,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:46:46,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:46:46,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82d001fd44e101337fb93/lava_callback.json.gz 2025-09-27 22:46:46,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:46,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82d001fd44e101337fb93 HTTP/1.1" 200 None 2025-09-27 22:46:46,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:46,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:46:46,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:46,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82d001fd44e101337fb93 HTTP/1.1" 200 None 2025-09-27 22:46:46,632 - lava_callback - INFO - Completed processing callback for node 68d82d001fd44e101337fb93 2025-09-27 22:46:53,365 - lava_callback - INFO - Received callback for node 68d7c4ee8dd6b39fd1aeb1da INFO: 172.21.0.1:35744 - "POST /node/68d7c4ee8dd6b39fd1aeb1da HTTP/1.0" 202 Accepted 2025-09-27 22:46:53,374 - lava_callback - INFO - Starting async job submit for node 68d7c4ee8dd6b39fd1aeb1da 2025-09-27 22:46:53,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:53,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4ee8dd6b39fd1aeb1da HTTP/1.1" 200 None 2025-09-27 22:46:53,408 - lava_callback - DEBUG - Processing node 68d7c4ee8dd6b39fd1aeb1da: baseline-arm64 2025-09-27 22:46:53,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:46:53,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:46:53,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4ee8dd6b39fd1aeb1da/log.txt.gz 2025-09-27 22:46:53,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:46:54,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:46:54,023 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4ee8dd6b39fd1aeb1da/lava_callback.json.gz 2025-09-27 22:46:54,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:54,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4ee8dd6b39fd1aeb1da HTTP/1.1" 200 None 2025-09-27 22:46:54,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:54,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:46:54,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:46:54,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4ee8dd6b39fd1aeb1da HTTP/1.1" 200 None 2025-09-27 22:46:54,102 - lava_callback - INFO - Completed processing callback for node 68d7c4ee8dd6b39fd1aeb1da INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:47:31,456 - lava_callback - INFO - Received callback for node 68d7c4ef8dd6b39fd1aeb1dd INFO: 172.21.0.1:35770 - "POST /node/68d7c4ef8dd6b39fd1aeb1dd HTTP/1.0" 202 Accepted 2025-09-27 22:47:31,462 - lava_callback - INFO - Starting async job submit for node 68d7c4ef8dd6b39fd1aeb1dd 2025-09-27 22:47:31,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:47:31,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4ef8dd6b39fd1aeb1dd HTTP/1.1" 200 None 2025-09-27 22:47:31,503 - lava_callback - DEBUG - Processing node 68d7c4ef8dd6b39fd1aeb1dd: baseline-arm64 2025-09-27 22:47:31,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:47:32,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:47:32,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4ef8dd6b39fd1aeb1dd/log.txt.gz 2025-09-27 22:47:32,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:47:32,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:47:32,164 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c4ef8dd6b39fd1aeb1dd/lava_callback.json.gz 2025-09-27 22:47:32,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:47:32,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c4ef8dd6b39fd1aeb1dd HTTP/1.1" 200 None 2025-09-27 22:47:32,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:47:32,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b9dd2f83206171a92b48 HTTP/1.1" 200 None 2025-09-27 22:47:32,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:47:32,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c4ef8dd6b39fd1aeb1dd HTTP/1.1" 200 None 2025-09-27 22:47:32,238 - lava_callback - INFO - Completed processing callback for node 68d7c4ef8dd6b39fd1aeb1dd INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:47:59,212 - lava_callback - INFO - Received callback for node 68d5c5d72be2da466069a817 INFO: 172.21.0.1:49854 - "POST /node/68d5c5d72be2da466069a817 HTTP/1.0" 202 Accepted 2025-09-27 22:47:59,220 - lava_callback - INFO - Starting async job submit for node 68d5c5d72be2da466069a817 2025-09-27 22:47:59,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:47:59,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5d72be2da466069a817 HTTP/1.1" 200 None 2025-09-27 22:47:59,362 - lava_callback - DEBUG - Processing node 68d5c5d72be2da466069a817: ltp-fs-bind 2025-09-27 22:47:59,909 - lava_callback - ERROR - Error processing callback for node 68d5c5d72be2da466069a817: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49926 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:49:05,584 - lava_callback - INFO - Received callback for node 68d82d001fd44e101337fb96 INFO: 172.21.0.1:49940 - "POST /node/68d82d001fd44e101337fb96 HTTP/1.0" 202 Accepted 2025-09-27 22:49:05,590 - lava_callback - INFO - Starting async job submit for node 68d82d001fd44e101337fb96 2025-09-27 22:49:05,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:49:05,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82d001fd44e101337fb96 HTTP/1.1" 200 None 2025-09-27 22:49:05,646 - lava_callback - DEBUG - Processing node 68d82d001fd44e101337fb96: baseline-arm 2025-09-27 22:49:05,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:49:06,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:49:06,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82d001fd44e101337fb96/log.txt.gz 2025-09-27 22:49:06,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:49:06,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:49:06,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82d001fd44e101337fb96/lava_callback.json.gz 2025-09-27 22:49:06,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:49:06,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82d001fd44e101337fb96 HTTP/1.1" 200 None 2025-09-27 22:49:06,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:49:06,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:49:06,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:49:06,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82d001fd44e101337fb96 HTTP/1.1" 200 None 2025-09-27 22:49:06,294 - lava_callback - INFO - Completed processing callback for node 68d82d001fd44e101337fb96 INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:49:29,778 - lava_callback - INFO - Received callback for node 68d5c2c12be2da466069a624 INFO: 172.21.0.1:33364 - "POST /node/68d5c2c12be2da466069a624 HTTP/1.0" 202 Accepted 2025-09-27 22:49:29,784 - lava_callback - INFO - Starting async job submit for node 68d5c2c12be2da466069a624 2025-09-27 22:49:29,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:49:29,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c2c12be2da466069a624 HTTP/1.1" 200 None 2025-09-27 22:49:29,847 - lava_callback - DEBUG - Processing node 68d5c2c12be2da466069a624: baseline-arm 2025-09-27 22:49:30,146 - lava_callback - ERROR - Error processing callback for node 68d5c2c12be2da466069a624: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:49:59,095 - lava_callback - INFO - Received callback for node 68d5c86e2be2da466069a8d1 INFO: 172.21.0.1:33816 - "POST /node/68d5c86e2be2da466069a8d1 HTTP/1.0" 202 Accepted 2025-09-27 22:49:59,100 - lava_callback - INFO - Starting async job submit for node 68d5c86e2be2da466069a8d1 2025-09-27 22:49:59,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:49:59,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c86e2be2da466069a8d1 HTTP/1.1" 200 None 2025-09-27 22:49:59,153 - lava_callback - DEBUG - Processing node 68d5c86e2be2da466069a8d1: baseline-arm-broonie 2025-09-27 22:49:59,345 - lava_callback - ERROR - Error processing callback for node 68d5c86e2be2da466069a8d1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:51:25,435 - lava_callback - INFO - Received callback for node 68d82d021fd44e101337fb99 INFO: 172.21.0.1:33884 - "POST /node/68d82d021fd44e101337fb99 HTTP/1.0" 202 Accepted 2025-09-27 22:51:25,441 - lava_callback - INFO - Starting async job submit for node 68d82d021fd44e101337fb99 2025-09-27 22:51:25,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:51:25,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82d021fd44e101337fb99 HTTP/1.1" 200 None 2025-09-27 22:51:25,500 - lava_callback - DEBUG - Processing node 68d82d021fd44e101337fb99: baseline-arm 2025-09-27 22:51:25,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:51:25,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:51:25,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82d021fd44e101337fb99/log.txt.gz 2025-09-27 22:51:25,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:51:26,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:51:26,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82d021fd44e101337fb99/lava_callback.json.gz 2025-09-27 22:51:26,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:51:26,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82d021fd44e101337fb99 HTTP/1.1" 200 None 2025-09-27 22:51:26,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:51:26,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:51:26,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:51:26,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82d021fd44e101337fb99 HTTP/1.1" 200 None 2025-09-27 22:51:26,185 - lava_callback - INFO - Completed processing callback for node 68d82d021fd44e101337fb99 INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:52:29,747 - lava_callback - INFO - Received callback for node 68d7c22d8dd6b39fd1aeb16e INFO: 172.21.0.1:57166 - "POST /node/68d7c22d8dd6b39fd1aeb16e HTTP/1.0" 202 Accepted 2025-09-27 22:52:29,754 - lava_callback - INFO - Starting async job submit for node 68d7c22d8dd6b39fd1aeb16e 2025-09-27 22:52:29,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:52:29,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c22d8dd6b39fd1aeb16e HTTP/1.1" 200 None 2025-09-27 22:52:29,828 - lava_callback - DEBUG - Processing node 68d7c22d8dd6b39fd1aeb16e: baseline-arm64 2025-09-27 22:52:30,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:52:30,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:52:30,879 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c22d8dd6b39fd1aeb16e/log.txt.gz 2025-09-27 22:52:30,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:52:31,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:52:31,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c22d8dd6b39fd1aeb16e/lava_callback.json.gz DEBUG: Setup failed for 68d7c22d8dd6b39fd1aeb16e. Transitting job node result: incomplete -> fail 2025-09-27 22:52:31,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:52:31,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c22d8dd6b39fd1aeb16e HTTP/1.1" 200 None 2025-09-27 22:52:31,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:52:31,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 22:52:31,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:52:31,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c22d8dd6b39fd1aeb16e HTTP/1.1" 200 None 2025-09-27 22:52:31,242 - lava_callback - INFO - Completed processing callback for node 68d7c22d8dd6b39fd1aeb16e INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:52:59,632 - lava_callback - INFO - Received callback for node 68d5c5d22be2da466069a80e INFO: 172.21.0.1:35762 - "POST /node/68d5c5d22be2da466069a80e HTTP/1.0" 202 Accepted 2025-09-27 22:52:59,642 - lava_callback - INFO - Starting async job submit for node 68d5c5d22be2da466069a80e 2025-09-27 22:52:59,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:52:59,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5d22be2da466069a80e HTTP/1.1" 200 None 2025-09-27 22:52:59,821 - lava_callback - DEBUG - Processing node 68d5c5d22be2da466069a80e: ltp-controllers 2025-09-27 22:53:01,949 - lava_callback - ERROR - Error processing callback for node 68d5c5d22be2da466069a80e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:53:35,940 - lava_callback - INFO - Received callback for node 68d7d1c08dd6b39fd1aeb276 INFO: 172.21.0.1:48260 - "POST /node/68d7d1c08dd6b39fd1aeb276 HTTP/1.0" 202 Accepted 2025-09-27 22:53:35,946 - lava_callback - INFO - Starting async job submit for node 68d7d1c08dd6b39fd1aeb276 2025-09-27 22:53:35,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:53:35,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c08dd6b39fd1aeb276 HTTP/1.1" 200 None 2025-09-27 22:53:35,990 - lava_callback - DEBUG - Processing node 68d7d1c08dd6b39fd1aeb276: baseline-arm64 2025-09-27 22:53:36,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:53:36,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:53:36,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c08dd6b39fd1aeb276/log.txt.gz 2025-09-27 22:53:36,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:53:36,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:53:36,638 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c08dd6b39fd1aeb276/lava_callback.json.gz 2025-09-27 22:53:36,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:53:36,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c08dd6b39fd1aeb276 HTTP/1.1" 200 None 2025-09-27 22:53:36,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:53:36,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 22:53:36,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:53:36,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1c08dd6b39fd1aeb276 HTTP/1.1" 200 None 2025-09-27 22:53:36,755 - lava_callback - INFO - Completed processing callback for node 68d7d1c08dd6b39fd1aeb276 INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41040 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:53:47,123 - lava_callback - INFO - Received callback for node 68d82d021fd44e101337fb9c INFO: 172.21.0.1:41056 - "POST /node/68d82d021fd44e101337fb9c HTTP/1.0" 202 Accepted 2025-09-27 22:53:47,129 - lava_callback - INFO - Starting async job submit for node 68d82d021fd44e101337fb9c 2025-09-27 22:53:47,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:53:47,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82d021fd44e101337fb9c HTTP/1.1" 200 None 2025-09-27 22:53:47,165 - lava_callback - DEBUG - Processing node 68d82d021fd44e101337fb9c: baseline-arm 2025-09-27 22:53:47,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:53:47,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:53:47,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d82d021fd44e101337fb9c/log.txt.gz 2025-09-27 22:53:47,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:53:47,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:53:47,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d82d021fd44e101337fb9c/lava_callback.json.gz 2025-09-27 22:53:47,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:53:47,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d82d021fd44e101337fb9c HTTP/1.1" 200 None 2025-09-27 22:53:47,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:53:47,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a2c3c94e462c68828a7 HTTP/1.1" 200 None 2025-09-27 22:53:47,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:53:47,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d82d021fd44e101337fb9c HTTP/1.1" 200 None 2025-09-27 22:53:47,742 - lava_callback - INFO - Completed processing callback for node 68d82d021fd44e101337fb9c INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:54:19,446 - lava_callback - INFO - Received callback for node 68d5c8b72be2da466069a922 INFO: 172.21.0.1:42054 - "POST /node/68d5c8b72be2da466069a922 HTTP/1.0" 202 Accepted 2025-09-27 22:54:19,452 - lava_callback - INFO - Starting async job submit for node 68d5c8b72be2da466069a922 2025-09-27 22:54:19,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:19,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8b72be2da466069a922 HTTP/1.1" 200 None 2025-09-27 22:54:19,492 - lava_callback - DEBUG - Processing node 68d5c8b72be2da466069a922: ltp-cap-bounds 2025-09-27 22:54:19,849 - lava_callback - ERROR - Error processing callback for node 68d5c8b72be2da466069a922: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:54:44,430 - lava_callback - INFO - Received callback for node 68d7d1c18dd6b39fd1aeb27c INFO: 172.21.0.1:51040 - "POST /node/68d7d1c18dd6b39fd1aeb27c HTTP/1.0" 202 Accepted 2025-09-27 22:54:44,436 - lava_callback - INFO - Starting async job submit for node 68d7d1c18dd6b39fd1aeb27c 2025-09-27 22:54:44,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:44,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c18dd6b39fd1aeb27c HTTP/1.1" 200 None 2025-09-27 22:54:44,470 - lava_callback - DEBUG - Processing node 68d7d1c18dd6b39fd1aeb27c: baseline-arm64 2025-09-27 22:54:44,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:54:44,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:54:44,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c18dd6b39fd1aeb27c/log.txt.gz 2025-09-27 22:54:44,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:54:45,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:54:45,123 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c18dd6b39fd1aeb27c/lava_callback.json.gz 2025-09-27 22:54:45,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:45,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c18dd6b39fd1aeb27c HTTP/1.1" 200 None 2025-09-27 22:54:45,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:45,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 22:54:45,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:45,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1c18dd6b39fd1aeb27c HTTP/1.1" 200 None 2025-09-27 22:54:45,201 - lava_callback - INFO - Completed processing callback for node 68d7d1c18dd6b39fd1aeb27c INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:54:57,906 - lava_callback - INFO - Received callback for node 68d5c8302be2da466069a86e INFO: 172.21.0.1:56462 - "POST /node/68d5c8302be2da466069a86e HTTP/1.0" 202 Accepted 2025-09-27 22:54:57,912 - lava_callback - INFO - Starting async job submit for node 68d5c8302be2da466069a86e 2025-09-27 22:54:57,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:57,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8302be2da466069a86e HTTP/1.1" 200 None 2025-09-27 22:54:57,933 - lava_callback - DEBUG - Processing node 68d5c8302be2da466069a86e: baseline-arm 2025-09-27 22:54:57,933 - lava_callback - ERROR - Error processing callback for node 68d5c8302be2da466069a86e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:54:58,566 - lava_callback - INFO - Received callback for node 68d5c8322be2da466069a871 INFO: 172.21.0.1:56478 - "POST /node/68d5c8322be2da466069a871 HTTP/1.0" 202 Accepted 2025-09-27 22:54:58,571 - lava_callback - INFO - Starting async job submit for node 68d5c8322be2da466069a871 2025-09-27 22:54:58,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:58,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8322be2da466069a871 HTTP/1.1" 200 None 2025-09-27 22:54:58,594 - lava_callback - DEBUG - Processing node 68d5c8322be2da466069a871: baseline-arm 2025-09-27 22:54:58,594 - lava_callback - ERROR - Error processing callback for node 68d5c8322be2da466069a871: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:54:59,214 - lava_callback - INFO - Received callback for node 68d5c8322be2da466069a874 INFO: 172.21.0.1:56494 - "POST /node/68d5c8322be2da466069a874 HTTP/1.0" 202 Accepted 2025-09-27 22:54:59,223 - lava_callback - INFO - Starting async job submit for node 68d5c8322be2da466069a874 2025-09-27 22:54:59,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:59,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8322be2da466069a874 HTTP/1.1" 200 None 2025-09-27 22:54:59,237 - lava_callback - DEBUG - Processing node 68d5c8322be2da466069a874: baseline-arm 2025-09-27 22:54:59,237 - lava_callback - ERROR - Error processing callback for node 68d5c8322be2da466069a874: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:54:59,861 - lava_callback - INFO - Received callback for node 68d5c8402be2da466069a89b INFO: 172.21.0.1:55080 - "POST /node/68d5c8402be2da466069a89b HTTP/1.0" 202 Accepted 2025-09-27 22:54:59,866 - lava_callback - INFO - Starting async job submit for node 68d5c8402be2da466069a89b 2025-09-27 22:54:59,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:54:59,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8402be2da466069a89b HTTP/1.1" 200 None 2025-09-27 22:54:59,897 - lava_callback - DEBUG - Processing node 68d5c8402be2da466069a89b: baseline-arm 2025-09-27 22:54:59,897 - lava_callback - ERROR - Error processing callback for node 68d5c8402be2da466069a89b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:55:00,508 - lava_callback - INFO - Received callback for node 68d5c8402be2da466069a89e INFO: 172.21.0.1:55090 - "POST /node/68d5c8402be2da466069a89e HTTP/1.0" 202 Accepted 2025-09-27 22:55:00,513 - lava_callback - INFO - Starting async job submit for node 68d5c8402be2da466069a89e 2025-09-27 22:55:00,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:55:00,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8402be2da466069a89e HTTP/1.1" 200 None 2025-09-27 22:55:00,531 - lava_callback - DEBUG - Processing node 68d5c8402be2da466069a89e: baseline-arm 2025-09-27 22:55:00,531 - lava_callback - ERROR - Error processing callback for node 68d5c8402be2da466069a89e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:55:17,990 - lava_callback - INFO - Received callback for node 68d5c8422be2da466069a8a1 INFO: 172.21.0.1:54042 - "POST /node/68d5c8422be2da466069a8a1 HTTP/1.0" 202 Accepted 2025-09-27 22:55:17,996 - lava_callback - INFO - Starting async job submit for node 68d5c8422be2da466069a8a1 2025-09-27 22:55:17,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:55:18,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8422be2da466069a8a1 HTTP/1.1" 200 None 2025-09-27 22:55:18,009 - lava_callback - DEBUG - Processing node 68d5c8422be2da466069a8a1: baseline-arm 2025-09-27 22:55:18,009 - lava_callback - ERROR - Error processing callback for node 68d5c8422be2da466069a8a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:55:18,636 - lava_callback - INFO - Received callback for node 68d5c8422be2da466069a8a4 INFO: 172.21.0.1:54052 - "POST /node/68d5c8422be2da466069a8a4 HTTP/1.0" 202 Accepted 2025-09-27 22:55:18,642 - lava_callback - INFO - Starting async job submit for node 68d5c8422be2da466069a8a4 2025-09-27 22:55:18,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:55:18,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8422be2da466069a8a4 HTTP/1.1" 200 None 2025-09-27 22:55:18,673 - lava_callback - DEBUG - Processing node 68d5c8422be2da466069a8a4: baseline-arm 2025-09-27 22:55:18,674 - lava_callback - ERROR - Error processing callback for node 68d5c8422be2da466069a8a4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:56:01,064 - lava_callback - INFO - Received callback for node 68d7d1c48dd6b39fd1aeb27f INFO: 172.21.0.1:50444 - "POST /node/68d7d1c48dd6b39fd1aeb27f HTTP/1.0" 202 Accepted 2025-09-27 22:56:01,071 - lava_callback - INFO - Starting async job submit for node 68d7d1c48dd6b39fd1aeb27f 2025-09-27 22:56:01,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:01,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c48dd6b39fd1aeb27f HTTP/1.1" 200 None 2025-09-27 22:56:01,111 - lava_callback - DEBUG - Processing node 68d7d1c48dd6b39fd1aeb27f: baseline-arm64 2025-09-27 22:56:01,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:56:01,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:56:01,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c48dd6b39fd1aeb27f/log.txt.gz 2025-09-27 22:56:01,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:56:01,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:56:01,898 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c48dd6b39fd1aeb27f/lava_callback.json.gz 2025-09-27 22:56:01,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:01,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c48dd6b39fd1aeb27f HTTP/1.1" 200 None 2025-09-27 22:56:01,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:01,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 22:56:01,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:01,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1c48dd6b39fd1aeb27f HTTP/1.1" 200 None 2025-09-27 22:56:01,978 - lava_callback - INFO - Completed processing callback for node 68d7d1c48dd6b39fd1aeb27f INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:56:08,118 - lava_callback - INFO - Received callback for node 68d830f41fd44e101337fc59 INFO: 172.21.0.1:50452 - "POST /node/68d830f41fd44e101337fc59 HTTP/1.0" 202 Accepted 2025-09-27 22:56:08,125 - lava_callback - INFO - Starting async job submit for node 68d830f41fd44e101337fc59 2025-09-27 22:56:08,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:08,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f41fd44e101337fc59 HTTP/1.1" 200 None 2025-09-27 22:56:08,164 - lava_callback - DEBUG - Processing node 68d830f41fd44e101337fc59: baseline-arm 2025-09-27 22:56:08,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:56:08,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:56:08,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f41fd44e101337fc59/log.txt.gz 2025-09-27 22:56:08,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:56:08,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:56:08,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f41fd44e101337fc59/lava_callback.json.gz 2025-09-27 22:56:08,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:08,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f41fd44e101337fc59 HTTP/1.1" 200 None 2025-09-27 22:56:08,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:08,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 22:56:08,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:08,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d830f41fd44e101337fc59 HTTP/1.1" 200 None 2025-09-27 22:56:08,802 - lava_callback - INFO - Completed processing callback for node 68d830f41fd44e101337fc59 2025-09-27 22:56:09,130 - lava_callback - INFO - Received callback for node 68d5c8782be2da466069a8e3 INFO: 172.21.0.1:50454 - "POST /node/68d5c8782be2da466069a8e3 HTTP/1.0" 202 Accepted 2025-09-27 22:56:09,139 - lava_callback - INFO - Starting async job submit for node 68d5c8782be2da466069a8e3 2025-09-27 22:56:09,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:09,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8782be2da466069a8e3 HTTP/1.1" 200 None 2025-09-27 22:56:09,157 - lava_callback - DEBUG - Processing node 68d5c8782be2da466069a8e3: baseline-arm-clabbe 2025-09-27 22:56:09,157 - lava_callback - ERROR - Error processing callback for node 68d5c8782be2da466069a8e3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:33562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:56:49,102 - lava_callback - INFO - Received callback for node 68d5c8a22be2da466069a8fa INFO: 172.21.0.1:56950 - "POST /node/68d5c8a22be2da466069a8fa HTTP/1.0" 202 Accepted 2025-09-27 22:56:49,108 - lava_callback - INFO - Starting async job submit for node 68d5c8a22be2da466069a8fa 2025-09-27 22:56:49,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:49,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8a22be2da466069a8fa HTTP/1.1" 200 None 2025-09-27 22:56:49,121 - lava_callback - DEBUG - Processing node 68d5c8a22be2da466069a8fa: baseline-arm-clabbe 2025-09-27 22:56:49,121 - lava_callback - ERROR - Error processing callback for node 68d5c8a22be2da466069a8fa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:56:49,768 - lava_callback - INFO - Received callback for node 68d5c8a72be2da466069a907 INFO: 172.21.0.1:50166 - "POST /node/68d5c8a72be2da466069a907 HTTP/1.0" 202 Accepted 2025-09-27 22:56:49,774 - lava_callback - INFO - Starting async job submit for node 68d5c8a72be2da466069a907 2025-09-27 22:56:49,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:49,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8a72be2da466069a907 HTTP/1.1" 200 None 2025-09-27 22:56:49,796 - lava_callback - DEBUG - Processing node 68d5c8a72be2da466069a907: baseline-arm-clabbe 2025-09-27 22:56:49,796 - lava_callback - ERROR - Error processing callback for node 68d5c8a72be2da466069a907: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:56:50,438 - lava_callback - INFO - Received callback for node 68d5c8af2be2da466069a916 INFO: 172.21.0.1:50168 - "POST /node/68d5c8af2be2da466069a916 HTTP/1.0" 202 Accepted 2025-09-27 22:56:50,444 - lava_callback - INFO - Starting async job submit for node 68d5c8af2be2da466069a916 2025-09-27 22:56:50,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:50,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8af2be2da466069a916 HTTP/1.1" 200 None 2025-09-27 22:56:50,474 - lava_callback - DEBUG - Processing node 68d5c8af2be2da466069a916: baseline-arm-clabbe 2025-09-27 22:56:50,474 - lava_callback - ERROR - Error processing callback for node 68d5c8af2be2da466069a916: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:56:51,098 - lava_callback - INFO - Received callback for node 68d5c8a92be2da466069a90a INFO: 172.21.0.1:50178 - "POST /node/68d5c8a92be2da466069a90a HTTP/1.0" 202 Accepted 2025-09-27 22:56:51,104 - lava_callback - INFO - Starting async job submit for node 68d5c8a92be2da466069a90a 2025-09-27 22:56:51,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:51,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8a92be2da466069a90a HTTP/1.1" 200 None 2025-09-27 22:56:51,117 - lava_callback - DEBUG - Processing node 68d5c8a92be2da466069a90a: baseline-arm-clabbe 2025-09-27 22:56:51,117 - lava_callback - ERROR - Error processing callback for node 68d5c8a92be2da466069a90a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:56:51,752 - lava_callback - INFO - Received callback for node 68d5c8aa2be2da466069a90d INFO: 172.21.0.1:50182 - "POST /node/68d5c8aa2be2da466069a90d HTTP/1.0" 202 Accepted 2025-09-27 22:56:51,758 - lava_callback - INFO - Starting async job submit for node 68d5c8aa2be2da466069a90d 2025-09-27 22:56:51,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:51,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8aa2be2da466069a90d HTTP/1.1" 200 None 2025-09-27 22:56:51,771 - lava_callback - DEBUG - Processing node 68d5c8aa2be2da466069a90d: baseline-arm-clabbe 2025-09-27 22:56:51,771 - lava_callback - ERROR - Error processing callback for node 68d5c8aa2be2da466069a90d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:56:59,722 - lava_callback - INFO - Received callback for node 68d5c5d42be2da466069a811 INFO: 172.21.0.1:40224 - "POST /node/68d5c5d42be2da466069a811 HTTP/1.0" 202 Accepted 2025-09-27 22:56:59,729 - lava_callback - INFO - Starting async job submit for node 68d5c5d42be2da466069a811 2025-09-27 22:56:59,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:56:59,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c5d42be2da466069a811 HTTP/1.1" 200 None 2025-09-27 22:56:59,852 - lava_callback - DEBUG - Processing node 68d5c5d42be2da466069a811: ltp-cve 2025-09-27 22:57:00,626 - lava_callback - ERROR - Error processing callback for node 68d5c5d42be2da466069a811: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:57:16,960 - lava_callback - INFO - Received callback for node 68d5c8c02be2da466069a931 INFO: 172.21.0.1:33814 - "POST /node/68d5c8c02be2da466069a931 HTTP/1.0" 202 Accepted 2025-09-27 22:57:16,966 - lava_callback - INFO - Starting async job submit for node 68d5c8c02be2da466069a931 2025-09-27 22:57:16,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:16,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8c02be2da466069a931 HTTP/1.1" 200 None 2025-09-27 22:57:16,981 - lava_callback - DEBUG - Processing node 68d5c8c02be2da466069a931: ltp-fs-bind 2025-09-27 22:57:16,981 - lava_callback - ERROR - Error processing callback for node 68d5c8c02be2da466069a931: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:17,748 - lava_callback - INFO - Received callback for node 68d5c8c12be2da466069a934 INFO: 172.21.0.1:33826 - "POST /node/68d5c8c12be2da466069a934 HTTP/1.0" 202 Accepted 2025-09-27 22:57:17,754 - lava_callback - INFO - Starting async job submit for node 68d5c8c12be2da466069a934 2025-09-27 22:57:17,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:17,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8c12be2da466069a934 HTTP/1.1" 200 None 2025-09-27 22:57:17,767 - lava_callback - DEBUG - Processing node 68d5c8c12be2da466069a934: ltp-fsx 2025-09-27 22:57:17,768 - lava_callback - ERROR - Error processing callback for node 68d5c8c12be2da466069a934: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:18,506 - lava_callback - INFO - Received callback for node 68d5c8c32be2da466069a937 INFO: 172.21.0.1:33836 - "POST /node/68d5c8c32be2da466069a937 HTTP/1.0" 202 Accepted 2025-09-27 22:57:18,512 - lava_callback - INFO - Starting async job submit for node 68d5c8c32be2da466069a937 2025-09-27 22:57:18,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:18,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8c32be2da466069a937 HTTP/1.1" 200 None 2025-09-27 22:57:18,528 - lava_callback - DEBUG - Processing node 68d5c8c32be2da466069a937: ltp-input 2025-09-27 22:57:18,528 - lava_callback - ERROR - Error processing callback for node 68d5c8c32be2da466069a937: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:19,221 - lava_callback - INFO - Received callback for node 68d5c8c52be2da466069a93a INFO: 172.21.0.1:33838 - "POST /node/68d5c8c52be2da466069a93a HTTP/1.0" 202 Accepted 2025-09-27 22:57:19,227 - lava_callback - INFO - Starting async job submit for node 68d5c8c52be2da466069a93a 2025-09-27 22:57:19,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:19,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8c52be2da466069a93a HTTP/1.1" 200 None 2025-09-27 22:57:19,242 - lava_callback - DEBUG - Processing node 68d5c8c52be2da466069a93a: ltp-ipc 2025-09-27 22:57:19,242 - lava_callback - ERROR - Error processing callback for node 68d5c8c52be2da466069a93a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:19,971 - lava_callback - INFO - Received callback for node 68d5c8c62be2da466069a93d INFO: 172.21.0.1:59884 - "POST /node/68d5c8c62be2da466069a93d HTTP/1.0" 202 Accepted 2025-09-27 22:57:19,977 - lava_callback - INFO - Starting async job submit for node 68d5c8c62be2da466069a93d 2025-09-27 22:57:19,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:19,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8c62be2da466069a93d HTTP/1.1" 200 None 2025-09-27 22:57:19,997 - lava_callback - DEBUG - Processing node 68d5c8c62be2da466069a93d: ltp-pty 2025-09-27 22:57:19,997 - lava_callback - ERROR - Error processing callback for node 68d5c8c62be2da466069a93d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:20,699 - lava_callback - INFO - Received callback for node 68d5c8c82be2da466069a940 INFO: 172.21.0.1:59888 - "POST /node/68d5c8c82be2da466069a940 HTTP/1.0" 202 Accepted 2025-09-27 22:57:20,705 - lava_callback - INFO - Starting async job submit for node 68d5c8c82be2da466069a940 2025-09-27 22:57:20,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:20,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8c82be2da466069a940 HTTP/1.1" 200 None 2025-09-27 22:57:20,718 - lava_callback - DEBUG - Processing node 68d5c8c82be2da466069a940: ltp-sched 2025-09-27 22:57:20,718 - lava_callback - ERROR - Error processing callback for node 68d5c8c82be2da466069a940: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:21,433 - lava_callback - INFO - Received callback for node 68d5c8c92be2da466069a943 INFO: 172.21.0.1:59904 - "POST /node/68d5c8c92be2da466069a943 HTTP/1.0" 202 Accepted 2025-09-27 22:57:21,439 - lava_callback - INFO - Starting async job submit for node 68d5c8c92be2da466069a943 2025-09-27 22:57:21,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:21,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8c92be2da466069a943 HTTP/1.1" 200 None 2025-09-27 22:57:21,473 - lava_callback - DEBUG - Processing node 68d5c8c92be2da466069a943: ltp-smoketest 2025-09-27 22:57:21,473 - lava_callback - ERROR - Error processing callback for node 68d5c8c92be2da466069a943: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:22,194 - lava_callback - INFO - Received callback for node 68d5c8cd2be2da466069a949 INFO: 172.21.0.1:59908 - "POST /node/68d5c8cd2be2da466069a949 HTTP/1.0" 202 Accepted 2025-09-27 22:57:22,200 - lava_callback - INFO - Starting async job submit for node 68d5c8cd2be2da466069a949 2025-09-27 22:57:22,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:22,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8cd2be2da466069a949 HTTP/1.1" 200 None 2025-09-27 22:57:22,214 - lava_callback - DEBUG - Processing node 68d5c8cd2be2da466069a949: ltp-syscalls-ipc 2025-09-27 22:57:22,214 - lava_callback - ERROR - Error processing callback for node 68d5c8cd2be2da466069a949: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:22,934 - lava_callback - INFO - Received callback for node 68d5c8ce2be2da466069a94c INFO: 172.21.0.1:59918 - "POST /node/68d5c8ce2be2da466069a94c HTTP/1.0" 202 Accepted 2025-09-27 22:57:22,940 - lava_callback - INFO - Starting async job submit for node 68d5c8ce2be2da466069a94c 2025-09-27 22:57:22,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:22,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8ce2be2da466069a94c HTTP/1.1" 200 None 2025-09-27 22:57:22,954 - lava_callback - DEBUG - Processing node 68d5c8ce2be2da466069a94c: ltp-timers 2025-09-27 22:57:22,954 - lava_callback - ERROR - Error processing callback for node 68d5c8ce2be2da466069a94c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 22:57:23,648 - lava_callback - INFO - Received callback for node 68d5c8d02be2da466069a94f INFO: 172.21.0.1:59922 - "POST /node/68d5c8d02be2da466069a94f HTTP/1.0" 202 Accepted 2025-09-27 22:57:23,654 - lava_callback - INFO - Starting async job submit for node 68d5c8d02be2da466069a94f 2025-09-27 22:57:23,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:23,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8d02be2da466069a94f HTTP/1.1" 200 None 2025-09-27 22:57:23,668 - lava_callback - DEBUG - Processing node 68d5c8d02be2da466069a94f: ltp-watchqueue 2025-09-27 22:57:23,668 - lava_callback - ERROR - Error processing callback for node 68d5c8d02be2da466069a94f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:57:48,378 - lava_callback - INFO - Received callback for node 68d7d1c48dd6b39fd1aeb282 INFO: 172.21.0.1:38698 - "POST /node/68d7d1c48dd6b39fd1aeb282 HTTP/1.0" 202 Accepted 2025-09-27 22:57:48,384 - lava_callback - INFO - Starting async job submit for node 68d7d1c48dd6b39fd1aeb282 2025-09-27 22:57:48,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:48,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c48dd6b39fd1aeb282 HTTP/1.1" 200 None 2025-09-27 22:57:48,418 - lava_callback - DEBUG - Processing node 68d7d1c48dd6b39fd1aeb282: baseline-arm64 2025-09-27 22:57:48,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:57:48,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:57:48,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c48dd6b39fd1aeb282/log.txt.gz 2025-09-27 22:57:48,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:57:49,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:57:49,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c48dd6b39fd1aeb282/lava_callback.json.gz 2025-09-27 22:57:49,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:49,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c48dd6b39fd1aeb282 HTTP/1.1" 200 None 2025-09-27 22:57:49,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:49,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 22:57:49,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:57:49,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1c48dd6b39fd1aeb282 HTTP/1.1" 200 None 2025-09-27 22:57:49,171 - lava_callback - INFO - Completed processing callback for node 68d7d1c48dd6b39fd1aeb282 INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:58:20,695 - lava_callback - INFO - Received callback for node 68d830f51fd44e101337fc5e INFO: 172.21.0.1:39802 - "POST /node/68d830f51fd44e101337fc5e HTTP/1.0" 202 Accepted 2025-09-27 22:58:20,701 - lava_callback - INFO - Starting async job submit for node 68d830f51fd44e101337fc5e 2025-09-27 22:58:20,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:58:20,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f51fd44e101337fc5e HTTP/1.1" 200 None 2025-09-27 22:58:20,744 - lava_callback - DEBUG - Processing node 68d830f51fd44e101337fc5e: baseline-arm 2025-09-27 22:58:21,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:58:21,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:58:21,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f51fd44e101337fc5e/log.txt.gz 2025-09-27 22:58:21,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:58:21,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:58:21,518 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f51fd44e101337fc5e/lava_callback.json.gz 2025-09-27 22:58:21,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:58:21,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f51fd44e101337fc5e HTTP/1.1" 200 None 2025-09-27 22:58:21,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:58:21,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 22:58:21,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:58:21,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d830f51fd44e101337fc5e HTTP/1.1" 200 None 2025-09-27 22:58:21,602 - lava_callback - INFO - Completed processing callback for node 68d830f51fd44e101337fc5e INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:58:56,464 - lava_callback - INFO - Received callback for node 68d7d1c78dd6b39fd1aeb285 INFO: 172.21.0.1:42452 - "POST /node/68d7d1c78dd6b39fd1aeb285 HTTP/1.0" 202 Accepted 2025-09-27 22:58:56,470 - lava_callback - INFO - Starting async job submit for node 68d7d1c78dd6b39fd1aeb285 2025-09-27 22:58:56,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:58:56,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c78dd6b39fd1aeb285 HTTP/1.1" 200 None 2025-09-27 22:58:56,537 - lava_callback - DEBUG - Processing node 68d7d1c78dd6b39fd1aeb285: baseline-arm64 INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:58:56,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:58:57,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:58:57,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c78dd6b39fd1aeb285/log.txt.gz 2025-09-27 22:58:57,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 22:58:57,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 22:58:57,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c78dd6b39fd1aeb285/lava_callback.json.gz 2025-09-27 22:58:57,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:58:57,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c78dd6b39fd1aeb285 HTTP/1.1" 200 None 2025-09-27 22:58:57,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:58:57,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 22:58:57,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:58:57,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1c78dd6b39fd1aeb285 HTTP/1.1" 200 None 2025-09-27 22:58:57,334 - lava_callback - INFO - Completed processing callback for node 68d7d1c78dd6b39fd1aeb285 INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK 2025-09-27 22:59:18,759 - lava_callback - INFO - Received callback for node 68d5c8b92be2da466069a925 INFO: 172.21.0.1:55148 - "POST /node/68d5c8b92be2da466069a925 HTTP/1.0" 202 Accepted 2025-09-27 22:59:18,767 - lava_callback - INFO - Starting async job submit for node 68d5c8b92be2da466069a925 2025-09-27 22:59:18,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 22:59:18,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8b92be2da466069a925 HTTP/1.1" 200 None 2025-09-27 22:59:18,882 - lava_callback - DEBUG - Processing node 68d5c8b92be2da466069a925: ltp-containers 2025-09-27 22:59:19,670 - lava_callback - ERROR - Error processing callback for node 68d5c8b92be2da466069a925: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:00:38,964 - lava_callback - INFO - Received callback for node 68d7d1c88dd6b39fd1aeb288 INFO: 172.21.0.1:37278 - "POST /node/68d7d1c88dd6b39fd1aeb288 HTTP/1.0" 202 Accepted 2025-09-27 23:00:38,971 - lava_callback - INFO - Starting async job submit for node 68d7d1c88dd6b39fd1aeb288 2025-09-27 23:00:38,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:00:39,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c88dd6b39fd1aeb288 HTTP/1.1" 200 None 2025-09-27 23:00:39,024 - lava_callback - DEBUG - Processing node 68d7d1c88dd6b39fd1aeb288: baseline-arm64 2025-09-27 23:00:39,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:00:39,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:00:39,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c88dd6b39fd1aeb288/log.txt.gz 2025-09-27 23:00:39,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:00:39,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:00:39,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1c88dd6b39fd1aeb288/lava_callback.json.gz 2025-09-27 23:00:39,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:00:39,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1c88dd6b39fd1aeb288 HTTP/1.1" 200 None 2025-09-27 23:00:39,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:00:39,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:00:39,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:00:39,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1c88dd6b39fd1aeb288 HTTP/1.1" 200 None 2025-09-27 23:00:39,786 - lava_callback - INFO - Completed processing callback for node 68d7d1c88dd6b39fd1aeb288 INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:00:50,553 - lava_callback - INFO - Received callback for node 68d830f61fd44e101337fc61 INFO: 172.21.0.1:60806 - "POST /node/68d830f61fd44e101337fc61 HTTP/1.0" 202 Accepted 2025-09-27 23:00:50,559 - lava_callback - INFO - Starting async job submit for node 68d830f61fd44e101337fc61 2025-09-27 23:00:50,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:00:50,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f61fd44e101337fc61 HTTP/1.1" 200 None 2025-09-27 23:00:50,592 - lava_callback - DEBUG - Processing node 68d830f61fd44e101337fc61: baseline-arm 2025-09-27 23:00:50,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:00:50,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:00:50,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f61fd44e101337fc61/log.txt.gz 2025-09-27 23:00:50,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:00:51,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:00:51,103 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f61fd44e101337fc61/lava_callback.json.gz 2025-09-27 23:00:51,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:00:51,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f61fd44e101337fc61 HTTP/1.1" 200 None 2025-09-27 23:00:51,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:00:51,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:00:51,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:00:51,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d830f61fd44e101337fc61 HTTP/1.1" 200 None 2025-09-27 23:00:51,204 - lava_callback - INFO - Completed processing callback for node 68d830f61fd44e101337fc61 INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:01:21,603 - lava_callback - INFO - Received callback for node 68d5df1f30c58dac7d94137b INFO: 172.21.0.1:54696 - "POST /node/68d5df1f30c58dac7d94137b HTTP/1.0" 202 Accepted 2025-09-27 23:01:21,609 - lava_callback - INFO - Starting async job submit for node 68d5df1f30c58dac7d94137b 2025-09-27 23:01:21,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:01:21,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df1f30c58dac7d94137b HTTP/1.1" 200 None 2025-09-27 23:01:21,667 - lava_callback - DEBUG - Processing node 68d5df1f30c58dac7d94137b: baseline-arm-broonie 2025-09-27 23:01:21,861 - lava_callback - ERROR - Error processing callback for node 68d5df1f30c58dac7d94137b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:02:27,545 - lava_callback - INFO - Received callback for node 68d7d1ca8dd6b39fd1aeb28b INFO: 172.21.0.1:46110 - "POST /node/68d7d1ca8dd6b39fd1aeb28b HTTP/1.0" 202 Accepted 2025-09-27 23:02:27,552 - lava_callback - INFO - Starting async job submit for node 68d7d1ca8dd6b39fd1aeb28b 2025-09-27 23:02:27,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:02:27,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1ca8dd6b39fd1aeb28b HTTP/1.1" 200 None 2025-09-27 23:02:27,586 - lava_callback - DEBUG - Processing node 68d7d1ca8dd6b39fd1aeb28b: baseline-arm64 2025-09-27 23:02:27,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:02:28,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:02:28,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1ca8dd6b39fd1aeb28b/log.txt.gz 2025-09-27 23:02:28,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:02:28,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:02:28,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1ca8dd6b39fd1aeb28b/lava_callback.json.gz 2025-09-27 23:02:28,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:02:28,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1ca8dd6b39fd1aeb28b HTTP/1.1" 200 None 2025-09-27 23:02:28,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:02:28,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:02:28,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:02:28,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1ca8dd6b39fd1aeb28b HTTP/1.1" 200 None 2025-09-27 23:02:28,376 - lava_callback - INFO - Completed processing callback for node 68d7d1ca8dd6b39fd1aeb28b INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:02:39,480 - lava_callback - INFO - Received callback for node 68d5ca0b2be2da466069a9e1 INFO: 172.21.0.1:54316 - "POST /node/68d5ca0b2be2da466069a9e1 HTTP/1.0" 202 Accepted 2025-09-27 23:02:39,486 - lava_callback - INFO - Starting async job submit for node 68d5ca0b2be2da466069a9e1 2025-09-27 23:02:39,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:02:39,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ca0b2be2da466069a9e1 HTTP/1.1" 200 None 2025-09-27 23:02:39,512 - lava_callback - DEBUG - Processing node 68d5ca0b2be2da466069a9e1: baseline-arm64-baylibre 2025-09-27 23:02:39,512 - lava_callback - ERROR - Error processing callback for node 68d5ca0b2be2da466069a9e1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:03:02,545 - lava_callback - INFO - Received callback for node 68d830f71fd44e101337fc64 INFO: 172.21.0.1:58972 - "POST /node/68d830f71fd44e101337fc64 HTTP/1.0" 202 Accepted 2025-09-27 23:03:02,551 - lava_callback - INFO - Starting async job submit for node 68d830f71fd44e101337fc64 2025-09-27 23:03:02,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:03:02,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f71fd44e101337fc64 HTTP/1.1" 200 None 2025-09-27 23:03:02,603 - lava_callback - DEBUG - Processing node 68d830f71fd44e101337fc64: baseline-arm 2025-09-27 23:03:02,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:03:02,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:03:02,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f71fd44e101337fc64/log.txt.gz 2025-09-27 23:03:02,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:03:03,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:03:03,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f71fd44e101337fc64/lava_callback.json.gz 2025-09-27 23:03:03,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:03,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f71fd44e101337fc64 HTTP/1.1" 200 None 2025-09-27 23:03:03,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:03,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:03:03,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:03,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d830f71fd44e101337fc64 HTTP/1.1" 200 None 2025-09-27 23:03:03,226 - lava_callback - INFO - Completed processing callback for node 68d830f71fd44e101337fc64 INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:03:19,456 - lava_callback - INFO - Received callback for node 68d5ca242be2da466069aa0a INFO: 172.21.0.1:50576 - "POST /node/68d5ca242be2da466069aa0a HTTP/1.0" 202 Accepted 2025-09-27 23:03:19,461 - lava_callback - INFO - Starting async job submit for node 68d5ca242be2da466069aa0a 2025-09-27 23:03:19,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:19,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ca242be2da466069aa0a HTTP/1.1" 200 None 2025-09-27 23:03:19,475 - lava_callback - DEBUG - Processing node 68d5ca242be2da466069aa0a: baseline-arm64-baylibre 2025-09-27 23:03:19,475 - lava_callback - ERROR - Error processing callback for node 68d5ca242be2da466069aa0a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:03:36,151 - lava_callback - INFO - Received callback for node 68d7d1cb8dd6b39fd1aeb28e INFO: 172.21.0.1:41266 - "POST /node/68d7d1cb8dd6b39fd1aeb28e HTTP/1.0" 202 Accepted 2025-09-27 23:03:36,158 - lava_callback - INFO - Starting async job submit for node 68d7d1cb8dd6b39fd1aeb28e 2025-09-27 23:03:36,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:36,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1cb8dd6b39fd1aeb28e HTTP/1.1" 200 None 2025-09-27 23:03:36,226 - lava_callback - DEBUG - Processing node 68d7d1cb8dd6b39fd1aeb28e: baseline-arm64 INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:03:36,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:03:36,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:03:36,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1cb8dd6b39fd1aeb28e/log.txt.gz 2025-09-27 23:03:36,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:03:36,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:03:36,896 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1cb8dd6b39fd1aeb28e/lava_callback.json.gz 2025-09-27 23:03:36,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:36,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1cb8dd6b39fd1aeb28e HTTP/1.1" 200 None 2025-09-27 23:03:36,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:36,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:03:36,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:36,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1cb8dd6b39fd1aeb28e HTTP/1.1" 200 None 2025-09-27 23:03:36,991 - lava_callback - INFO - Completed processing callback for node 68d7d1cb8dd6b39fd1aeb28e INFO: 172.21.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:03:49,442 - lava_callback - INFO - Received callback for node 68d5ca532be2da466069aa3a INFO: 172.21.0.1:57352 - "POST /node/68d5ca532be2da466069aa3a HTTP/1.0" 202 Accepted 2025-09-27 23:03:49,448 - lava_callback - INFO - Starting async job submit for node 68d5ca532be2da466069aa3a 2025-09-27 23:03:49,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:49,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ca532be2da466069aa3a HTTP/1.1" 200 None 2025-09-27 23:03:49,473 - lava_callback - DEBUG - Processing node 68d5ca532be2da466069aa3a: baseline-arm64-clabbe 2025-09-27 23:03:49,473 - lava_callback - ERROR - Error processing callback for node 68d5ca532be2da466069aa3a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:03:50,082 - lava_callback - INFO - Received callback for node 68d5ca4c2be2da466069aa34 INFO: 172.21.0.1:57360 - "POST /node/68d5ca4c2be2da466069aa34 HTTP/1.0" 202 Accepted 2025-09-27 23:03:50,087 - lava_callback - INFO - Starting async job submit for node 68d5ca4c2be2da466069aa34 2025-09-27 23:03:50,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:03:50,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ca4c2be2da466069aa34 HTTP/1.1" 200 None 2025-09-27 23:03:50,100 - lava_callback - DEBUG - Processing node 68d5ca4c2be2da466069aa34: baseline-arm64-clabbe 2025-09-27 23:03:50,100 - lava_callback - ERROR - Error processing callback for node 68d5ca4c2be2da466069aa34: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:04:09,435 - lava_callback - INFO - Received callback for node 68d5ca562be2da466069aa3d INFO: 172.21.0.1:45628 - "POST /node/68d5ca562be2da466069aa3d HTTP/1.0" 202 Accepted 2025-09-27 23:04:09,441 - lava_callback - INFO - Starting async job submit for node 68d5ca562be2da466069aa3d 2025-09-27 23:04:09,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:04:09,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ca562be2da466069aa3d HTTP/1.1" 200 None 2025-09-27 23:04:09,457 - lava_callback - DEBUG - Processing node 68d5ca562be2da466069aa3d: baseline-arm64-clabbe 2025-09-27 23:04:09,457 - lava_callback - ERROR - Error processing callback for node 68d5ca562be2da466069aa3d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:04:10,099 - lava_callback - INFO - Received callback for node 68d5ca5f2be2da466069aa46 INFO: 172.21.0.1:45644 - "POST /node/68d5ca5f2be2da466069aa46 HTTP/1.0" 202 Accepted 2025-09-27 23:04:10,105 - lava_callback - INFO - Starting async job submit for node 68d5ca5f2be2da466069aa46 2025-09-27 23:04:10,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:04:10,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ca5f2be2da466069aa46 HTTP/1.1" 200 None 2025-09-27 23:04:10,137 - lava_callback - DEBUG - Processing node 68d5ca5f2be2da466069aa46: baseline-arm64-clabbe 2025-09-27 23:04:10,137 - lava_callback - ERROR - Error processing callback for node 68d5ca5f2be2da466069aa46: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:04:10,780 - lava_callback - INFO - Received callback for node 68d5ca592be2da466069aa40 INFO: 172.21.0.1:45656 - "POST /node/68d5ca592be2da466069aa40 HTTP/1.0" 202 Accepted 2025-09-27 23:04:10,786 - lava_callback - INFO - Starting async job submit for node 68d5ca592be2da466069aa40 2025-09-27 23:04:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:04:10,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ca592be2da466069aa40 HTTP/1.1" 200 None 2025-09-27 23:04:10,799 - lava_callback - DEBUG - Processing node 68d5ca592be2da466069aa40: baseline-arm64-clabbe 2025-09-27 23:04:10,799 - lava_callback - ERROR - Error processing callback for node 68d5ca592be2da466069aa40: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:04:11,420 - lava_callback - INFO - Received callback for node 68d5ca5c2be2da466069aa43 INFO: 172.21.0.1:45664 - "POST /node/68d5ca5c2be2da466069aa43 HTTP/1.0" 202 Accepted 2025-09-27 23:04:11,425 - lava_callback - INFO - Starting async job submit for node 68d5ca5c2be2da466069aa43 2025-09-27 23:04:11,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:04:11,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5ca5c2be2da466069aa43 HTTP/1.1" 200 None 2025-09-27 23:04:11,438 - lava_callback - DEBUG - Processing node 68d5ca5c2be2da466069aa43: baseline-arm64-clabbe 2025-09-27 23:04:11,438 - lava_callback - ERROR - Error processing callback for node 68d5ca5c2be2da466069aa43: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:45672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:05:14,200 - lava_callback - INFO - Received callback for node 68d7d1cd8dd6b39fd1aeb291 INFO: 172.21.0.1:48288 - "POST /node/68d7d1cd8dd6b39fd1aeb291 HTTP/1.0" 202 Accepted 2025-09-27 23:05:14,207 - lava_callback - INFO - Starting async job submit for node 68d7d1cd8dd6b39fd1aeb291 2025-09-27 23:05:14,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:05:14,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1cd8dd6b39fd1aeb291 HTTP/1.1" 200 None 2025-09-27 23:05:14,267 - lava_callback - DEBUG - Processing node 68d7d1cd8dd6b39fd1aeb291: baseline-arm64 2025-09-27 23:05:14,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:05:14,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:05:14,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1cd8dd6b39fd1aeb291/log.txt.gz 2025-09-27 23:05:14,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:05:15,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:05:15,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1cd8dd6b39fd1aeb291/lava_callback.json.gz 2025-09-27 23:05:15,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:05:15,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1cd8dd6b39fd1aeb291 HTTP/1.1" 200 None 2025-09-27 23:05:15,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:05:15,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:05:15,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:48302 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 23:05:15,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1cd8dd6b39fd1aeb291 HTTP/1.1" 200 None 2025-09-27 23:05:15,190 - lava_callback - INFO - Completed processing callback for node 68d7d1cd8dd6b39fd1aeb291 INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:05:26,443 - lava_callback - INFO - Received callback for node 68d830f81fd44e101337fc67 INFO: 172.21.0.1:37740 - "POST /node/68d830f81fd44e101337fc67 HTTP/1.0" 202 Accepted 2025-09-27 23:05:26,449 - lava_callback - INFO - Starting async job submit for node 68d830f81fd44e101337fc67 2025-09-27 23:05:26,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:05:26,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f81fd44e101337fc67 HTTP/1.1" 200 None 2025-09-27 23:05:26,483 - lava_callback - DEBUG - Processing node 68d830f81fd44e101337fc67: baseline-arm INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:05:26,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:05:26,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:05:26,855 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f81fd44e101337fc67/log.txt.gz 2025-09-27 23:05:26,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:05:26,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:05:26,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f81fd44e101337fc67/lava_callback.json.gz 2025-09-27 23:05:26,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:05:27,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f81fd44e101337fc67 HTTP/1.1" 200 None 2025-09-27 23:05:27,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:05:27,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:05:27,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:05:27,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d830f81fd44e101337fc67 HTTP/1.1" 200 None 2025-09-27 23:05:27,056 - lava_callback - INFO - Completed processing callback for node 68d830f81fd44e101337fc67 INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:05:39,291 - lava_callback - INFO - Received callback for node 68d5df2630c58dac7d9413a1 INFO: 172.21.0.1:45658 - "POST /node/68d5df2630c58dac7d9413a1 HTTP/1.0" 202 Accepted 2025-09-27 23:05:39,298 - lava_callback - INFO - Starting async job submit for node 68d5df2630c58dac7d9413a1 2025-09-27 23:05:39,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:05:39,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2630c58dac7d9413a1 HTTP/1.1" 200 None 2025-09-27 23:05:39,365 - lava_callback - DEBUG - Processing node 68d5df2630c58dac7d9413a1: ltp-cap-bounds 2025-09-27 23:05:39,711 - lava_callback - ERROR - Error processing callback for node 68d5df2630c58dac7d9413a1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:06:17,528 - lava_callback - INFO - Received callback for node 68d7d1ce8dd6b39fd1aeb294 INFO: 172.21.0.1:34912 - "POST /node/68d7d1ce8dd6b39fd1aeb294 HTTP/1.0" 202 Accepted 2025-09-27 23:06:17,534 - lava_callback - INFO - Starting async job submit for node 68d7d1ce8dd6b39fd1aeb294 2025-09-27 23:06:17,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:06:17,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1ce8dd6b39fd1aeb294 HTTP/1.1" 200 None 2025-09-27 23:06:17,567 - lava_callback - DEBUG - Processing node 68d7d1ce8dd6b39fd1aeb294: baseline-arm64 2025-09-27 23:06:17,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:06:18,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:06:18,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1ce8dd6b39fd1aeb294/log.txt.gz 2025-09-27 23:06:18,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:06:18,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:06:18,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1ce8dd6b39fd1aeb294/lava_callback.json.gz 2025-09-27 23:06:18,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:06:18,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1ce8dd6b39fd1aeb294 HTTP/1.1" 200 None 2025-09-27 23:06:18,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:06:18,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:06:18,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:06:18,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1ce8dd6b39fd1aeb294 HTTP/1.1" 200 None 2025-09-27 23:06:18,341 - lava_callback - INFO - Completed processing callback for node 68d7d1ce8dd6b39fd1aeb294 INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:07:19,302 - lava_callback - INFO - Received callback for node 68d7c6ab8dd6b39fd1aeb1fa INFO: 172.21.0.1:49638 - "POST /node/68d7c6ab8dd6b39fd1aeb1fa HTTP/1.0" 202 Accepted 2025-09-27 23:07:19,309 - lava_callback - INFO - Starting async job submit for node 68d7c6ab8dd6b39fd1aeb1fa 2025-09-27 23:07:19,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:19,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c6ab8dd6b39fd1aeb1fa HTTP/1.1" 200 None 2025-09-27 23:07:19,363 - lava_callback - DEBUG - Processing node 68d7c6ab8dd6b39fd1aeb1fa: baseline-arm64 2025-09-27 23:07:20,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:07:20,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:07:20,451 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c6ab8dd6b39fd1aeb1fa/log.txt.gz 2025-09-27 23:07:20,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:07:20,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:07:20,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c6ab8dd6b39fd1aeb1fa/lava_callback.json.gz DEBUG: Setup failed for 68d7c6ab8dd6b39fd1aeb1fa. Transitting job node result: incomplete -> fail 2025-09-27 23:07:20,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:20,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c6ab8dd6b39fd1aeb1fa HTTP/1.1" 200 None 2025-09-27 23:07:20,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:20,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 23:07:20,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:20,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c6ab8dd6b39fd1aeb1fa HTTP/1.1" 200 None 2025-09-27 23:07:20,832 - lava_callback - INFO - Completed processing callback for node 68d7c6ab8dd6b39fd1aeb1fa INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:07:47,290 - lava_callback - INFO - Received callback for node 68d830f91fd44e101337fc6a INFO: 172.21.0.1:38572 - "POST /node/68d830f91fd44e101337fc6a HTTP/1.0" 202 Accepted 2025-09-27 23:07:47,296 - lava_callback - INFO - Starting async job submit for node 68d830f91fd44e101337fc6a 2025-09-27 23:07:47,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:47,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f91fd44e101337fc6a HTTP/1.1" 200 None 2025-09-27 23:07:47,329 - lava_callback - DEBUG - Processing node 68d830f91fd44e101337fc6a: baseline-arm 2025-09-27 23:07:47,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:07:47,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:07:47,698 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f91fd44e101337fc6a/log.txt.gz 2025-09-27 23:07:47,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:07:47,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:07:47,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d830f91fd44e101337fc6a/lava_callback.json.gz 2025-09-27 23:07:47,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:47,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830f91fd44e101337fc6a HTTP/1.1" 200 None 2025-09-27 23:07:47,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:47,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:07:47,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:47,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d830f91fd44e101337fc6a HTTP/1.1" 200 None 2025-09-27 23:07:47,926 - lava_callback - INFO - Completed processing callback for node 68d830f91fd44e101337fc6a INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:07:57,581 - lava_callback - INFO - Received callback for node 68d7c6ab8dd6b39fd1aeb1fd INFO: 172.21.0.1:52476 - "POST /node/68d7c6ab8dd6b39fd1aeb1fd HTTP/1.0" 202 Accepted 2025-09-27 23:07:57,588 - lava_callback - INFO - Starting async job submit for node 68d7c6ab8dd6b39fd1aeb1fd 2025-09-27 23:07:57,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:57,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c6ab8dd6b39fd1aeb1fd HTTP/1.1" 200 None 2025-09-27 23:07:57,650 - lava_callback - DEBUG - Processing node 68d7c6ab8dd6b39fd1aeb1fd: baseline-arm64 2025-09-27 23:07:58,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:07:58,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:07:58,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c6ab8dd6b39fd1aeb1fd/log.txt.gz 2025-09-27 23:07:58,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:07:58,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:07:58,843 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7c6ab8dd6b39fd1aeb1fd/lava_callback.json.gz DEBUG: Setup failed for 68d7c6ab8dd6b39fd1aeb1fd. Transitting job node result: incomplete -> fail 2025-09-27 23:07:58,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:58,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7c6ab8dd6b39fd1aeb1fd HTTP/1.1" 200 None 2025-09-27 23:07:58,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:58,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-27 23:07:58,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:07:59,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7c6ab8dd6b39fd1aeb1fd HTTP/1.1" 200 None 2025-09-27 23:07:59,026 - lava_callback - INFO - Completed processing callback for node 68d7c6ab8dd6b39fd1aeb1fd INFO: 172.21.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:08:12,176 - lava_callback - INFO - Received callback for node 68d7d1d08dd6b39fd1aeb297 INFO: 172.21.0.1:43168 - "POST /node/68d7d1d08dd6b39fd1aeb297 HTTP/1.0" 202 Accepted 2025-09-27 23:08:12,182 - lava_callback - INFO - Starting async job submit for node 68d7d1d08dd6b39fd1aeb297 2025-09-27 23:08:12,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:12,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d08dd6b39fd1aeb297 HTTP/1.1" 200 None 2025-09-27 23:08:12,217 - lava_callback - DEBUG - Processing node 68d7d1d08dd6b39fd1aeb297: baseline-arm64 2025-09-27 23:08:12,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:08:12,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:08:12,732 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d08dd6b39fd1aeb297/log.txt.gz 2025-09-27 23:08:12,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:08:12,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:08:12,860 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d08dd6b39fd1aeb297/lava_callback.json.gz 2025-09-27 23:08:12,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:12,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d08dd6b39fd1aeb297 HTTP/1.1" 200 None 2025-09-27 23:08:12,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:12,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:08:12,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:12,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1d08dd6b39fd1aeb297 HTTP/1.1" 200 None 2025-09-27 23:08:12,939 - lava_callback - INFO - Completed processing callback for node 68d7d1d08dd6b39fd1aeb297 INFO: 172.21.0.1:43174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:08:19,719 - lava_callback - INFO - Received callback for node 68d5cb532be2da466069ab6e INFO: 172.21.0.1:59574 - "POST /node/68d5cb532be2da466069ab6e HTTP/1.0" 202 Accepted 2025-09-27 23:08:19,725 - lava_callback - INFO - Starting async job submit for node 68d5cb532be2da466069ab6e 2025-09-27 23:08:19,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:19,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb532be2da466069ab6e HTTP/1.1" 200 None 2025-09-27 23:08:19,741 - lava_callback - DEBUG - Processing node 68d5cb532be2da466069ab6e: baseline-arm64-baylibre 2025-09-27 23:08:19,741 - lava_callback - ERROR - Error processing callback for node 68d5cb532be2da466069ab6e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:08:39,725 - lava_callback - INFO - Received callback for node 68d5cb6a2be2da466069ab86 INFO: 172.21.0.1:55872 - "POST /node/68d5cb6a2be2da466069ab86 HTTP/1.0" 202 Accepted 2025-09-27 23:08:39,730 - lava_callback - INFO - Starting async job submit for node 68d5cb6a2be2da466069ab86 2025-09-27 23:08:39,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:39,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb6a2be2da466069ab86 HTTP/1.1" 200 None 2025-09-27 23:08:39,744 - lava_callback - DEBUG - Processing node 68d5cb6a2be2da466069ab86: baseline-arm64-baylibre 2025-09-27 23:08:39,744 - lava_callback - ERROR - Error processing callback for node 68d5cb6a2be2da466069ab86: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:55876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:08:50,200 - lava_callback - INFO - Received callback for node 68d7d1d18dd6b39fd1aeb29a INFO: 172.21.0.1:46384 - "POST /node/68d7d1d18dd6b39fd1aeb29a HTTP/1.0" 202 Accepted 2025-09-27 23:08:50,206 - lava_callback - INFO - Starting async job submit for node 68d7d1d18dd6b39fd1aeb29a 2025-09-27 23:08:50,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:50,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d18dd6b39fd1aeb29a HTTP/1.1" 200 None 2025-09-27 23:08:50,240 - lava_callback - DEBUG - Processing node 68d7d1d18dd6b39fd1aeb29a: baseline-arm64 2025-09-27 23:08:50,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:08:50,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:08:50,727 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d18dd6b39fd1aeb29a/log.txt.gz 2025-09-27 23:08:50,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:08:50,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:08:50,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d18dd6b39fd1aeb29a/lava_callback.json.gz 2025-09-27 23:08:50,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:50,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d18dd6b39fd1aeb29a HTTP/1.1" 200 None 2025-09-27 23:08:50,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:50,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:08:50,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:08:50,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1d18dd6b39fd1aeb29a HTTP/1.1" 200 None 2025-09-27 23:08:50,970 - lava_callback - INFO - Completed processing callback for node 68d7d1d18dd6b39fd1aeb29a INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:09:10,469 - lava_callback - INFO - Received callback for node 68d5c8302be2da466069a86b INFO: 172.21.0.1:46628 - "POST /node/68d5c8302be2da466069a86b HTTP/1.0" 202 Accepted 2025-09-27 23:09:10,475 - lava_callback - INFO - Starting async job submit for node 68d5c8302be2da466069a86b 2025-09-27 23:09:10,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:10,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8302be2da466069a86b HTTP/1.1" 200 None 2025-09-27 23:09:10,523 - lava_callback - DEBUG - Processing node 68d5c8302be2da466069a86b: baseline-arm 2025-09-27 23:09:10,795 - lava_callback - ERROR - Error processing callback for node 68d5c8302be2da466069a86b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:46636 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 23:09:16,459 - lava_callback - INFO - Received callback for node 68d7d1d38dd6b39fd1aeb29d INFO: 172.21.0.1:46642 - "POST /node/68d7d1d38dd6b39fd1aeb29d HTTP/1.0" 202 Accepted 2025-09-27 23:09:16,465 - lava_callback - INFO - Starting async job submit for node 68d7d1d38dd6b39fd1aeb29d 2025-09-27 23:09:16,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:16,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d38dd6b39fd1aeb29d HTTP/1.1" 200 None 2025-09-27 23:09:16,499 - lava_callback - DEBUG - Processing node 68d7d1d38dd6b39fd1aeb29d: baseline-arm64 INFO: 172.21.0.1:46652 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:09:16,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:09:17,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:09:17,009 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d38dd6b39fd1aeb29d/log.txt.gz 2025-09-27 23:09:17,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:09:17,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:09:17,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d38dd6b39fd1aeb29d/lava_callback.json.gz 2025-09-27 23:09:17,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:17,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d38dd6b39fd1aeb29d HTTP/1.1" 200 None 2025-09-27 23:09:17,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:17,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:09:17,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:17,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1d38dd6b39fd1aeb29d HTTP/1.1" 200 None 2025-09-27 23:09:17,247 - lava_callback - INFO - Completed processing callback for node 68d7d1d38dd6b39fd1aeb29d INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:09:29,684 - lava_callback - INFO - Received callback for node 68d5cb9b2be2da466069abbe INFO: 172.21.0.1:36986 - "POST /node/68d5cb9b2be2da466069abbe HTTP/1.0" 202 Accepted 2025-09-27 23:09:29,689 - lava_callback - INFO - Starting async job submit for node 68d5cb9b2be2da466069abbe 2025-09-27 23:09:29,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:29,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb9b2be2da466069abbe HTTP/1.1" 200 None 2025-09-27 23:09:29,723 - lava_callback - DEBUG - Processing node 68d5cb9b2be2da466069abbe: baseline-arm64-clabbe 2025-09-27 23:09:29,723 - lava_callback - ERROR - Error processing callback for node 68d5cb9b2be2da466069abbe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:09:29,949 - lava_callback - INFO - Received callback for node 68d7d1d48dd6b39fd1aeb2a0 INFO: 172.21.0.1:36996 - "POST /node/68d7d1d48dd6b39fd1aeb2a0 HTTP/1.0" 202 Accepted 2025-09-27 23:09:29,955 - lava_callback - INFO - Starting async job submit for node 68d7d1d48dd6b39fd1aeb2a0 2025-09-27 23:09:29,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:29,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d48dd6b39fd1aeb2a0 HTTP/1.1" 200 None 2025-09-27 23:09:29,989 - lava_callback - DEBUG - Processing node 68d7d1d48dd6b39fd1aeb2a0: baseline-arm64 2025-09-27 23:09:30,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:09:30,347 - lava_callback - INFO - Received callback for node 68d5cb9e2be2da466069abc1 INFO: 172.21.0.1:37010 - "POST /node/68d5cb9e2be2da466069abc1 HTTP/1.0" 202 Accepted 2025-09-27 23:09:30,352 - lava_callback - INFO - Starting async job submit for node 68d5cb9e2be2da466069abc1 2025-09-27 23:09:30,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:30,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb9e2be2da466069abc1 HTTP/1.1" 200 None 2025-09-27 23:09:30,385 - lava_callback - DEBUG - Processing node 68d5cb9e2be2da466069abc1: baseline-arm64-clabbe 2025-09-27 23:09:30,385 - lava_callback - ERROR - Error processing callback for node 68d5cb9e2be2da466069abc1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:09:30,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:09:30,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d48dd6b39fd1aeb2a0/log.txt.gz 2025-09-27 23:09:30,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:09:30,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:09:30,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d48dd6b39fd1aeb2a0/lava_callback.json.gz 2025-09-27 23:09:30,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:30,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d48dd6b39fd1aeb2a0 HTTP/1.1" 200 None 2025-09-27 23:09:30,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:30,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:09:30,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:30,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1d48dd6b39fd1aeb2a0 HTTP/1.1" 200 None 2025-09-27 23:09:30,728 - lava_callback - INFO - Completed processing callback for node 68d7d1d48dd6b39fd1aeb2a0 2025-09-27 23:09:31,035 - lava_callback - INFO - Received callback for node 68d5cb942be2da466069abb8 INFO: 172.21.0.1:37014 - "POST /node/68d5cb942be2da466069abb8 HTTP/1.0" 202 Accepted 2025-09-27 23:09:31,040 - lava_callback - INFO - Starting async job submit for node 68d5cb942be2da466069abb8 2025-09-27 23:09:31,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:31,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cb942be2da466069abb8 HTTP/1.1" 200 None 2025-09-27 23:09:31,057 - lava_callback - DEBUG - Processing node 68d5cb942be2da466069abb8: baseline-arm64-clabbe 2025-09-27 23:09:31,057 - lava_callback - ERROR - Error processing callback for node 68d5cb942be2da466069abb8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:09:31,702 - lava_callback - INFO - Received callback for node 68d5cba12be2da466069abc4 INFO: 172.21.0.1:37026 - "POST /node/68d5cba12be2da466069abc4 HTTP/1.0" 202 Accepted 2025-09-27 23:09:31,708 - lava_callback - INFO - Starting async job submit for node 68d5cba12be2da466069abc4 2025-09-27 23:09:31,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:31,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cba12be2da466069abc4 HTTP/1.1" 200 None 2025-09-27 23:09:31,722 - lava_callback - DEBUG - Processing node 68d5cba12be2da466069abc4: baseline-arm64-clabbe 2025-09-27 23:09:31,722 - lava_callback - ERROR - Error processing callback for node 68d5cba12be2da466069abc4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:09:32,365 - lava_callback - INFO - Received callback for node 68d5cba32be2da466069abc7 INFO: 172.21.0.1:37040 - "POST /node/68d5cba32be2da466069abc7 HTTP/1.0" 202 Accepted 2025-09-27 23:09:32,370 - lava_callback - INFO - Starting async job submit for node 68d5cba32be2da466069abc7 2025-09-27 23:09:32,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:32,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cba32be2da466069abc7 HTTP/1.1" 200 None 2025-09-27 23:09:32,384 - lava_callback - DEBUG - Processing node 68d5cba32be2da466069abc7: baseline-arm64-clabbe 2025-09-27 23:09:32,384 - lava_callback - ERROR - Error processing callback for node 68d5cba32be2da466069abc7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-27 23:09:33,015 - lava_callback - INFO - Received callback for node 68d5cba62be2da466069abca INFO: 172.21.0.1:37046 - "POST /node/68d5cba62be2da466069abca HTTP/1.0" 202 Accepted 2025-09-27 23:09:33,020 - lava_callback - INFO - Starting async job submit for node 68d5cba62be2da466069abca 2025-09-27 23:09:33,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:09:33,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5cba62be2da466069abca HTTP/1.1" 200 None 2025-09-27 23:09:33,034 - lava_callback - DEBUG - Processing node 68d5cba62be2da466069abca: baseline-arm64-clabbe 2025-09-27 23:09:33,034 - lava_callback - ERROR - Error processing callback for node 68d5cba62be2da466069abca: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 276, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:10:09,779 - lava_callback - INFO - Received callback for node 68d830fa1fd44e101337fc6d INFO: 172.21.0.1:33846 - "POST /node/68d830fa1fd44e101337fc6d HTTP/1.0" 202 Accepted 2025-09-27 23:10:09,786 - lava_callback - INFO - Starting async job submit for node 68d830fa1fd44e101337fc6d 2025-09-27 23:10:09,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:09,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830fa1fd44e101337fc6d HTTP/1.1" 200 None 2025-09-27 23:10:09,823 - lava_callback - DEBUG - Processing node 68d830fa1fd44e101337fc6d: baseline-arm 2025-09-27 23:10:10,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:10:10,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:10:10,229 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d830fa1fd44e101337fc6d/log.txt.gz 2025-09-27 23:10:10,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:10:10,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:10:10,373 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d830fa1fd44e101337fc6d/lava_callback.json.gz 2025-09-27 23:10:10,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:10,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830fa1fd44e101337fc6d HTTP/1.1" 200 None 2025-09-27 23:10:10,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:10,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:10:10,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:10,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d830fa1fd44e101337fc6d HTTP/1.1" 200 None 2025-09-27 23:10:10,472 - lava_callback - INFO - Completed processing callback for node 68d830fa1fd44e101337fc6d INFO: 172.21.0.1:33856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:10:19,227 - lava_callback - INFO - Received callback for node 68d7d1d78dd6b39fd1aeb2a6 INFO: 172.21.0.1:33870 - "POST /node/68d7d1d78dd6b39fd1aeb2a6 HTTP/1.0" 202 Accepted 2025-09-27 23:10:19,233 - lava_callback - INFO - Starting async job submit for node 68d7d1d78dd6b39fd1aeb2a6 2025-09-27 23:10:19,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:19,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d78dd6b39fd1aeb2a6 HTTP/1.1" 200 None 2025-09-27 23:10:19,267 - lava_callback - DEBUG - Processing node 68d7d1d78dd6b39fd1aeb2a6: baseline-arm64 2025-09-27 23:10:19,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:10:19,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:10:19,749 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d78dd6b39fd1aeb2a6/log.txt.gz 2025-09-27 23:10:19,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:10:19,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:10:19,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d78dd6b39fd1aeb2a6/lava_callback.json.gz 2025-09-27 23:10:19,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:19,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d78dd6b39fd1aeb2a6 HTTP/1.1" 200 None 2025-09-27 23:10:19,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:19,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:10:19,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:19,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1d78dd6b39fd1aeb2a6 HTTP/1.1" 200 None 2025-09-27 23:10:19,983 - lava_callback - INFO - Completed processing callback for node 68d7d1d78dd6b39fd1aeb2a6 INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:10:34,697 - lava_callback - INFO - Received callback for node 68d7d1d68dd6b39fd1aeb2a3 INFO: 172.21.0.1:57614 - "POST /node/68d7d1d68dd6b39fd1aeb2a3 HTTP/1.0" 202 Accepted 2025-09-27 23:10:34,704 - lava_callback - INFO - Starting async job submit for node 68d7d1d68dd6b39fd1aeb2a3 2025-09-27 23:10:34,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:34,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d68dd6b39fd1aeb2a3 HTTP/1.1" 200 None 2025-09-27 23:10:34,763 - lava_callback - DEBUG - Processing node 68d7d1d68dd6b39fd1aeb2a3: baseline-arm64 2025-09-27 23:10:35,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:10:35,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:10:35,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d68dd6b39fd1aeb2a3/log.txt.gz 2025-09-27 23:10:35,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:10:35,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:10:35,427 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7d1d68dd6b39fd1aeb2a3/lava_callback.json.gz 2025-09-27 23:10:35,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:35,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7d1d68dd6b39fd1aeb2a3 HTTP/1.1" 200 None 2025-09-27 23:10:35,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:35,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd8e3c94e462c68814f1 HTTP/1.1" 200 None 2025-09-27 23:10:35,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:35,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7d1d68dd6b39fd1aeb2a3 HTTP/1.1" 200 None 2025-09-27 23:10:35,520 - lava_callback - INFO - Completed processing callback for node 68d7d1d68dd6b39fd1aeb2a3 INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:10:45,357 - lava_callback - INFO - Received callback for node 68d7dfd88dd6b39fd1aeb46a INFO: 172.21.0.1:49802 - "POST /node/68d7dfd88dd6b39fd1aeb46a HTTP/1.0" 202 Accepted 2025-09-27 23:10:45,363 - lava_callback - INFO - Starting async job submit for node 68d7dfd88dd6b39fd1aeb46a 2025-09-27 23:10:45,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:45,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfd88dd6b39fd1aeb46a HTTP/1.1" 200 None 2025-09-27 23:10:45,397 - lava_callback - DEBUG - Processing node 68d7dfd88dd6b39fd1aeb46a: baseline-arm64 2025-09-27 23:10:45,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:10:45,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:10:45,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfd88dd6b39fd1aeb46a/log.txt.gz 2025-09-27 23:10:45,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:10:45,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:10:45,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfd88dd6b39fd1aeb46a/lava_callback.json.gz 2025-09-27 23:10:46,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:46,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfd88dd6b39fd1aeb46a HTTP/1.1" 200 None 2025-09-27 23:10:46,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:46,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 23:10:46,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:10:46,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfd88dd6b39fd1aeb46a HTTP/1.1" 200 None 2025-09-27 23:10:46,065 - lava_callback - INFO - Completed processing callback for node 68d7dfd88dd6b39fd1aeb46a INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:11:00,531 - lava_callback - INFO - Received callback for node 68d5c8ba2be2da466069a928 INFO: 172.21.0.1:55208 - "POST /node/68d5c8ba2be2da466069a928 HTTP/1.0" 202 Accepted 2025-09-27 23:11:00,542 - lava_callback - INFO - Starting async job submit for node 68d5c8ba2be2da466069a928 2025-09-27 23:11:00,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:00,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8ba2be2da466069a928 HTTP/1.1" 200 None 2025-09-27 23:11:00,918 - lava_callback - DEBUG - Processing node 68d5c8ba2be2da466069a928: ltp-controllers INFO: 172.21.0.1:55214 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:11:03,740 - lava_callback - ERROR - Error processing callback for node 68d5c8ba2be2da466069a928: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:11:38,806 - lava_callback - INFO - Received callback for node 68d7dfdc8dd6b39fd1aeb472 INFO: 172.21.0.1:34476 - "POST /node/68d7dfdc8dd6b39fd1aeb472 HTTP/1.0" 202 Accepted 2025-09-27 23:11:38,812 - lava_callback - INFO - Starting async job submit for node 68d7dfdc8dd6b39fd1aeb472 2025-09-27 23:11:38,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:38,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfdc8dd6b39fd1aeb472 HTTP/1.1" 200 None 2025-09-27 23:11:38,867 - lava_callback - DEBUG - Processing node 68d7dfdc8dd6b39fd1aeb472: baseline-arm64 2025-09-27 23:11:39,112 - lava_callback - INFO - Received callback for node 68d5df2630c58dac7d9413a5 INFO: 172.21.0.1:34492 - "POST /node/68d5df2630c58dac7d9413a5 HTTP/1.0" 202 Accepted 2025-09-27 23:11:39,135 - lava_callback - INFO - Starting async job submit for node 68d5df2630c58dac7d9413a5 2025-09-27 23:11:39,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:39,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:11:39,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2630c58dac7d9413a5 HTTP/1.1" 200 None 2025-09-27 23:11:39,303 - lava_callback - DEBUG - Processing node 68d5df2630c58dac7d9413a5: ltp-containers 2025-09-27 23:11:39,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:11:39,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfdc8dd6b39fd1aeb472/log.txt.gz 2025-09-27 23:11:39,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:11:39,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:11:39,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfdc8dd6b39fd1aeb472/lava_callback.json.gz 2025-09-27 23:11:39,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:40,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfdc8dd6b39fd1aeb472 HTTP/1.1" 200 None 2025-09-27 23:11:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:40,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 23:11:40,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:40,198 - lava_callback - ERROR - Error processing callback for node 68d5df2630c58dac7d9413a5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 23:11:40,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfdc8dd6b39fd1aeb472 HTTP/1.1" 200 None 2025-09-27 23:11:40,227 - lava_callback - INFO - Completed processing callback for node 68d7dfdc8dd6b39fd1aeb472 INFO: 172.21.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:11:47,026 - lava_callback - INFO - Received callback for node 68d7dfd98dd6b39fd1aeb46f INFO: 172.21.0.1:45596 - "POST /node/68d7dfd98dd6b39fd1aeb46f HTTP/1.0" 202 Accepted 2025-09-27 23:11:47,032 - lava_callback - INFO - Starting async job submit for node 68d7dfd98dd6b39fd1aeb46f 2025-09-27 23:11:47,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:47,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfd98dd6b39fd1aeb46f HTTP/1.1" 200 None 2025-09-27 23:11:47,069 - lava_callback - DEBUG - Processing node 68d7dfd98dd6b39fd1aeb46f: baseline-arm64 2025-09-27 23:11:47,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:11:47,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:11:47,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfd98dd6b39fd1aeb46f/log.txt.gz 2025-09-27 23:11:47,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:11:47,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:11:47,649 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfd98dd6b39fd1aeb46f/lava_callback.json.gz 2025-09-27 23:11:47,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:47,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfd98dd6b39fd1aeb46f HTTP/1.1" 200 None 2025-09-27 23:11:47,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:47,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 23:11:47,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:11:47,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfd98dd6b39fd1aeb46f HTTP/1.1" 200 None 2025-09-27 23:11:47,730 - lava_callback - INFO - Completed processing callback for node 68d7dfd98dd6b39fd1aeb46f INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:12:04,760 - lava_callback - INFO - Received callback for node 68d7dfdd8dd6b39fd1aeb475 INFO: 172.21.0.1:59508 - "POST /node/68d7dfdd8dd6b39fd1aeb475 HTTP/1.0" 202 Accepted 2025-09-27 23:12:04,766 - lava_callback - INFO - Starting async job submit for node 68d7dfdd8dd6b39fd1aeb475 2025-09-27 23:12:04,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:04,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfdd8dd6b39fd1aeb475 HTTP/1.1" 200 None 2025-09-27 23:12:04,803 - lava_callback - DEBUG - Processing node 68d7dfdd8dd6b39fd1aeb475: baseline-arm64 2025-09-27 23:12:05,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:12:05,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:12:05,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfdd8dd6b39fd1aeb475/log.txt.gz 2025-09-27 23:12:05,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:12:05,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:12:05,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfdd8dd6b39fd1aeb475/lava_callback.json.gz 2025-09-27 23:12:05,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:05,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfdd8dd6b39fd1aeb475 HTTP/1.1" 200 None 2025-09-27 23:12:05,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:05,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 23:12:05,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:05,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfdd8dd6b39fd1aeb475 HTTP/1.1" 200 None 2025-09-27 23:12:05,443 - lava_callback - INFO - Completed processing callback for node 68d7dfdd8dd6b39fd1aeb475 INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:12:28,231 - lava_callback - INFO - Received callback for node 68d830fa1fd44e101337fc70 INFO: 172.21.0.1:51514 - "POST /node/68d830fa1fd44e101337fc70 HTTP/1.0" 202 Accepted 2025-09-27 23:12:28,237 - lava_callback - INFO - Starting async job submit for node 68d830fa1fd44e101337fc70 2025-09-27 23:12:28,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:28,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830fa1fd44e101337fc70 HTTP/1.1" 200 None 2025-09-27 23:12:28,281 - lava_callback - DEBUG - Processing node 68d830fa1fd44e101337fc70: baseline-arm 2025-09-27 23:12:28,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:12:28,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:12:28,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d830fa1fd44e101337fc70/log.txt.gz 2025-09-27 23:12:28,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:12:28,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:12:28,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d830fa1fd44e101337fc70/lava_callback.json.gz 2025-09-27 23:12:28,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:28,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d830fa1fd44e101337fc70 HTTP/1.1" 200 None 2025-09-27 23:12:28,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:28,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:12:28,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:28,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d830fa1fd44e101337fc70 HTTP/1.1" 200 None 2025-09-27 23:12:28,956 - lava_callback - INFO - Completed processing callback for node 68d830fa1fd44e101337fc70 INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:12:59,234 - lava_callback - INFO - Received callback for node 68d7dfe08dd6b39fd1aeb47b INFO: 172.21.0.1:44832 - "POST /node/68d7dfe08dd6b39fd1aeb47b HTTP/1.0" 202 Accepted 2025-09-27 23:12:59,241 - lava_callback - INFO - Starting async job submit for node 68d7dfe08dd6b39fd1aeb47b 2025-09-27 23:12:59,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:12:59,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfe08dd6b39fd1aeb47b HTTP/1.1" 200 None 2025-09-27 23:12:59,290 - lava_callback - DEBUG - Processing node 68d7dfe08dd6b39fd1aeb47b: baseline-arm64 2025-09-27 23:12:59,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:12:59,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:12:59,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfe08dd6b39fd1aeb47b/log.txt.gz 2025-09-27 23:12:59,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:12:59,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:12:59,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfe08dd6b39fd1aeb47b/lava_callback.json.gz 2025-09-27 23:13:00,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:00,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfe08dd6b39fd1aeb47b HTTP/1.1" 200 None 2025-09-27 23:13:00,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:00,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 23:13:00,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:00,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfe08dd6b39fd1aeb47b HTTP/1.1" 200 None 2025-09-27 23:13:00,104 - lava_callback - INFO - Completed processing callback for node 68d7dfe08dd6b39fd1aeb47b INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:13:03,640 - lava_callback - INFO - Received callback for node 68d7dfdf8dd6b39fd1aeb478 INFO: 172.21.0.1:36604 - "POST /node/68d7dfdf8dd6b39fd1aeb478 HTTP/1.0" 202 Accepted 2025-09-27 23:13:03,646 - lava_callback - INFO - Starting async job submit for node 68d7dfdf8dd6b39fd1aeb478 2025-09-27 23:13:03,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:03,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfdf8dd6b39fd1aeb478 HTTP/1.1" 200 None 2025-09-27 23:13:03,681 - lava_callback - DEBUG - Processing node 68d7dfdf8dd6b39fd1aeb478: baseline-arm64 2025-09-27 23:13:04,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:13:04,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:13:04,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfdf8dd6b39fd1aeb478/log.txt.gz 2025-09-27 23:13:04,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:13:04,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:13:04,238 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfdf8dd6b39fd1aeb478/lava_callback.json.gz 2025-09-27 23:13:04,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:04,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfdf8dd6b39fd1aeb478 HTTP/1.1" 200 None 2025-09-27 23:13:04,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:04,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 23:13:04,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:04,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfdf8dd6b39fd1aeb478 HTTP/1.1" 200 None 2025-09-27 23:13:04,315 - lava_callback - INFO - Completed processing callback for node 68d7dfdf8dd6b39fd1aeb478 INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:13:24,785 - lava_callback - INFO - Received callback for node 68d7dfe28dd6b39fd1aeb47e INFO: 172.21.0.1:43178 - "POST /node/68d7dfe28dd6b39fd1aeb47e HTTP/1.0" 202 Accepted 2025-09-27 23:13:24,791 - lava_callback - INFO - Starting async job submit for node 68d7dfe28dd6b39fd1aeb47e 2025-09-27 23:13:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:24,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfe28dd6b39fd1aeb47e HTTP/1.1" 200 None 2025-09-27 23:13:24,840 - lava_callback - DEBUG - Processing node 68d7dfe28dd6b39fd1aeb47e: baseline-arm64 2025-09-27 23:13:25,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:13:25,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:13:25,285 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfe28dd6b39fd1aeb47e/log.txt.gz 2025-09-27 23:13:25,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:13:25,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:13:25,434 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfe28dd6b39fd1aeb47e/lava_callback.json.gz 2025-09-27 23:13:25,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:25,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfe28dd6b39fd1aeb47e HTTP/1.1" 200 None 2025-09-27 23:13:25,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:25,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 23:13:25,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:13:25,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfe28dd6b39fd1aeb47e HTTP/1.1" 200 None 2025-09-27 23:13:25,519 - lava_callback - INFO - Completed processing callback for node 68d7dfe28dd6b39fd1aeb47e INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-27 23:14:16,430 - lava_callback - INFO - Received callback for node 68d7e0288dd6b39fd1aeb4ae INFO: 172.21.0.1:47088 - "POST /node/68d7e0288dd6b39fd1aeb4ae HTTP/1.0" 202 Accepted 2025-09-27 23:14:16,438 - lava_callback - INFO - Starting async job submit for node 68d7e0288dd6b39fd1aeb4ae 2025-09-27 23:14:16,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:16,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0288dd6b39fd1aeb4ae HTTP/1.1" 200 None 2025-09-27 23:14:16,492 - lava_callback - DEBUG - Processing node 68d7e0288dd6b39fd1aeb4ae: baseline-arm64 INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:14:16,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:14:16,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:14:16,999 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e0288dd6b39fd1aeb4ae/log.txt.gz 2025-09-27 23:14:17,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:14:17,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:14:17,153 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e0288dd6b39fd1aeb4ae/lava_callback.json.gz 2025-09-27 23:14:17,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:17,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0288dd6b39fd1aeb4ae HTTP/1.1" 200 None 2025-09-27 23:14:17,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:17,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:14:17,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:17,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e0288dd6b39fd1aeb4ae HTTP/1.1" 200 None 2025-09-27 23:14:17,238 - lava_callback - INFO - Completed processing callback for node 68d7e0288dd6b39fd1aeb4ae INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:14:29,300 - lava_callback - INFO - Received callback for node 68d7dfe38dd6b39fd1aeb481 INFO: 172.21.0.1:50864 - "POST /node/68d7dfe38dd6b39fd1aeb481 HTTP/1.0" 202 Accepted 2025-09-27 23:14:29,306 - lava_callback - INFO - Starting async job submit for node 68d7dfe38dd6b39fd1aeb481 2025-09-27 23:14:29,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:29,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfe38dd6b39fd1aeb481 HTTP/1.1" 200 None 2025-09-27 23:14:29,340 - lava_callback - DEBUG - Processing node 68d7dfe38dd6b39fd1aeb481: baseline-arm64 2025-09-27 23:14:29,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:14:29,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:14:29,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfe38dd6b39fd1aeb481/log.txt.gz 2025-09-27 23:14:29,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:14:29,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:14:29,949 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7dfe38dd6b39fd1aeb481/lava_callback.json.gz 2025-09-27 23:14:29,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:29,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7dfe38dd6b39fd1aeb481 HTTP/1.1" 200 None 2025-09-27 23:14:29,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:29,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e52a6a7b6615d4c4172 HTTP/1.1" 200 None 2025-09-27 23:14:29,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:30,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7dfe38dd6b39fd1aeb481 HTTP/1.1" 200 None 2025-09-27 23:14:30,037 - lava_callback - INFO - Completed processing callback for node 68d7dfe38dd6b39fd1aeb481 INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:14:47,202 - lava_callback - INFO - Received callback for node 68d831341fd44e101337fc98 INFO: 172.21.0.1:39128 - "POST /node/68d831341fd44e101337fc98 HTTP/1.0" 202 Accepted 2025-09-27 23:14:47,208 - lava_callback - INFO - Starting async job submit for node 68d831341fd44e101337fc98 2025-09-27 23:14:47,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:47,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831341fd44e101337fc98 HTTP/1.1" 200 None 2025-09-27 23:14:47,262 - lava_callback - DEBUG - Processing node 68d831341fd44e101337fc98: baseline-arm 2025-09-27 23:14:47,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:14:47,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:14:47,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d831341fd44e101337fc98/log.txt.gz 2025-09-27 23:14:47,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:14:47,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:14:47,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d831341fd44e101337fc98/lava_callback.json.gz 2025-09-27 23:14:47,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:47,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831341fd44e101337fc98 HTTP/1.1" 200 None 2025-09-27 23:14:47,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:47,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:14:47,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:47,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d831341fd44e101337fc98 HTTP/1.1" 200 None 2025-09-27 23:14:47,842 - lava_callback - INFO - Completed processing callback for node 68d831341fd44e101337fc98 2025-09-27 23:14:50,502 - lava_callback - INFO - Received callback for node 68d7e0288dd6b39fd1aeb4b1 INFO: 172.21.0.1:42514 - "POST /node/68d7e0288dd6b39fd1aeb4b1 HTTP/1.0" 202 Accepted 2025-09-27 23:14:50,510 - lava_callback - INFO - Starting async job submit for node 68d7e0288dd6b39fd1aeb4b1 2025-09-27 23:14:50,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:50,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0288dd6b39fd1aeb4b1 HTTP/1.1" 200 None 2025-09-27 23:14:50,548 - lava_callback - DEBUG - Processing node 68d7e0288dd6b39fd1aeb4b1: baseline-arm64 2025-09-27 23:14:50,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:14:51,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:14:51,022 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e0288dd6b39fd1aeb4b1/log.txt.gz 2025-09-27 23:14:51,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:14:51,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:14:51,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e0288dd6b39fd1aeb4b1/lava_callback.json.gz 2025-09-27 23:14:51,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:51,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0288dd6b39fd1aeb4b1 HTTP/1.1" 200 None 2025-09-27 23:14:51,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:51,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:14:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:14:51,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e0288dd6b39fd1aeb4b1 HTTP/1.1" 200 None 2025-09-27 23:14:51,225 - lava_callback - INFO - Completed processing callback for node 68d7e0288dd6b39fd1aeb4b1 INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:15:24,088 - lava_callback - INFO - Received callback for node 68d7e02b8dd6b39fd1aeb4b4 INFO: 172.21.0.1:47970 - "POST /node/68d7e02b8dd6b39fd1aeb4b4 HTTP/1.0" 202 Accepted 2025-09-27 23:15:24,095 - lava_callback - INFO - Starting async job submit for node 68d7e02b8dd6b39fd1aeb4b4 2025-09-27 23:15:24,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:15:24,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e02b8dd6b39fd1aeb4b4 HTTP/1.1" 200 None 2025-09-27 23:15:24,148 - lava_callback - DEBUG - Processing node 68d7e02b8dd6b39fd1aeb4b4: baseline-arm64 2025-09-27 23:15:24,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:15:24,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:15:24,658 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e02b8dd6b39fd1aeb4b4/log.txt.gz 2025-09-27 23:15:24,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:15:24,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:15:24,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e02b8dd6b39fd1aeb4b4/lava_callback.json.gz 2025-09-27 23:15:24,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:15:24,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e02b8dd6b39fd1aeb4b4 HTTP/1.1" 200 None 2025-09-27 23:15:24,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:15:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:15:24,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:15:24,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e02b8dd6b39fd1aeb4b4 HTTP/1.1" 200 None 2025-09-27 23:15:24,898 - lava_callback - INFO - Completed processing callback for node 68d7e02b8dd6b39fd1aeb4b4 INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:15:50,588 - lava_callback - INFO - Received callback for node 68d7e02b8dd6b39fd1aeb4b7 INFO: 172.21.0.1:39938 - "POST /node/68d7e02b8dd6b39fd1aeb4b7 HTTP/1.0" 202 Accepted 2025-09-27 23:15:50,594 - lava_callback - INFO - Starting async job submit for node 68d7e02b8dd6b39fd1aeb4b7 2025-09-27 23:15:50,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:15:50,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e02b8dd6b39fd1aeb4b7 HTTP/1.1" 200 None 2025-09-27 23:15:50,627 - lava_callback - DEBUG - Processing node 68d7e02b8dd6b39fd1aeb4b7: baseline-arm64 2025-09-27 23:15:50,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:15:51,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:15:51,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e02b8dd6b39fd1aeb4b7/log.txt.gz 2025-09-27 23:15:51,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:15:51,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:15:51,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e02b8dd6b39fd1aeb4b7/lava_callback.json.gz 2025-09-27 23:15:51,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:15:51,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e02b8dd6b39fd1aeb4b7 HTTP/1.1" 200 None 2025-09-27 23:15:51,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:15:51,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:15:51,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:15:51,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e02b8dd6b39fd1aeb4b7 HTTP/1.1" 200 None 2025-09-27 23:15:51,355 - lava_callback - INFO - Completed processing callback for node 68d7e02b8dd6b39fd1aeb4b7 INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:17:03,289 - lava_callback - INFO - Received callback for node 68d831351fd44e101337fc9b INFO: 172.21.0.1:42074 - "POST /node/68d831351fd44e101337fc9b HTTP/1.0" 202 Accepted 2025-09-27 23:17:03,295 - lava_callback - INFO - Starting async job submit for node 68d831351fd44e101337fc9b 2025-09-27 23:17:03,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:03,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831351fd44e101337fc9b HTTP/1.1" 200 None 2025-09-27 23:17:03,331 - lava_callback - DEBUG - Processing node 68d831351fd44e101337fc9b: baseline-arm 2025-09-27 23:17:03,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:17:03,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:17:03,741 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d831351fd44e101337fc9b/log.txt.gz 2025-09-27 23:17:03,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:17:03,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:17:03,896 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d831351fd44e101337fc9b/lava_callback.json.gz 2025-09-27 23:17:03,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:03,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831351fd44e101337fc9b HTTP/1.1" 200 None 2025-09-27 23:17:03,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:03,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:17:03,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:04,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d831351fd44e101337fc9b HTTP/1.1" 200 None 2025-09-27 23:17:04,016 - lava_callback - INFO - Completed processing callback for node 68d831351fd44e101337fc9b INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:17:09,027 - lava_callback - INFO - Received callback for node 68d7e02e8dd6b39fd1aeb4bd INFO: 172.21.0.1:42082 - "POST /node/68d7e02e8dd6b39fd1aeb4bd HTTP/1.0" 202 Accepted 2025-09-27 23:17:09,035 - lava_callback - INFO - Starting async job submit for node 68d7e02e8dd6b39fd1aeb4bd 2025-09-27 23:17:09,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:09,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e02e8dd6b39fd1aeb4bd HTTP/1.1" 200 None 2025-09-27 23:17:09,075 - lava_callback - DEBUG - Processing node 68d7e02e8dd6b39fd1aeb4bd: baseline-arm64 2025-09-27 23:17:09,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:17:09,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:17:09,589 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e02e8dd6b39fd1aeb4bd/log.txt.gz 2025-09-27 23:17:09,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:17:09,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:17:09,718 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e02e8dd6b39fd1aeb4bd/lava_callback.json.gz 2025-09-27 23:17:09,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:09,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e02e8dd6b39fd1aeb4bd HTTP/1.1" 200 None 2025-09-27 23:17:09,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:09,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:17:09,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:09,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e02e8dd6b39fd1aeb4bd HTTP/1.1" 200 None 2025-09-27 23:17:09,810 - lava_callback - INFO - Completed processing callback for node 68d7e02e8dd6b39fd1aeb4bd 2025-09-27 23:17:10,556 - lava_callback - INFO - Received callback for node 68d7e02e8dd6b39fd1aeb4ba INFO: 172.21.0.1:39600 - "POST /node/68d7e02e8dd6b39fd1aeb4ba HTTP/1.0" 202 Accepted 2025-09-27 23:17:10,563 - lava_callback - INFO - Starting async job submit for node 68d7e02e8dd6b39fd1aeb4ba 2025-09-27 23:17:10,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:10,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e02e8dd6b39fd1aeb4ba HTTP/1.1" 200 None 2025-09-27 23:17:10,597 - lava_callback - DEBUG - Processing node 68d7e02e8dd6b39fd1aeb4ba: baseline-arm64 2025-09-27 23:17:10,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:17:11,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:17:11,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e02e8dd6b39fd1aeb4ba/log.txt.gz 2025-09-27 23:17:11,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:17:11,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:17:11,208 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e02e8dd6b39fd1aeb4ba/lava_callback.json.gz 2025-09-27 23:17:11,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:11,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e02e8dd6b39fd1aeb4ba HTTP/1.1" 200 None 2025-09-27 23:17:11,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:11,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:17:11,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:11,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e02e8dd6b39fd1aeb4ba HTTP/1.1" 200 None 2025-09-27 23:17:11,326 - lava_callback - INFO - Completed processing callback for node 68d7e02e8dd6b39fd1aeb4ba INFO: 172.21.0.1:39612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:17:34,640 - lava_callback - INFO - Received callback for node 68d7e0318dd6b39fd1aeb4c0 INFO: 172.21.0.1:56350 - "POST /node/68d7e0318dd6b39fd1aeb4c0 HTTP/1.0" 202 Accepted 2025-09-27 23:17:34,646 - lava_callback - INFO - Starting async job submit for node 68d7e0318dd6b39fd1aeb4c0 2025-09-27 23:17:34,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:34,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0318dd6b39fd1aeb4c0 HTTP/1.1" 200 None 2025-09-27 23:17:34,686 - lava_callback - DEBUG - Processing node 68d7e0318dd6b39fd1aeb4c0: baseline-arm64 2025-09-27 23:17:35,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:17:35,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:17:35,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e0318dd6b39fd1aeb4c0/log.txt.gz 2025-09-27 23:17:35,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:17:35,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:17:35,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e0318dd6b39fd1aeb4c0/lava_callback.json.gz 2025-09-27 23:17:35,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:35,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0318dd6b39fd1aeb4c0 HTTP/1.1" 200 None 2025-09-27 23:17:35,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:35,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:17:35,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:17:35,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e0318dd6b39fd1aeb4c0 HTTP/1.1" 200 None 2025-09-27 23:17:35,384 - lava_callback - INFO - Completed processing callback for node 68d7e0318dd6b39fd1aeb4c0 INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:18:31,454 - lava_callback - INFO - Received callback for node 68d7e0318dd6b39fd1aeb4c3 INFO: 172.21.0.1:60312 - "POST /node/68d7e0318dd6b39fd1aeb4c3 HTTP/1.0" 202 Accepted 2025-09-27 23:18:31,460 - lava_callback - INFO - Starting async job submit for node 68d7e0318dd6b39fd1aeb4c3 2025-09-27 23:18:31,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:18:31,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0318dd6b39fd1aeb4c3 HTTP/1.1" 200 None 2025-09-27 23:18:31,522 - lava_callback - DEBUG - Processing node 68d7e0318dd6b39fd1aeb4c3: baseline-arm64 2025-09-27 23:18:31,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:18:32,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:18:32,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e0318dd6b39fd1aeb4c3/log.txt.gz 2025-09-27 23:18:32,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:18:32,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:18:32,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e0318dd6b39fd1aeb4c3/lava_callback.json.gz 2025-09-27 23:18:32,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:18:32,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e0318dd6b39fd1aeb4c3 HTTP/1.1" 200 None 2025-09-27 23:18:32,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:18:32,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:18:32,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:18:32,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e0318dd6b39fd1aeb4c3 HTTP/1.1" 200 None 2025-09-27 23:18:32,266 - lava_callback - INFO - Completed processing callback for node 68d7e0318dd6b39fd1aeb4c3 INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50432 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:19:20,688 - lava_callback - INFO - Received callback for node 68d5c8bc2be2da466069a92b INFO: 172.21.0.1:33962 - "POST /node/68d5c8bc2be2da466069a92b HTTP/1.0" 202 Accepted 2025-09-27 23:19:20,696 - lava_callback - INFO - Starting async job submit for node 68d5c8bc2be2da466069a92b 2025-09-27 23:19:20,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:19:20,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8bc2be2da466069a92b HTTP/1.1" 200 None 2025-09-27 23:19:20,833 - lava_callback - DEBUG - Processing node 68d5c8bc2be2da466069a92b: ltp-cve 2025-09-27 23:19:21,590 - lava_callback - ERROR - Error processing callback for node 68d5c8bc2be2da466069a92b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-27 23:19:25,856 - lava_callback - INFO - Received callback for node 68d831361fd44e101337fc9e INFO: 172.21.0.1:33964 - "POST /node/68d831361fd44e101337fc9e HTTP/1.0" 202 Accepted 2025-09-27 23:19:25,862 - lava_callback - INFO - Starting async job submit for node 68d831361fd44e101337fc9e 2025-09-27 23:19:25,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:19:25,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831361fd44e101337fc9e HTTP/1.1" 200 None 2025-09-27 23:19:25,895 - lava_callback - DEBUG - Processing node 68d831361fd44e101337fc9e: baseline-arm 2025-09-27 23:19:26,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:19:26,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:19:26,242 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d831361fd44e101337fc9e/log.txt.gz 2025-09-27 23:19:26,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:19:26,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:19:26,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d831361fd44e101337fc9e/lava_callback.json.gz 2025-09-27 23:19:26,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:19:26,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831361fd44e101337fc9e HTTP/1.1" 200 None 2025-09-27 23:19:26,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:19:26,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:19:26,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:19:26,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d831361fd44e101337fc9e HTTP/1.1" 200 None 2025-09-27 23:19:26,448 - lava_callback - INFO - Completed processing callback for node 68d831361fd44e101337fc9e INFO: 172.21.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:21:37,444 - lava_callback - INFO - Received callback for node 68d831371fd44e101337fca1 INFO: 172.21.0.1:48558 - "POST /node/68d831371fd44e101337fca1 HTTP/1.0" 202 Accepted 2025-09-27 23:21:37,450 - lava_callback - INFO - Starting async job submit for node 68d831371fd44e101337fca1 2025-09-27 23:21:37,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:21:37,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831371fd44e101337fca1 HTTP/1.1" 200 None 2025-09-27 23:21:37,483 - lava_callback - DEBUG - Processing node 68d831371fd44e101337fca1: baseline-arm 2025-09-27 23:21:37,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:21:37,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:21:37,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d831371fd44e101337fca1/log.txt.gz 2025-09-27 23:21:37,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:21:38,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:21:38,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d831371fd44e101337fca1/lava_callback.json.gz 2025-09-27 23:21:38,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:21:38,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831371fd44e101337fca1 HTTP/1.1" 200 None 2025-09-27 23:21:38,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:21:38,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:21:38,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:21:38,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d831371fd44e101337fca1 HTTP/1.1" 200 None 2025-09-27 23:21:38,245 - lava_callback - INFO - Completed processing callback for node 68d831371fd44e101337fca1 INFO: 172.21.0.1:33234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:23:49,675 - lava_callback - INFO - Received callback for node 68d831381fd44e101337fca4 INFO: 172.21.0.1:53972 - "POST /node/68d831381fd44e101337fca4 HTTP/1.0" 202 Accepted 2025-09-27 23:23:49,680 - lava_callback - INFO - Starting async job submit for node 68d831381fd44e101337fca4 2025-09-27 23:23:49,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:23:49,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831381fd44e101337fca4 HTTP/1.1" 200 None 2025-09-27 23:23:49,714 - lava_callback - DEBUG - Processing node 68d831381fd44e101337fca4: baseline-arm 2025-09-27 23:23:49,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:23:50,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:23:50,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d831381fd44e101337fca4/log.txt.gz 2025-09-27 23:23:50,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:23:50,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:23:50,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d831381fd44e101337fca4/lava_callback.json.gz 2025-09-27 23:23:50,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:23:50,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831381fd44e101337fca4 HTTP/1.1" 200 None 2025-09-27 23:23:50,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:23:50,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:23:50,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:23:50,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d831381fd44e101337fca4 HTTP/1.1" 200 None 2025-09-27 23:23:50,358 - lava_callback - INFO - Completed processing callback for node 68d831381fd44e101337fca4 INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:26:07,059 - lava_callback - INFO - Received callback for node 68d831391fd44e101337fca7 INFO: 172.21.0.1:47914 - "POST /node/68d831391fd44e101337fca7 HTTP/1.0" 202 Accepted 2025-09-27 23:26:07,065 - lava_callback - INFO - Starting async job submit for node 68d831391fd44e101337fca7 2025-09-27 23:26:07,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:26:07,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831391fd44e101337fca7 HTTP/1.1" 200 None 2025-09-27 23:26:07,098 - lava_callback - DEBUG - Processing node 68d831391fd44e101337fca7: baseline-arm 2025-09-27 23:26:07,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:26:07,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:26:07,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d831391fd44e101337fca7/log.txt.gz 2025-09-27 23:26:07,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:26:07,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:26:07,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d831391fd44e101337fca7/lava_callback.json.gz 2025-09-27 23:26:07,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:26:07,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d831391fd44e101337fca7 HTTP/1.1" 200 None 2025-09-27 23:26:07,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:26:07,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:26:07,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:26:07,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d831391fd44e101337fca7 HTTP/1.1" 200 None 2025-09-27 23:26:07,749 - lava_callback - INFO - Completed processing callback for node 68d831391fd44e101337fca7 INFO: 172.21.0.1:41812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:26:40,757 - lava_callback - INFO - Received callback for node 68d5df2830c58dac7d9413b3 INFO: 172.21.0.1:45340 - "POST /node/68d5df2830c58dac7d9413b3 HTTP/1.0" 202 Accepted 2025-09-27 23:26:40,764 - lava_callback - INFO - Starting async job submit for node 68d5df2830c58dac7d9413b3 2025-09-27 23:26:40,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:26:40,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2830c58dac7d9413b3 HTTP/1.1" 200 None 2025-09-27 23:26:40,886 - lava_callback - DEBUG - Processing node 68d5df2830c58dac7d9413b3: ltp-fs-bind 2025-09-27 23:26:41,448 - lava_callback - ERROR - Error processing callback for node 68d5df2830c58dac7d9413b3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:45346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:28:27,234 - lava_callback - INFO - Received callback for node 68d8313a1fd44e101337fcaa INFO: 172.21.0.1:58446 - "POST /node/68d8313a1fd44e101337fcaa HTTP/1.0" 202 Accepted 2025-09-27 23:28:27,240 - lava_callback - INFO - Starting async job submit for node 68d8313a1fd44e101337fcaa 2025-09-27 23:28:27,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:28:27,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8313a1fd44e101337fcaa HTTP/1.1" 200 None 2025-09-27 23:28:27,282 - lava_callback - DEBUG - Processing node 68d8313a1fd44e101337fcaa: baseline-arm 2025-09-27 23:28:27,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:28:27,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:28:27,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d8313a1fd44e101337fcaa/log.txt.gz 2025-09-27 23:28:27,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:28:27,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:28:27,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d8313a1fd44e101337fcaa/lava_callback.json.gz 2025-09-27 23:28:27,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:28:27,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8313a1fd44e101337fcaa HTTP/1.1" 200 None 2025-09-27 23:28:27,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:28:27,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:28:27,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:28:27,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8313a1fd44e101337fcaa HTTP/1.1" 200 None 2025-09-27 23:28:27,923 - lava_callback - INFO - Completed processing callback for node 68d8313a1fd44e101337fcaa INFO: 172.21.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:28:50,869 - lava_callback - INFO - Received callback for node 68d5df1c30c58dac7d941369 INFO: 172.21.0.1:49206 - "POST /node/68d5df1c30c58dac7d941369 HTTP/1.0" 202 Accepted 2025-09-27 23:28:50,875 - lava_callback - INFO - Starting async job submit for node 68d5df1c30c58dac7d941369 2025-09-27 23:28:50,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:28:50,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df1c30c58dac7d941369 HTTP/1.1" 200 None 2025-09-27 23:28:50,918 - lava_callback - DEBUG - Processing node 68d5df1c30c58dac7d941369: baseline-arm 2025-09-27 23:28:51,191 - lava_callback - ERROR - Error processing callback for node 68d5df1c30c58dac7d941369: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:30:22,283 - lava_callback - INFO - Received callback for node 68d5df2730c58dac7d9413a8 INFO: 172.21.0.1:40412 - "POST /node/68d5df2730c58dac7d9413a8 HTTP/1.0" 202 Accepted 2025-09-27 23:30:22,291 - lava_callback - INFO - Starting async job submit for node 68d5df2730c58dac7d9413a8 2025-09-27 23:30:22,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:30:22,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2730c58dac7d9413a8 HTTP/1.1" 200 None 2025-09-27 23:30:22,331 - lava_callback - DEBUG - Processing node 68d5df2730c58dac7d9413a8: ltp-controllers 2025-09-27 23:30:23,229 - lava_callback - ERROR - Error processing callback for node 68d5df2730c58dac7d9413a8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:30:41,349 - lava_callback - INFO - Received callback for node 68d8313b1fd44e101337fcad INFO: 172.21.0.1:50282 - "POST /node/68d8313b1fd44e101337fcad HTTP/1.0" 202 Accepted 2025-09-27 23:30:41,356 - lava_callback - INFO - Starting async job submit for node 68d8313b1fd44e101337fcad 2025-09-27 23:30:41,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:30:41,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8313b1fd44e101337fcad HTTP/1.1" 200 None 2025-09-27 23:30:41,420 - lava_callback - DEBUG - Processing node 68d8313b1fd44e101337fcad: baseline-arm 2025-09-27 23:30:41,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:30:41,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:30:41,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d8313b1fd44e101337fcad/log.txt.gz 2025-09-27 23:30:41,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:30:41,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:30:41,953 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d8313b1fd44e101337fcad/lava_callback.json.gz 2025-09-27 23:30:41,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:30:41,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8313b1fd44e101337fcad HTTP/1.1" 200 None 2025-09-27 23:30:41,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:30:42,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72e3fa6a7b6615d4c4163 HTTP/1.1" 200 None 2025-09-27 23:30:42,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:30:42,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8313b1fd44e101337fcad HTTP/1.1" 200 None 2025-09-27 23:30:42,034 - lava_callback - INFO - Completed processing callback for node 68d8313b1fd44e101337fcad INFO: 172.21.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:31:00,868 - lava_callback - INFO - Received callback for node 68d5df2930c58dac7d9413b7 INFO: 172.21.0.1:60028 - "POST /node/68d5df2930c58dac7d9413b7 HTTP/1.0" 202 Accepted 2025-09-27 23:31:00,874 - lava_callback - INFO - Starting async job submit for node 68d5df2930c58dac7d9413b7 2025-09-27 23:31:00,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:31:00,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2930c58dac7d9413b7 HTTP/1.1" 200 None 2025-09-27 23:31:00,913 - lava_callback - DEBUG - Processing node 68d5df2930c58dac7d9413b7: ltp-fsx 2025-09-27 23:31:01,240 - lava_callback - ERROR - Error processing callback for node 68d5df2930c58dac7d9413b7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:34:21,761 - lava_callback - INFO - Received callback for node 68d5df2730c58dac7d9413ab INFO: 172.21.0.1:40994 - "POST /node/68d5df2730c58dac7d9413ab HTTP/1.0" 202 Accepted 2025-09-27 23:34:21,768 - lava_callback - INFO - Starting async job submit for node 68d5df2730c58dac7d9413ab 2025-09-27 23:34:21,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:34:21,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2730c58dac7d9413ab HTTP/1.1" 200 None 2025-09-27 23:34:21,915 - lava_callback - DEBUG - Processing node 68d5df2730c58dac7d9413ab: ltp-cve 2025-09-27 23:34:22,635 - lava_callback - ERROR - Error processing callback for node 68d5df2730c58dac7d9413ab: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:34:41,168 - lava_callback - INFO - Received callback for node 68d5df2930c58dac7d9413ba INFO: 172.21.0.1:44860 - "POST /node/68d5df2930c58dac7d9413ba HTTP/1.0" 202 Accepted 2025-09-27 23:34:41,174 - lava_callback - INFO - Starting async job submit for node 68d5df2930c58dac7d9413ba 2025-09-27 23:34:41,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:34:41,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2930c58dac7d9413ba HTTP/1.1" 200 None 2025-09-27 23:34:41,218 - lava_callback - DEBUG - Processing node 68d5df2930c58dac7d9413ba: ltp-input 2025-09-27 23:34:41,653 - lava_callback - ERROR - Error processing callback for node 68d5df2930c58dac7d9413ba: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:35:21,057 - lava_callback - INFO - Received callback for node 68d5df2a30c58dac7d9413bd INFO: 172.21.0.1:39302 - "POST /node/68d5df2a30c58dac7d9413bd HTTP/1.0" 202 Accepted 2025-09-27 23:35:21,063 - lava_callback - INFO - Starting async job submit for node 68d5df2a30c58dac7d9413bd 2025-09-27 23:35:21,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:35:21,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2a30c58dac7d9413bd HTTP/1.1" 200 None 2025-09-27 23:35:21,103 - lava_callback - DEBUG - Processing node 68d5df2a30c58dac7d9413bd: ltp-ipc 2025-09-27 23:35:21,440 - lava_callback - ERROR - Error processing callback for node 68d5df2a30c58dac7d9413bd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:37:30,718 - lava_callback - INFO - Received callback for node 68d7e5798dd6b39fd1aeb4f3 INFO: 172.21.0.1:41546 - "POST /node/68d7e5798dd6b39fd1aeb4f3 HTTP/1.0" 202 Accepted 2025-09-27 23:37:30,726 - lava_callback - INFO - Starting async job submit for node 68d7e5798dd6b39fd1aeb4f3 2025-09-27 23:37:30,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:37:30,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e5798dd6b39fd1aeb4f3 HTTP/1.1" 200 None 2025-09-27 23:37:30,781 - lava_callback - DEBUG - Processing node 68d7e5798dd6b39fd1aeb4f3: baseline-arm64 2025-09-27 23:37:31,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:37:31,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:37:31,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e5798dd6b39fd1aeb4f3/log.txt.gz 2025-09-27 23:37:31,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:37:32,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:37:32,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e5798dd6b39fd1aeb4f3/lava_callback.json.gz DEBUG: Setup failed for 68d7e5798dd6b39fd1aeb4f3. Transitting job node result: incomplete -> fail 2025-09-27 23:37:32,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:37:32,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e5798dd6b39fd1aeb4f3 HTTP/1.1" 200 None 2025-09-27 23:37:32,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:37:32,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 23:37:32,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:37:32,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e5798dd6b39fd1aeb4f3 HTTP/1.1" 200 None 2025-09-27 23:37:32,158 - lava_callback - INFO - Completed processing callback for node 68d7e5798dd6b39fd1aeb4f3 INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:37:42,327 - lava_callback - INFO - Received callback for node 68d5c8cb2be2da466069a946 INFO: 172.21.0.1:34786 - "POST /node/68d5c8cb2be2da466069a946 HTTP/1.0" 202 Accepted 2025-09-27 23:37:42,345 - lava_callback - INFO - Starting async job submit for node 68d5c8cb2be2da466069a946 2025-09-27 23:37:43,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:37:43,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5c8cb2be2da466069a946 HTTP/1.1" 200 None 2025-09-27 23:37:43,674 - lava_callback - DEBUG - Processing node 68d5c8cb2be2da466069a946: ltp-syscalls INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:37:50,742 - lava_callback - ERROR - Error processing callback for node 68d5c8cb2be2da466069a946: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:38:00,389 - lava_callback - INFO - Received callback for node 68d7e57a8dd6b39fd1aeb4f6 INFO: 172.21.0.1:49128 - "POST /node/68d7e57a8dd6b39fd1aeb4f6 HTTP/1.0" 202 Accepted 2025-09-27 23:38:00,396 - lava_callback - INFO - Starting async job submit for node 68d7e57a8dd6b39fd1aeb4f6 2025-09-27 23:38:00,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:00,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e57a8dd6b39fd1aeb4f6 HTTP/1.1" 200 None 2025-09-27 23:38:00,459 - lava_callback - DEBUG - Processing node 68d7e57a8dd6b39fd1aeb4f6: baseline-arm64 2025-09-27 23:38:01,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:38:01,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:38:01,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e57a8dd6b39fd1aeb4f6/log.txt.gz 2025-09-27 23:38:01,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:38:01,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:38:01,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e57a8dd6b39fd1aeb4f6/lava_callback.json.gz DEBUG: Setup failed for 68d7e57a8dd6b39fd1aeb4f6. Transitting job node result: incomplete -> fail 2025-09-27 23:38:01,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:01,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e57a8dd6b39fd1aeb4f6 HTTP/1.1" 200 None 2025-09-27 23:38:01,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:01,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 23:38:01,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:01,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e57a8dd6b39fd1aeb4f6 HTTP/1.1" 200 None 2025-09-27 23:38:01,855 - lava_callback - INFO - Completed processing callback for node 68d7e57a8dd6b39fd1aeb4f6 INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55504 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:38:47,083 - lava_callback - INFO - Received callback for node 68d846161fd44e101337feb8 INFO: 172.21.0.1:55520 - "POST /node/68d846161fd44e101337feb8 HTTP/1.0" 202 Accepted 2025-09-27 23:38:47,089 - lava_callback - INFO - Starting async job submit for node 68d846161fd44e101337feb8 2025-09-27 23:38:47,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:47,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846161fd44e101337feb8 HTTP/1.1" 200 None 2025-09-27 23:38:47,132 - lava_callback - DEBUG - Processing node 68d846161fd44e101337feb8: baseline-arm 2025-09-27 23:38:47,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:38:47,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:38:47,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d846161fd44e101337feb8/log.txt.gz 2025-09-27 23:38:47,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:38:47,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:38:47,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d846161fd44e101337feb8/lava_callback.json.gz 2025-09-27 23:38:47,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:47,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846161fd44e101337feb8 HTTP/1.1" 200 None 2025-09-27 23:38:47,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:47,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 23:38:47,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:47,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d846161fd44e101337feb8 HTTP/1.1" 200 None 2025-09-27 23:38:47,787 - lava_callback - INFO - Completed processing callback for node 68d846161fd44e101337feb8 INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:38:59,904 - lava_callback - INFO - Received callback for node 68d7e5968dd6b39fd1aeb4fc INFO: 172.21.0.1:56872 - "POST /node/68d7e5968dd6b39fd1aeb4fc HTTP/1.0" 202 Accepted 2025-09-27 23:38:59,911 - lava_callback - INFO - Starting async job submit for node 68d7e5968dd6b39fd1aeb4fc 2025-09-27 23:38:59,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:38:59,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e5968dd6b39fd1aeb4fc HTTP/1.1" 200 None 2025-09-27 23:38:59,965 - lava_callback - DEBUG - Processing node 68d7e5968dd6b39fd1aeb4fc: baseline-arm64 2025-09-27 23:39:00,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:39:00,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:39:00,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e5968dd6b39fd1aeb4fc/log.txt.gz 2025-09-27 23:39:00,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:39:01,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:39:01,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e5968dd6b39fd1aeb4fc/lava_callback.json.gz DEBUG: Setup failed for 68d7e5968dd6b39fd1aeb4fc. Transitting job node result: incomplete -> fail 2025-09-27 23:39:01,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:39:01,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e5968dd6b39fd1aeb4fc HTTP/1.1" 200 None 2025-09-27 23:39:01,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:39:01,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 23:39:01,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:39:01,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e5968dd6b39fd1aeb4fc HTTP/1.1" 200 None 2025-09-27 23:39:01,320 - lava_callback - INFO - Completed processing callback for node 68d7e5968dd6b39fd1aeb4fc INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:39:21,040 - lava_callback - INFO - Received callback for node 68d5df2030c58dac7d941384 INFO: 172.21.0.1:51032 - "POST /node/68d5df2030c58dac7d941384 HTTP/1.0" 202 Accepted 2025-09-27 23:39:21,046 - lava_callback - INFO - Starting async job submit for node 68d5df2030c58dac7d941384 2025-09-27 23:39:21,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:39:21,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2030c58dac7d941384 HTTP/1.1" 200 None 2025-09-27 23:39:21,081 - lava_callback - DEBUG - Processing node 68d5df2030c58dac7d941384: baseline-arm-broonie 2025-09-27 23:39:21,311 - lava_callback - ERROR - Error processing callback for node 68d5df2030c58dac7d941384: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:41:08,384 - lava_callback - INFO - Received callback for node 68d846171fd44e101337febb INFO: 172.21.0.1:43202 - "POST /node/68d846171fd44e101337febb HTTP/1.0" 202 Accepted 2025-09-27 23:41:08,390 - lava_callback - INFO - Starting async job submit for node 68d846171fd44e101337febb 2025-09-27 23:41:08,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:41:08,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846171fd44e101337febb HTTP/1.1" 200 None 2025-09-27 23:41:08,425 - lava_callback - DEBUG - Processing node 68d846171fd44e101337febb: baseline-arm 2025-09-27 23:41:08,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:41:08,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:41:08,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d846171fd44e101337febb/log.txt.gz 2025-09-27 23:41:08,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:41:08,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:41:08,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d846171fd44e101337febb/lava_callback.json.gz 2025-09-27 23:41:08,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:41:08,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846171fd44e101337febb HTTP/1.1" 200 None 2025-09-27 23:41:08,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:41:09,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 23:41:09,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:41:09,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d846171fd44e101337febb HTTP/1.1" 200 None 2025-09-27 23:41:09,045 - lava_callback - INFO - Completed processing callback for node 68d846171fd44e101337febb INFO: 172.21.0.1:54510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:43:01,346 - lava_callback - INFO - Received callback for node 68d5df2e30c58dac7d9413c9 INFO: 172.21.0.1:51012 - "POST /node/68d5df2e30c58dac7d9413c9 HTTP/1.0" 202 Accepted 2025-09-27 23:43:01,353 - lava_callback - INFO - Starting async job submit for node 68d5df2e30c58dac7d9413c9 2025-09-27 23:43:01,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:43:01,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2e30c58dac7d9413c9 HTTP/1.1" 200 None 2025-09-27 23:43:01,421 - lava_callback - DEBUG - Processing node 68d5df2e30c58dac7d9413c9: ltp-smoketest 2025-09-27 23:43:01,839 - lava_callback - ERROR - Error processing callback for node 68d5df2e30c58dac7d9413c9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:43:27,476 - lava_callback - INFO - Received callback for node 68d846181fd44e101337febe INFO: 172.21.0.1:59094 - "POST /node/68d846181fd44e101337febe HTTP/1.0" 202 Accepted 2025-09-27 23:43:27,482 - lava_callback - INFO - Starting async job submit for node 68d846181fd44e101337febe 2025-09-27 23:43:27,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:43:27,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846181fd44e101337febe HTTP/1.1" 200 None 2025-09-27 23:43:27,521 - lava_callback - DEBUG - Processing node 68d846181fd44e101337febe: baseline-arm 2025-09-27 23:43:27,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:43:27,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:43:27,976 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d846181fd44e101337febe/log.txt.gz 2025-09-27 23:43:27,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:43:28,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:43:28,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d846181fd44e101337febe/lava_callback.json.gz 2025-09-27 23:43:28,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:43:28,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846181fd44e101337febe HTTP/1.1" 200 None 2025-09-27 23:43:28,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:43:28,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 23:43:28,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:43:28,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d846181fd44e101337febe HTTP/1.1" 200 None 2025-09-27 23:43:28,222 - lava_callback - INFO - Completed processing callback for node 68d846181fd44e101337febe INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:44:17,738 - lava_callback - INFO - Received callback for node 68d5df2b30c58dac7d9413c2 INFO: 172.21.0.1:50790 - "POST /node/68d5df2b30c58dac7d9413c2 HTTP/1.0" 202 Accepted 2025-09-27 23:44:17,745 - lava_callback - INFO - Starting async job submit for node 68d5df2b30c58dac7d9413c2 2025-09-27 23:44:17,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:44:17,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2b30c58dac7d9413c2 HTTP/1.1" 200 None 2025-09-27 23:44:17,816 - lava_callback - DEBUG - Processing node 68d5df2b30c58dac7d9413c2: ltp-pty 2025-09-27 23:44:18,214 - lava_callback - ERROR - Error processing callback for node 68d5df2b30c58dac7d9413c2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:45:48,102 - lava_callback - INFO - Received callback for node 68d846191fd44e101337fec1 INFO: 172.21.0.1:58578 - "POST /node/68d846191fd44e101337fec1 HTTP/1.0" 202 Accepted 2025-09-27 23:45:48,108 - lava_callback - INFO - Starting async job submit for node 68d846191fd44e101337fec1 2025-09-27 23:45:48,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:45:48,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846191fd44e101337fec1 HTTP/1.1" 200 None 2025-09-27 23:45:48,179 - lava_callback - DEBUG - Processing node 68d846191fd44e101337fec1: baseline-arm 2025-09-27 23:45:48,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:45:48,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:45:48,570 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d846191fd44e101337fec1/log.txt.gz 2025-09-27 23:45:48,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:45:48,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:45:48,704 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d846191fd44e101337fec1/lava_callback.json.gz 2025-09-27 23:45:48,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:45:48,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846191fd44e101337fec1 HTTP/1.1" 200 None 2025-09-27 23:45:48,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:45:48,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6bd793c94e462c68814e2 HTTP/1.1" 200 None 2025-09-27 23:45:48,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:45:48,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d846191fd44e101337fec1 HTTP/1.1" 200 None 2025-09-27 23:45:48,810 - lava_callback - INFO - Completed processing callback for node 68d846191fd44e101337fec1 INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:48:09,751 - lava_callback - INFO - Received callback for node 68d84acb1fd44e101337ff68 INFO: 172.21.0.1:60704 - "POST /node/68d84acb1fd44e101337ff68 HTTP/1.0" 202 Accepted 2025-09-27 23:48:09,757 - lava_callback - INFO - Starting async job submit for node 68d84acb1fd44e101337ff68 2025-09-27 23:48:09,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:48:09,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84acb1fd44e101337ff68 HTTP/1.1" 200 None 2025-09-27 23:48:09,791 - lava_callback - DEBUG - Processing node 68d84acb1fd44e101337ff68: baseline-arm 2025-09-27 23:48:10,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:48:10,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:48:10,199 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84acb1fd44e101337ff68/log.txt.gz 2025-09-27 23:48:10,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:48:10,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:48:10,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84acb1fd44e101337ff68/lava_callback.json.gz 2025-09-27 23:48:10,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:48:10,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84acb1fd44e101337ff68 HTTP/1.1" 200 None 2025-09-27 23:48:10,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:48:10,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 23:48:10,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:48:10,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84acb1fd44e101337ff68 HTTP/1.1" 200 None 2025-09-27 23:48:10,428 - lava_callback - INFO - Completed processing callback for node 68d84acb1fd44e101337ff68 INFO: 172.21.0.1:60712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:48:31,431 - lava_callback - INFO - Received callback for node 68d5df1e30c58dac7d941375 INFO: 172.21.0.1:36140 - "POST /node/68d5df1e30c58dac7d941375 HTTP/1.0" 202 Accepted 2025-09-27 23:48:31,437 - lava_callback - INFO - Starting async job submit for node 68d5df1e30c58dac7d941375 2025-09-27 23:48:31,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:48:31,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df1e30c58dac7d941375 HTTP/1.1" 200 None 2025-09-27 23:48:31,500 - lava_callback - DEBUG - Processing node 68d5df1e30c58dac7d941375: baseline-arm 2025-09-27 23:48:31,764 - lava_callback - ERROR - Error processing callback for node 68d5df1e30c58dac7d941375: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:48:43,209 - lava_callback - INFO - Received callback for node 68d5df3130c58dac7d9413d5 INFO: 172.21.0.1:42066 - "POST /node/68d5df3130c58dac7d9413d5 HTTP/1.0" 202 Accepted 2025-09-27 23:48:43,216 - lava_callback - INFO - Starting async job submit for node 68d5df3130c58dac7d9413d5 2025-09-27 23:48:43,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:48:43,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df3130c58dac7d9413d5 HTTP/1.1" 200 None 2025-09-27 23:48:43,266 - lava_callback - DEBUG - Processing node 68d5df3130c58dac7d9413d5: ltp-timers 2025-09-27 23:48:43,611 - lava_callback - ERROR - Error processing callback for node 68d5df3130c58dac7d9413d5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:50:22,250 - lava_callback - INFO - Received callback for node 68d84acb1fd44e101337ff6b INFO: 172.21.0.1:48246 - "POST /node/68d84acb1fd44e101337ff6b HTTP/1.0" 202 Accepted 2025-09-27 23:50:22,256 - lava_callback - INFO - Starting async job submit for node 68d84acb1fd44e101337ff6b 2025-09-27 23:50:22,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:50:22,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84acb1fd44e101337ff6b HTTP/1.1" 200 None 2025-09-27 23:50:22,320 - lava_callback - DEBUG - Processing node 68d84acb1fd44e101337ff6b: baseline-arm 2025-09-27 23:50:22,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:50:22,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:50:22,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84acb1fd44e101337ff6b/log.txt.gz 2025-09-27 23:50:22,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:50:22,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:50:22,863 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84acb1fd44e101337ff6b/lava_callback.json.gz 2025-09-27 23:50:22,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:50:22,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84acb1fd44e101337ff6b HTTP/1.1" 200 None 2025-09-27 23:50:22,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:50:22,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 23:50:22,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:50:22,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84acb1fd44e101337ff6b HTTP/1.1" 200 None 2025-09-27 23:50:22,940 - lava_callback - INFO - Completed processing callback for node 68d84acb1fd44e101337ff6b INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:52:50,501 - lava_callback - INFO - Received callback for node 68d84acd1fd44e101337ff6e INFO: 172.21.0.1:56762 - "POST /node/68d84acd1fd44e101337ff6e HTTP/1.0" 202 Accepted 2025-09-27 23:52:50,507 - lava_callback - INFO - Starting async job submit for node 68d84acd1fd44e101337ff6e 2025-09-27 23:52:50,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:52:50,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84acd1fd44e101337ff6e HTTP/1.1" 200 None 2025-09-27 23:52:50,561 - lava_callback - DEBUG - Processing node 68d84acd1fd44e101337ff6e: baseline-arm 2025-09-27 23:52:50,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:52:50,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:52:50,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84acd1fd44e101337ff6e/log.txt.gz 2025-09-27 23:52:50,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:52:51,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:52:51,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84acd1fd44e101337ff6e/lava_callback.json.gz 2025-09-27 23:52:51,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:52:51,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84acd1fd44e101337ff6e HTTP/1.1" 200 None 2025-09-27 23:52:51,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:52:51,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 23:52:51,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:52:51,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84acd1fd44e101337ff6e HTTP/1.1" 200 None 2025-09-27 23:52:51,193 - lava_callback - INFO - Completed processing callback for node 68d84acd1fd44e101337ff6e INFO: 172.21.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41248 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:53:04,562 - lava_callback - INFO - Received callback for node 68d5df3230c58dac7d9413da INFO: 172.21.0.1:41260 - "POST /node/68d5df3230c58dac7d9413da HTTP/1.0" 202 Accepted 2025-09-27 23:53:04,569 - lava_callback - INFO - Starting async job submit for node 68d5df3230c58dac7d9413da 2025-09-27 23:53:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:53:04,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df3230c58dac7d9413da HTTP/1.1" 200 None 2025-09-27 23:53:04,624 - lava_callback - DEBUG - Processing node 68d5df3230c58dac7d9413da: ltp-watchqueue 2025-09-27 23:53:05,033 - lava_callback - ERROR - Error processing callback for node 68d5df3230c58dac7d9413da: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:53:41,715 - lava_callback - INFO - Received callback for node 68d5df2c30c58dac7d9413c6 INFO: 172.21.0.1:51798 - "POST /node/68d5df2c30c58dac7d9413c6 HTTP/1.0" 202 Accepted 2025-09-27 23:53:41,721 - lava_callback - INFO - Starting async job submit for node 68d5df2c30c58dac7d9413c6 2025-09-27 23:53:41,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:53:41,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df2c30c58dac7d9413c6 HTTP/1.1" 200 None 2025-09-27 23:53:41,764 - lava_callback - DEBUG - Processing node 68d5df2c30c58dac7d9413c6: ltp-sched 2025-09-27 23:53:42,102 - lava_callback - ERROR - Error processing callback for node 68d5df2c30c58dac7d9413c6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:55:00,413 - lava_callback - INFO - Received callback for node 68d5e00730c58dac7d941426 INFO: 172.21.0.1:58368 - "POST /node/68d5e00730c58dac7d941426 HTTP/1.0" 202 Accepted 2025-09-27 23:55:00,419 - lava_callback - INFO - Starting async job submit for node 68d5e00730c58dac7d941426 2025-09-27 23:55:00,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:55:00,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e00730c58dac7d941426 HTTP/1.1" 200 None 2025-09-27 23:55:00,452 - lava_callback - DEBUG - Processing node 68d5e00730c58dac7d941426: baseline-arm-broonie 2025-09-27 23:55:00,645 - lava_callback - ERROR - Error processing callback for node 68d5e00730c58dac7d941426: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:55:11,779 - lava_callback - INFO - Received callback for node 68d84acd1fd44e101337ff71 INFO: 172.21.0.1:58560 - "POST /node/68d84acd1fd44e101337ff71 HTTP/1.0" 202 Accepted 2025-09-27 23:55:11,785 - lava_callback - INFO - Starting async job submit for node 68d84acd1fd44e101337ff71 2025-09-27 23:55:11,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:55:11,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84acd1fd44e101337ff71 HTTP/1.1" 200 None 2025-09-27 23:55:11,842 - lava_callback - DEBUG - Processing node 68d84acd1fd44e101337ff71: baseline-arm 2025-09-27 23:55:12,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:55:12,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:55:12,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84acd1fd44e101337ff71/log.txt.gz 2025-09-27 23:55:12,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:55:12,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:55:12,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84acd1fd44e101337ff71/lava_callback.json.gz 2025-09-27 23:55:12,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:55:12,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84acd1fd44e101337ff71 HTTP/1.1" 200 None 2025-09-27 23:55:12,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:55:12,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 23:55:12,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:55:12,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84acd1fd44e101337ff71 HTTP/1.1" 200 None 2025-09-27 23:55:12,490 - lava_callback - INFO - Completed processing callback for node 68d84acd1fd44e101337ff71 INFO: 172.21.0.1:58576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:57:21,631 - lava_callback - INFO - Received callback for node 68d844c41fd44e101337fea0 INFO: 172.21.0.1:53492 - "POST /node/68d844c41fd44e101337fea0 HTTP/1.0" 202 Accepted 2025-09-27 23:57:21,637 - lava_callback - INFO - Starting async job submit for node 68d844c41fd44e101337fea0 2025-09-27 23:57:21,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:21,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d844c41fd44e101337fea0 HTTP/1.1" 200 None 2025-09-27 23:57:21,668 - lava_callback - DEBUG - Processing node 68d844c41fd44e101337fea0: baseline-arm64-broonie 2025-09-27 23:57:21,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:57:22,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:57:22,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d844c41fd44e101337fea0/log.txt.gz 2025-09-27 23:57:22,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:57:22,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:57:22,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d844c41fd44e101337fea0/lava_callback.json.gz 2025-09-27 23:57:22,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:22,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d844c41fd44e101337fea0 HTTP/1.1" 200 None 2025-09-27 23:57:22,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:22,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d72a303c94e462c68828aa HTTP/1.1" 200 None 2025-09-27 23:57:22,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:22,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d844c41fd44e101337fea0 HTTP/1.1" 200 None 2025-09-27 23:57:22,426 - lava_callback - INFO - Completed processing callback for node 68d844c41fd44e101337fea0 INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:57:31,684 - lava_callback - INFO - Received callback for node 68d84b041fd44e101337ff91 INFO: 172.21.0.1:46516 - "POST /node/68d84b041fd44e101337ff91 HTTP/1.0" 202 Accepted 2025-09-27 23:57:31,690 - lava_callback - INFO - Starting async job submit for node 68d84b041fd44e101337ff91 2025-09-27 23:57:31,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:31,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84b041fd44e101337ff91 HTTP/1.1" 200 None 2025-09-27 23:57:31,725 - lava_callback - DEBUG - Processing node 68d84b041fd44e101337ff91: baseline-arm 2025-09-27 23:57:31,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:57:32,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:57:32,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84b041fd44e101337ff91/log.txt.gz 2025-09-27 23:57:32,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:57:32,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:57:32,232 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84b041fd44e101337ff91/lava_callback.json.gz 2025-09-27 23:57:32,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:32,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84b041fd44e101337ff91 HTTP/1.1" 200 None 2025-09-27 23:57:32,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:32,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 23:57:32,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:32,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84b041fd44e101337ff91 HTTP/1.1" 200 None 2025-09-27 23:57:32,307 - lava_callback - INFO - Completed processing callback for node 68d84b041fd44e101337ff91 INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:57:51,673 - lava_callback - INFO - Received callback for node 68d7e5978dd6b39fd1aeb4ff INFO: 172.21.0.1:59288 - "POST /node/68d7e5978dd6b39fd1aeb4ff HTTP/1.0" 202 Accepted 2025-09-27 23:57:51,680 - lava_callback - INFO - Starting async job submit for node 68d7e5978dd6b39fd1aeb4ff 2025-09-27 23:57:51,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:51,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e5978dd6b39fd1aeb4ff HTTP/1.1" 200 None 2025-09-27 23:57:51,734 - lava_callback - DEBUG - Processing node 68d7e5978dd6b39fd1aeb4ff: baseline-arm64 2025-09-27 23:57:52,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:57:52,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:57:52,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e5978dd6b39fd1aeb4ff/log.txt.gz 2025-09-27 23:57:52,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:57:52,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:57:52,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e5978dd6b39fd1aeb4ff/lava_callback.json.gz DEBUG: Setup failed for 68d7e5978dd6b39fd1aeb4ff. Transitting job node result: incomplete -> fail 2025-09-27 23:57:52,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:53,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e5978dd6b39fd1aeb4ff HTTP/1.1" 200 None 2025-09-27 23:57:53,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:53,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 23:57:53,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:57:53,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e5978dd6b39fd1aeb4ff HTTP/1.1" 200 None 2025-09-27 23:57:53,107 - lava_callback - INFO - Completed processing callback for node 68d7e5978dd6b39fd1aeb4ff INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:58:01,968 - lava_callback - INFO - Received callback for node 68d5e01430c58dac7d94147d INFO: 172.21.0.1:37564 - "POST /node/68d5e01430c58dac7d94147d HTTP/1.0" 202 Accepted 2025-09-27 23:58:01,974 - lava_callback - INFO - Starting async job submit for node 68d5e01430c58dac7d94147d 2025-09-27 23:58:02,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:58:02,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e01430c58dac7d94147d HTTP/1.1" 200 None 2025-09-27 23:58:02,014 - lava_callback - DEBUG - Processing node 68d5e01430c58dac7d94147d: ltp-cap-bounds 2025-09-27 23:58:02,376 - lava_callback - ERROR - Error processing callback for node 68d5e01430c58dac7d94147d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:58:40,750 - lava_callback - INFO - Received callback for node 68d7e6228dd6b39fd1aeb509 INFO: 172.21.0.1:46064 - "POST /node/68d7e6228dd6b39fd1aeb509 HTTP/1.0" 202 Accepted 2025-09-27 23:58:40,758 - lava_callback - INFO - Starting async job submit for node 68d7e6228dd6b39fd1aeb509 2025-09-27 23:58:40,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:58:40,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e6228dd6b39fd1aeb509 HTTP/1.1" 200 None 2025-09-27 23:58:40,834 - lava_callback - DEBUG - Processing node 68d7e6228dd6b39fd1aeb509: baseline-arm64 2025-09-27 23:58:41,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:58:41,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:58:41,890 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e6228dd6b39fd1aeb509/log.txt.gz 2025-09-27 23:58:41,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:58:42,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:58:42,097 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e6228dd6b39fd1aeb509/lava_callback.json.gz DEBUG: Setup failed for 68d7e6228dd6b39fd1aeb509. Transitting job node result: incomplete -> fail 2025-09-27 23:58:42,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:58:42,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e6228dd6b39fd1aeb509 HTTP/1.1" 200 None 2025-09-27 23:58:42,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:58:42,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 23:58:42,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:58:42,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e6228dd6b39fd1aeb509 HTTP/1.1" 200 None 2025-09-27 23:58:42,254 - lava_callback - INFO - Completed processing callback for node 68d7e6228dd6b39fd1aeb509 INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:59:40,779 - lava_callback - INFO - Received callback for node 68d7e6238dd6b39fd1aeb50c INFO: 172.21.0.1:56948 - "POST /node/68d7e6238dd6b39fd1aeb50c HTTP/1.0" 202 Accepted 2025-09-27 23:59:40,786 - lava_callback - INFO - Starting async job submit for node 68d7e6238dd6b39fd1aeb50c 2025-09-27 23:59:40,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:59:40,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e6238dd6b39fd1aeb50c HTTP/1.1" 200 None 2025-09-27 23:59:40,850 - lava_callback - DEBUG - Processing node 68d7e6238dd6b39fd1aeb50c: baseline-arm64 2025-09-27 23:59:41,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:59:41,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:59:41,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e6238dd6b39fd1aeb50c/log.txt.gz 2025-09-27 23:59:41,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:59:42,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:59:42,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d7e6238dd6b39fd1aeb50c/lava_callback.json.gz DEBUG: Setup failed for 68d7e6238dd6b39fd1aeb50c. Transitting job node result: incomplete -> fail 2025-09-27 23:59:42,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:59:42,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d7e6238dd6b39fd1aeb50c HTTP/1.1" 200 None 2025-09-27 23:59:42,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:59:42,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-27 23:59:42,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:59:42,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d7e6238dd6b39fd1aeb50c HTTP/1.1" 200 None 2025-09-27 23:59:42,489 - lava_callback - INFO - Completed processing callback for node 68d7e6238dd6b39fd1aeb50c INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK 2025-09-27 23:59:50,112 - lava_callback - INFO - Received callback for node 68d84b041fd44e101337ff9a INFO: 172.21.0.1:49270 - "POST /node/68d84b041fd44e101337ff9a HTTP/1.0" 202 Accepted 2025-09-27 23:59:50,118 - lava_callback - INFO - Starting async job submit for node 68d84b041fd44e101337ff9a 2025-09-27 23:59:50,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:59:50,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84b041fd44e101337ff9a HTTP/1.1" 200 None 2025-09-27 23:59:50,152 - lava_callback - DEBUG - Processing node 68d84b041fd44e101337ff9a: baseline-arm 2025-09-27 23:59:50,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:59:50,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:59:50,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84b041fd44e101337ff9a/log.txt.gz 2025-09-27 23:59:50,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-27 23:59:50,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-27 23:59:50,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84b041fd44e101337ff9a/lava_callback.json.gz 2025-09-27 23:59:50,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:59:50,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84b041fd44e101337ff9a HTTP/1.1" 200 None 2025-09-27 23:59:50,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:59:50,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-27 23:59:50,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-27 23:59:50,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84b041fd44e101337ff9a HTTP/1.1" 200 None 2025-09-27 23:59:50,758 - lava_callback - INFO - Completed processing callback for node 68d84b041fd44e101337ff9a INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:00:22,685 - lava_callback - INFO - Received callback for node 68d846131fd44e101337feb3 INFO: 172.21.0.1:37378 - "POST /node/68d846131fd44e101337feb3 HTTP/1.0" 202 Accepted 2025-09-28 00:00:22,693 - lava_callback - INFO - Starting async job submit for node 68d846131fd44e101337feb3 2025-09-28 00:00:22,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:00:22,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846131fd44e101337feb3 HTTP/1.1" 200 None 2025-09-28 00:00:22,737 - lava_callback - DEBUG - Processing node 68d846131fd44e101337feb3: baseline-arm64-broonie 2025-09-28 00:00:23,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:00:23,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:00:23,415 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d846131fd44e101337feb3/log.txt.gz 2025-09-28 00:00:23,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:00:23,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:00:23,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d846131fd44e101337feb3/lava_callback.json.gz 2025-09-28 00:00:23,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:00:23,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d846131fd44e101337feb3 HTTP/1.1" 200 None 2025-09-28 00:00:23,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:00:23,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eda8dd6b39fd1aea2de HTTP/1.1" 200 None 2025-09-28 00:00:23,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:00:23,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d846131fd44e101337feb3 HTTP/1.1" 200 None 2025-09-28 00:00:23,717 - lava_callback - INFO - Completed processing callback for node 68d846131fd44e101337feb3 INFO: 172.21.0.1:37390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58126 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:01:23,245 - lava_callback - INFO - Received callback for node 68d5e01530c58dac7d941481 INFO: 172.21.0.1:49854 - "POST /node/68d5e01530c58dac7d941481 HTTP/1.0" 202 Accepted 2025-09-28 00:01:23,258 - lava_callback - INFO - Starting async job submit for node 68d5e01530c58dac7d941481 2025-09-28 00:01:23,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:01:23,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e01530c58dac7d941481 HTTP/1.1" 200 None 2025-09-28 00:01:23,472 - lava_callback - DEBUG - Processing node 68d5e01530c58dac7d941481: ltp-containers 2025-09-28 00:01:24,506 - lava_callback - ERROR - Error processing callback for node 68d5e01530c58dac7d941481: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:02:02,263 - lava_callback - INFO - Received callback for node 68d5df3030c58dac7d9413d2 INFO: 172.21.0.1:40608 - "POST /node/68d5df3030c58dac7d9413d2 HTTP/1.0" 202 Accepted 2025-09-28 00:02:02,273 - lava_callback - INFO - Starting async job submit for node 68d5df3030c58dac7d9413d2 2025-09-28 00:02:02,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:02:02,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5df3030c58dac7d9413d2 HTTP/1.1" 200 None 2025-09-28 00:02:02,371 - lava_callback - DEBUG - Processing node 68d5df3030c58dac7d9413d2: ltp-syscalls-ipc INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:02:03,685 - lava_callback - ERROR - Error processing callback for node 68d5df3030c58dac7d9413d2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:03:07,993 - lava_callback - INFO - Received callback for node 68d84b061fd44e101337ff9d INFO: 172.21.0.1:33958 - "POST /node/68d84b061fd44e101337ff9d HTTP/1.0" 202 Accepted 2025-09-28 00:03:08,000 - lava_callback - INFO - Starting async job submit for node 68d84b061fd44e101337ff9d 2025-09-28 00:03:08,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:03:08,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84b061fd44e101337ff9d HTTP/1.1" 200 None 2025-09-28 00:03:08,048 - lava_callback - DEBUG - Processing node 68d84b061fd44e101337ff9d: baseline-arm 2025-09-28 00:03:08,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:03:08,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:03:08,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84b061fd44e101337ff9d/log.txt.gz 2025-09-28 00:03:08,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:03:08,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:03:08,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84b061fd44e101337ff9d/lava_callback.json.gz 2025-09-28 00:03:08,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:03:08,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84b061fd44e101337ff9d HTTP/1.1" 200 None 2025-09-28 00:03:08,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:03:08,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-28 00:03:08,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:03:08,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84b061fd44e101337ff9d HTTP/1.1" 200 None 2025-09-28 00:03:08,989 - lava_callback - INFO - Completed processing callback for node 68d84b061fd44e101337ff9d INFO: 172.21.0.1:59114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:03:21,014 - lava_callback - INFO - Received callback for node 68d8485b1fd44e101337fee5 INFO: 172.21.0.1:54466 - "POST /node/68d8485b1fd44e101337fee5 HTTP/1.0" 202 Accepted 2025-09-28 00:03:21,024 - lava_callback - INFO - Starting async job submit for node 68d8485b1fd44e101337fee5 2025-09-28 00:03:21,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:03:21,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8485b1fd44e101337fee5 HTTP/1.1" 200 None 2025-09-28 00:03:21,061 - lava_callback - DEBUG - Processing node 68d8485b1fd44e101337fee5: baseline-arm64-broonie 2025-09-28 00:03:21,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:03:21,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:03:21,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8485b1fd44e101337fee5/log.txt.gz 2025-09-28 00:03:21,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:03:21,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:03:21,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d8485b1fd44e101337fee5/lava_callback.json.gz 2025-09-28 00:03:21,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:03:21,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d8485b1fd44e101337fee5 HTTP/1.1" 200 None 2025-09-28 00:03:21,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:03:21,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-28 00:03:21,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:03:21,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d8485b1fd44e101337fee5 HTTP/1.1" 200 None 2025-09-28 00:03:21,917 - lava_callback - INFO - Completed processing callback for node 68d8485b1fd44e101337fee5 INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:05:21,077 - lava_callback - INFO - Received callback for node 68d84b071fd44e101337ffa0 INFO: 172.21.0.1:54218 - "POST /node/68d84b071fd44e101337ffa0 HTTP/1.0" 202 Accepted 2025-09-28 00:05:21,083 - lava_callback - INFO - Starting async job submit for node 68d84b071fd44e101337ffa0 2025-09-28 00:05:21,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:05:21,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84b071fd44e101337ffa0 HTTP/1.1" 200 None 2025-09-28 00:05:21,117 - lava_callback - DEBUG - Processing node 68d84b071fd44e101337ffa0: baseline-arm 2025-09-28 00:05:21,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:05:21,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:05:21,570 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84b071fd44e101337ffa0/log.txt.gz 2025-09-28 00:05:21,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:05:21,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:05:21,738 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84b071fd44e101337ffa0/lava_callback.json.gz 2025-09-28 00:05:21,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:05:21,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84b071fd44e101337ffa0 HTTP/1.1" 200 None 2025-09-28 00:05:21,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:05:21,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79adfa6a7b6615d4c53ef HTTP/1.1" 200 None 2025-09-28 00:05:21,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:05:21,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84b071fd44e101337ffa0 HTTP/1.1" 200 None 2025-09-28 00:05:21,847 - lava_callback - INFO - Completed processing callback for node 68d84b071fd44e101337ffa0 INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:06:21,124 - lava_callback - INFO - Received callback for node 68d84a981fd44e101337ff51 INFO: 172.21.0.1:47980 - "POST /node/68d84a981fd44e101337ff51 HTTP/1.0" 202 Accepted 2025-09-28 00:06:21,130 - lava_callback - INFO - Starting async job submit for node 68d84a981fd44e101337ff51 2025-09-28 00:06:21,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:06:21,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84a981fd44e101337ff51 HTTP/1.1" 200 None 2025-09-28 00:06:21,163 - lava_callback - DEBUG - Processing node 68d84a981fd44e101337ff51: baseline-arm64-broonie 2025-09-28 00:06:21,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:06:21,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:06:21,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d84a981fd44e101337ff51/log.txt.gz 2025-09-28 00:06:21,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:06:21,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:06:21,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d84a981fd44e101337ff51/lava_callback.json.gz 2025-09-28 00:06:21,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:06:21,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84a981fd44e101337ff51 HTTP/1.1" 200 None 2025-09-28 00:06:21,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:06:21,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79ae2a6a7b6615d4c53f2 HTTP/1.1" 200 None 2025-09-28 00:06:21,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:06:21,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84a981fd44e101337ff51 HTTP/1.1" 200 None 2025-09-28 00:06:21,865 - lava_callback - INFO - Completed processing callback for node 68d84a981fd44e101337ff51 INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:07:48,689 - lava_callback - INFO - Received callback for node 68d84c321fd44e1013380034 INFO: 172.21.0.1:45492 - "POST /node/68d84c321fd44e1013380034 HTTP/1.0" 202 Accepted 2025-09-28 00:07:48,698 - lava_callback - INFO - Starting async job submit for node 68d84c321fd44e1013380034 2025-09-28 00:07:48,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:07:48,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c321fd44e1013380034 HTTP/1.1" 200 None 2025-09-28 00:07:48,753 - lava_callback - DEBUG - Processing node 68d84c321fd44e1013380034: baseline-arm 2025-09-28 00:07:49,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:07:49,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:07:49,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84c321fd44e1013380034/log.txt.gz 2025-09-28 00:07:49,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:07:49,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:07:49,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84c321fd44e1013380034/lava_callback.json.gz 2025-09-28 00:07:49,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:07:49,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c321fd44e1013380034 HTTP/1.1" 200 None 2025-09-28 00:07:49,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:07:49,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-28 00:07:49,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:07:49,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84c321fd44e1013380034 HTTP/1.1" 200 None 2025-09-28 00:07:49,672 - lava_callback - INFO - Completed processing callback for node 68d84c321fd44e1013380034 INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:08:11,336 - lava_callback - INFO - Received callback for node 68d5e00130c58dac7d9413f9 INFO: 172.21.0.1:60228 - "POST /node/68d5e00130c58dac7d9413f9 HTTP/1.0" 202 Accepted 2025-09-28 00:08:11,343 - lava_callback - INFO - Starting async job submit for node 68d5e00130c58dac7d9413f9 2025-09-28 00:08:11,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:08:11,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e00130c58dac7d9413f9 HTTP/1.1" 200 None 2025-09-28 00:08:11,386 - lava_callback - DEBUG - Processing node 68d5e00130c58dac7d9413f9: baseline-arm 2025-09-28 00:08:11,666 - lava_callback - ERROR - Error processing callback for node 68d5e00130c58dac7d9413f9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:60232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:09:21,056 - lava_callback - INFO - Received callback for node 68d84aef1fd44e101337ff84 INFO: 172.21.0.1:42320 - "POST /node/68d84aef1fd44e101337ff84 HTTP/1.0" 202 Accepted 2025-09-28 00:09:21,062 - lava_callback - INFO - Starting async job submit for node 68d84aef1fd44e101337ff84 2025-09-28 00:09:21,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:09:21,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84aef1fd44e101337ff84 HTTP/1.1" 200 None 2025-09-28 00:09:21,117 - lava_callback - DEBUG - Processing node 68d84aef1fd44e101337ff84: baseline-arm64-broonie 2025-09-28 00:09:21,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:09:21,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:09:21,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d84aef1fd44e101337ff84/log.txt.gz 2025-09-28 00:09:21,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:09:21,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:09:21,723 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d84aef1fd44e101337ff84/lava_callback.json.gz 2025-09-28 00:09:21,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:09:21,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84aef1fd44e101337ff84 HTTP/1.1" 200 None 2025-09-28 00:09:21,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:09:21,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-28 00:09:21,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:09:21,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84aef1fd44e101337ff84 HTTP/1.1" 200 None 2025-09-28 00:09:21,821 - lava_callback - INFO - Completed processing callback for node 68d84aef1fd44e101337ff84 2025-09-28 00:09:22,444 - lava_callback - INFO - Received callback for node 68d5e01730c58dac7d94148f INFO: 172.21.0.1:42332 - "POST /node/68d5e01730c58dac7d94148f HTTP/1.0" 202 Accepted 2025-09-28 00:09:22,451 - lava_callback - INFO - Starting async job submit for node 68d5e01730c58dac7d94148f 2025-09-28 00:09:22,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:09:22,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e01730c58dac7d94148f HTTP/1.1" 200 None 2025-09-28 00:09:22,576 - lava_callback - DEBUG - Processing node 68d5e01730c58dac7d94148f: ltp-fs-bind 2025-09-28 00:09:23,096 - lava_callback - ERROR - Error processing callback for node 68d5e01730c58dac7d94148f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:10:08,680 - lava_callback - INFO - Received callback for node 68d84c331fd44e1013380037 INFO: 172.21.0.1:38338 - "POST /node/68d84c331fd44e1013380037 HTTP/1.0" 202 Accepted 2025-09-28 00:10:08,686 - lava_callback - INFO - Starting async job submit for node 68d84c331fd44e1013380037 2025-09-28 00:10:08,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:10:08,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c331fd44e1013380037 HTTP/1.1" 200 None 2025-09-28 00:10:08,739 - lava_callback - DEBUG - Processing node 68d84c331fd44e1013380037: baseline-arm 2025-09-28 00:10:08,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:10:09,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:10:09,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84c331fd44e1013380037/log.txt.gz 2025-09-28 00:10:09,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:10:09,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:10:09,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84c331fd44e1013380037/lava_callback.json.gz 2025-09-28 00:10:09,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:10:09,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c331fd44e1013380037 HTTP/1.1" 200 None 2025-09-28 00:10:09,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:10:09,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-28 00:10:09,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:10:09,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84c331fd44e1013380037 HTTP/1.1" 200 None 2025-09-28 00:10:09,325 - lava_callback - INFO - Completed processing callback for node 68d84c331fd44e1013380037 INFO: 172.21.0.1:43142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:12:22,498 - lava_callback - INFO - Received callback for node 68d84ba71fd44e101338000a INFO: 172.21.0.1:59718 - "POST /node/68d84ba71fd44e101338000a HTTP/1.0" 202 Accepted 2025-09-28 00:12:22,504 - lava_callback - INFO - Starting async job submit for node 68d84ba71fd44e101338000a 2025-09-28 00:12:22,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:12:22,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84ba71fd44e101338000a HTTP/1.1" 200 None 2025-09-28 00:12:22,534 - lava_callback - DEBUG - Processing node 68d84ba71fd44e101338000a: baseline-arm64-broonie 2025-09-28 00:12:22,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:12:22,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:12:22,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d84ba71fd44e101338000a/log.txt.gz 2025-09-28 00:12:23,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:12:23,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:12:23,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d84ba71fd44e101338000a/lava_callback.json.gz 2025-09-28 00:12:23,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:12:23,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84ba71fd44e101338000a HTTP/1.1" 200 None 2025-09-28 00:12:23,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:12:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-28 00:12:23,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:12:23,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84ba71fd44e101338000a HTTP/1.1" 200 None 2025-09-28 00:12:23,229 - lava_callback - INFO - Completed processing callback for node 68d84ba71fd44e101338000a INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:12:29,847 - lava_callback - INFO - Received callback for node 68d84c351fd44e101338003a INFO: 172.21.0.1:54032 - "POST /node/68d84c351fd44e101338003a HTTP/1.0" 202 Accepted 2025-09-28 00:12:29,853 - lava_callback - INFO - Starting async job submit for node 68d84c351fd44e101338003a 2025-09-28 00:12:29,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:12:29,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c351fd44e101338003a HTTP/1.1" 200 None 2025-09-28 00:12:29,888 - lava_callback - DEBUG - Processing node 68d84c351fd44e101338003a: baseline-arm 2025-09-28 00:12:30,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:12:30,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:12:30,259 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84c351fd44e101338003a/log.txt.gz 2025-09-28 00:12:30,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:12:30,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:12:30,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84c351fd44e101338003a/lava_callback.json.gz 2025-09-28 00:12:30,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:12:30,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c351fd44e101338003a HTTP/1.1" 200 None 2025-09-28 00:12:30,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:12:30,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-28 00:12:30,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:12:30,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84c351fd44e101338003a HTTP/1.1" 200 None 2025-09-28 00:12:30,461 - lava_callback - INFO - Completed processing callback for node 68d84c351fd44e101338003a INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:13:42,569 - lava_callback - INFO - Received callback for node 68d5e01730c58dac7d941493 INFO: 172.21.0.1:35348 - "POST /node/68d5e01730c58dac7d941493 HTTP/1.0" 202 Accepted 2025-09-28 00:13:42,575 - lava_callback - INFO - Starting async job submit for node 68d5e01730c58dac7d941493 2025-09-28 00:13:42,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:13:42,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e01730c58dac7d941493 HTTP/1.1" 200 None 2025-09-28 00:13:42,613 - lava_callback - DEBUG - Processing node 68d5e01730c58dac7d941493: ltp-fsx 2025-09-28 00:13:42,957 - lava_callback - ERROR - Error processing callback for node 68d5e01730c58dac7d941493: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:14:43,086 - lava_callback - INFO - Received callback for node 68d5e01530c58dac7d941484 INFO: 172.21.0.1:32776 - "POST /node/68d5e01530c58dac7d941484 HTTP/1.0" 202 Accepted 2025-09-28 00:14:43,098 - lava_callback - INFO - Starting async job submit for node 68d5e01530c58dac7d941484 2025-09-28 00:14:43,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:14:43,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5e01530c58dac7d941484 HTTP/1.1" 200 None 2025-09-28 00:14:43,446 - lava_callback - DEBUG - Processing node 68d5e01530c58dac7d941484: ltp-controllers 2025-09-28 00:14:46,195 - lava_callback - ERROR - Error processing callback for node 68d5e01530c58dac7d941484: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 280, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 172, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:14:49,218 - lava_callback - INFO - Received callback for node 68d84c351fd44e101338003d INFO: 172.21.0.1:32796 - "POST /node/68d84c351fd44e101338003d HTTP/1.0" 202 Accepted 2025-09-28 00:14:49,224 - lava_callback - INFO - Starting async job submit for node 68d84c351fd44e101338003d 2025-09-28 00:14:49,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:14:49,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c351fd44e101338003d HTTP/1.1" 200 None 2025-09-28 00:14:49,274 - lava_callback - DEBUG - Processing node 68d84c351fd44e101338003d: baseline-arm 2025-09-28 00:14:49,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:14:49,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:14:49,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d84c351fd44e101338003d/log.txt.gz 2025-09-28 00:14:49,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:14:49,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:14:49,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d84c351fd44e101338003d/lava_callback.json.gz 2025-09-28 00:14:49,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:14:49,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c351fd44e101338003d HTTP/1.1" 200 None 2025-09-28 00:14:49,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:14:49,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d79eca8dd6b39fd1aea2cb HTTP/1.1" 200 None 2025-09-28 00:14:49,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:14:49,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84c351fd44e101338003d HTTP/1.1" 200 None 2025-09-28 00:14:49,907 - lava_callback - INFO - Completed processing callback for node 68d84c351fd44e101338003d INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK 2025-09-28 00:15:33,927 - lava_callback - INFO - Received callback for node 68d84c2f1fd44e1013380025 INFO: 172.21.0.1:50204 - "POST /node/68d84c2f1fd44e1013380025 HTTP/1.0" 202 Accepted 2025-09-28 00:15:33,933 - lava_callback - INFO - Starting async job submit for node 68d84c2f1fd44e1013380025 2025-09-28 00:15:33,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:15:33,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c2f1fd44e1013380025 HTTP/1.1" 200 None 2025-09-28 00:15:33,964 - lava_callback - DEBUG - Processing node 68d84c2f1fd44e1013380025: baseline-arm64-broonie 2025-09-28 00:15:34,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:15:34,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:15:34,417 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d84c2f1fd44e1013380025/log.txt.gz 2025-09-28 00:15:34,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-28 00:15:34,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-28 00:15:34,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d84c2f1fd44e1013380025/lava_callback.json.gz 2025-09-28 00:15:34,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:15:34,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d84c2f1fd44e1013380025 HTTP/1.1" 200 None 2025-09-28 00:15:34,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:15:34,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-28 00:15:34,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-28 00:15:34,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d84c2f1fd44e1013380025 HTTP/1.1" 200 None 2025-09-28 00:15:34,650 - lava_callback - INFO - Completed processing callback for node 68d84c2f1fd44e1013380025 INFO: 172.21.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]