INFO:     Started server process [1]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
INFO:     172.20.0.1:50240 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:55:31,076 - lava_callback - INFO - Received callback for node 69188dd4be9adb01fa8e5f3a
2025-11-16 23:55:31,083 - lava_callback - INFO - Starting async job submit for node 69188dd4be9adb01fa8e5f3a
INFO:     172.20.0.1:38494 - "POST /node/69188dd4be9adb01fa8e5f3a HTTP/1.0" 202 Accepted
2025-11-16 23:55:31,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:31,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dd4be9adb01fa8e5f3a HTTP/1.1" 200 None
2025-11-16 23:55:31,125 - lava_callback - DEBUG - Processing node 69188dd4be9adb01fa8e5f3a: ltp-cap-bounds
2025-11-16 23:55:31,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:31,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
2025-11-16 23:55:31,531 - lava_callback - INFO - Received callback for node 691a639d121efb600bc717dc
2025-11-16 23:55:31,537 - lava_callback - INFO - Starting async job submit for node 691a639d121efb600bc717dc
INFO:     172.20.0.1:38504 - "POST /node/691a639d121efb600bc717dc HTTP/1.0" 202 Accepted
2025-11-16 23:55:31,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:31,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639d121efb600bc717dc HTTP/1.1" 200 None
2025-11-16 23:55:31,574 - lava_callback - DEBUG - Processing node 691a639d121efb600bc717dc: baseline-arm64-broonie
2025-11-16 23:55:31,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:31,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
2025-11-16 23:55:32,159 - lava_callback - INFO - Received callback for node 691a638d121efb600bc71773
2025-11-16 23:55:32,166 - lava_callback - INFO - Starting async job submit for node 691a638d121efb600bc71773
INFO:     172.20.0.1:38518 - "POST /node/691a638d121efb600bc71773 HTTP/1.0" 202 Accepted
2025-11-16 23:55:32,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:32,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a638d121efb600bc71773 HTTP/1.1" 200 None
2025-11-16 23:55:32,208 - lava_callback - DEBUG - Processing node 691a638d121efb600bc71773: baseline-arm64
2025-11-16 23:55:32,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:32,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
2025-11-16 23:55:34,405 - lava_callback - INFO - Received callback for node 691a639a121efb600bc717c8
2025-11-16 23:55:34,414 - lava_callback - INFO - Starting async job submit for node 691a639a121efb600bc717c8
INFO:     172.20.0.1:38526 - "POST /node/691a639a121efb600bc717c8 HTTP/1.0" 202 Accepted
2025-11-16 23:55:34,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:34,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639a121efb600bc717c8 HTTP/1.1" 200 None
2025-11-16 23:55:34,464 - lava_callback - DEBUG - Processing node 691a639a121efb600bc717c8: baseline-arm64-broonie
2025-11-16 23:55:34,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:34,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
2025-11-16 23:55:36,191 - lava_callback - INFO - Received callback for node 691a639e121efb600bc717e2
2025-11-16 23:55:36,197 - lava_callback - INFO - Starting async job submit for node 691a639e121efb600bc717e2
INFO:     172.20.0.1:38532 - "POST /node/691a639e121efb600bc717e2 HTTP/1.0" 202 Accepted
2025-11-16 23:55:36,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:36,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639e121efb600bc717e2 HTTP/1.1" 200 None
2025-11-16 23:55:36,240 - lava_callback - DEBUG - Processing node 691a639e121efb600bc717e2: baseline-arm64-clabbe
INFO:     172.20.0.1:38546 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:55:36,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:36,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:36,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a639e121efb600bc717e2/log.txt.gz
2025-11-16 23:55:36,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:36,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:36,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a639e121efb600bc717e2/lava_callback.json.gz
2025-11-16 23:55:36,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:36,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639e121efb600bc717e2 HTTP/1.1" 200 None
2025-11-16 23:55:36,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:36,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:55:36,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:36,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a639e121efb600bc717e2 HTTP/1.1" 200 None
2025-11-16 23:55:36,920 - lava_callback - INFO - Completed processing callback for node 691a639e121efb600bc717e2
2025-11-16 23:55:41,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:41,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
2025-11-16 23:55:41,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:41,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
2025-11-16 23:55:42,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:42,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
2025-11-16 23:55:44,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:44,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
INFO:     172.20.0.1:47370 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:55:49,147 - lava_callback - INFO - Received callback for node 691a63a1121efb600bc717fa
INFO:     172.20.0.1:47378 - "POST /node/691a63a1121efb600bc717fa HTTP/1.0" 202 Accepted
2025-11-16 23:55:49,153 - lava_callback - INFO - Starting async job submit for node 691a63a1121efb600bc717fa
2025-11-16 23:55:49,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:49,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a1121efb600bc717fa HTTP/1.1" 200 None
2025-11-16 23:55:49,211 - lava_callback - DEBUG - Processing node 691a63a1121efb600bc717fa: baseline-arm64-clabbe
2025-11-16 23:55:49,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:49,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
2025-11-16 23:55:50,865 - lava_callback - INFO - Received callback for node 691a639d121efb600bc717df
2025-11-16 23:55:50,872 - lava_callback - INFO - Starting async job submit for node 691a639d121efb600bc717df
INFO:     172.20.0.1:48014 - "POST /node/691a639d121efb600bc717df HTTP/1.0" 202 Accepted
2025-11-16 23:55:50,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
INFO:     172.20.0.1:48028 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:55:50,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639d121efb600bc717df HTTP/1.1" 200 None
2025-11-16 23:55:50,918 - lava_callback - DEBUG - Processing node 691a639d121efb600bc717df: baseline-arm64-broonie
2025-11-16 23:55:51,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:51,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:51,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639d121efb600bc717df/log.txt.gz
2025-11-16 23:55:51,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:51,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:51,443 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639d121efb600bc717df/lava_callback.json.gz
2025-11-16 23:55:51,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:51,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639d121efb600bc717df HTTP/1.1" 200 None
2025-11-16 23:55:51,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:51,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:55:51,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:51,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a639d121efb600bc717df HTTP/1.1" 200 None
2025-11-16 23:55:51,534 - lava_callback - INFO - Completed processing callback for node 691a639d121efb600bc717df
2025-11-16 23:55:51,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:51,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:51,746 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap-bounds-69188dd4be9adb01fa8e5f3a/log.txt.gz
2025-11-16 23:55:51,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:51,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:51,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:51,924 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap-bounds-69188dd4be9adb01fa8e5f3a/lava_callback.json.gz
2025-11-16 23:55:51,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:51,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dd4be9adb01fa8e5f3a HTTP/1.1" 200 None
2025-11-16 23:55:51,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:51,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-16 23:55:51,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:52,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188dd4be9adb01fa8e5f3a HTTP/1.1" 200 None
2025-11-16 23:55:52,040 - lava_callback - INFO - Completed processing callback for node 69188dd4be9adb01fa8e5f3a
2025-11-16 23:55:52,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:52,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639d121efb600bc717dc/log.txt.gz
2025-11-16 23:55:52,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:52,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:52,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639d121efb600bc717dc/lava_callback.json.gz
2025-11-16 23:55:52,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:52,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639d121efb600bc717dc HTTP/1.1" 200 None
2025-11-16 23:55:52,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:52,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:55:52,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:52,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a639d121efb600bc717dc HTTP/1.1" 200 None
2025-11-16 23:55:52,281 - lava_callback - INFO - Completed processing callback for node 691a639d121efb600bc717dc
2025-11-16 23:55:52,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:52,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:52,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-691a638d121efb600bc71773/log.txt.gz
2025-11-16 23:55:52,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:52,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:52,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-691a638d121efb600bc71773/lava_callback.json.gz
2025-11-16 23:55:52,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:52,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a638d121efb600bc71773 HTTP/1.1" 200 None
2025-11-16 23:55:53,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:53,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:55:53,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:53,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a638d121efb600bc71773 HTTP/1.1" 200 None
2025-11-16 23:55:53,054 - lava_callback - INFO - Completed processing callback for node 691a638d121efb600bc71773
2025-11-16 23:55:54,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:54,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:54,896 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639a121efb600bc717c8/log.txt.gz
2025-11-16 23:55:54,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:55,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:55,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639a121efb600bc717c8/lava_callback.json.gz
2025-11-16 23:55:55,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:55,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639a121efb600bc717c8 HTTP/1.1" 200 None
2025-11-16 23:55:55,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:55,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:55:55,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:55,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a639a121efb600bc717c8 HTTP/1.1" 200 None
2025-11-16 23:55:55,127 - lava_callback - INFO - Completed processing callback for node 691a639a121efb600bc717c8
INFO:     172.20.0.1:48032 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:55:59,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:59,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:59,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a1121efb600bc717fa/log.txt.gz
2025-11-16 23:55:59,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:55:59,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:55:59,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a1121efb600bc717fa/lava_callback.json.gz
2025-11-16 23:55:59,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:59,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a1121efb600bc717fa HTTP/1.1" 200 None
2025-11-16 23:55:59,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:59,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:55:59,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:55:59,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a1121efb600bc717fa HTTP/1.1" 200 None
2025-11-16 23:55:59,917 - lava_callback - INFO - Completed processing callback for node 691a63a1121efb600bc717fa
2025-11-16 23:56:03,577 - lava_callback - INFO - Received callback for node 691a6427121efb600bc7184c
INFO:     172.20.0.1:50486 - "POST /node/691a6427121efb600bc7184c HTTP/1.0" 202 Accepted
2025-11-16 23:56:03,583 - lava_callback - INFO - Starting async job submit for node 691a6427121efb600bc7184c
2025-11-16 23:56:03,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:56:03,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6427121efb600bc7184c HTTP/1.1" 200 None
2025-11-16 23:56:03,617 - lava_callback - DEBUG - Processing node 691a6427121efb600bc7184c: baseline-arm64-clabbe
2025-11-16 23:56:03,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:50496 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:56:09,823 - lava_callback - INFO - Received callback for node 691a6399121efb600bc717c2
INFO:     172.20.0.1:56680 - "POST /node/691a6399121efb600bc717c2 HTTP/1.0" 202 Accepted
2025-11-16 23:56:09,830 - lava_callback - INFO - Starting async job submit for node 691a6399121efb600bc717c2
2025-11-16 23:56:09,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:56:09,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6399121efb600bc717c2 HTTP/1.1" 200 None
2025-11-16 23:56:09,881 - lava_callback - DEBUG - Processing node 691a6399121efb600bc717c2: baseline-arm64-broonie
2025-11-16 23:56:10,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:56682 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:56692 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:50102 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:57610 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:42442 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:46494 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:56:51,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:56:51,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a6427121efb600bc7184c/log.txt.gz
2025-11-16 23:56:51,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:56:51,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:56:51,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a6399121efb600bc717c2/log.txt.gz
2025-11-16 23:56:51,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:56:51,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:56:51,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a6427121efb600bc7184c/lava_callback.json.gz
2025-11-16 23:56:51,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:56:51,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6427121efb600bc7184c HTTP/1.1" 200 None
2025-11-16 23:56:51,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:56:51,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:56:51,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:56:51,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:56:51,963 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a6399121efb600bc717c2/lava_callback.json.gz
2025-11-16 23:56:52,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:56:52,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a6427121efb600bc7184c HTTP/1.1" 200 None
2025-11-16 23:56:52,040 - lava_callback - INFO - Completed processing callback for node 691a6427121efb600bc7184c
2025-11-16 23:56:52,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6399121efb600bc717c2 HTTP/1.1" 200 None
2025-11-16 23:56:52,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:56:52,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:56:52,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:56:52,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a6399121efb600bc717c2 HTTP/1.1" 200 None
2025-11-16 23:56:52,250 - lava_callback - INFO - Completed processing callback for node 691a6399121efb600bc717c2
INFO:     172.20.0.1:46510 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:57:09,923 - lava_callback - INFO - Received callback for node 69188dd6be9adb01fa8e5f3d
INFO:     172.20.0.1:57382 - "POST /node/69188dd6be9adb01fa8e5f3d HTTP/1.0" 202 Accepted
2025-11-16 23:57:09,932 - lava_callback - INFO - Starting async job submit for node 69188dd6be9adb01fa8e5f3d
2025-11-16 23:57:10,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:57:10,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dd6be9adb01fa8e5f3d HTTP/1.1" 200 None
2025-11-16 23:57:10,095 - lava_callback - DEBUG - Processing node 69188dd6be9adb01fa8e5f3d: ltp-containers
2025-11-16 23:57:10,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:57:11,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:57392 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:57408 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:57:21,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:57:21,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
INFO:     172.20.0.1:57320 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:57:31,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:57:31,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:57:31,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69188dd6be9adb01fa8e5f3d/log.txt.gz
2025-11-16 23:57:31,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:57:31,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:57:31,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69188dd6be9adb01fa8e5f3d/lava_callback.json.gz
DEBUG: 69188dd6be9adb01fa8e5f3d Transitting job node result: pass -> fail
2025-11-16 23:57:31,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:57:31,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dd6be9adb01fa8e5f3d HTTP/1.1" 200 None
2025-11-16 23:57:31,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:57:31,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-16 23:57:31,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:57:31,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188dd6be9adb01fa8e5f3d HTTP/1.1" 200 None
2025-11-16 23:57:31,995 - lava_callback - INFO - Completed processing callback for node 69188dd6be9adb01fa8e5f3d
INFO:     172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:45700 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:55848 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:58:05,179 - lava_callback - INFO - Received callback for node 6917c1fb364b1cb06de85390
INFO:     172.20.0.1:59570 - "POST /node/6917c1fb364b1cb06de85390 HTTP/1.0" 202 Accepted
2025-11-16 23:58:05,184 - lava_callback - INFO - Starting async job submit for node 6917c1fb364b1cb06de85390
2025-11-16 23:58:05,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:05,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6917c1fb364b1cb06de85390 HTTP/1.1" 200 None
2025-11-16 23:58:05,228 - lava_callback - DEBUG - Processing node 6917c1fb364b1cb06de85390: baseline-x86
2025-11-16 23:58:05,229 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 6917c1fb364b1cb06de85390
2025-11-16 23:58:05,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:05,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6917c1fb364b1cb06de85390 HTTP/1.1" 200 None
2025-11-16 23:58:05,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:05,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69176031364b1cb06de80a19 HTTP/1.1" 200 None
2025-11-16 23:58:05,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:05,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6917c1fb364b1cb06de85390 HTTP/1.1" 200 None
2025-11-16 23:58:05,295 - lava_callback - INFO - Completed processing callback for node 6917c1fb364b1cb06de85390
INFO:     172.20.0.1:59586 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:58:11,852 - lava_callback - INFO - Received callback for node 691a63a2121efb600bc71800
INFO:     172.20.0.1:59126 - "POST /node/691a63a2121efb600bc71800 HTTP/1.0" 202 Accepted
2025-11-16 23:58:11,859 - lava_callback - INFO - Starting async job submit for node 691a63a2121efb600bc71800
2025-11-16 23:58:11,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:11,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a2121efb600bc71800 HTTP/1.1" 200 None
2025-11-16 23:58:11,895 - lava_callback - DEBUG - Processing node 691a63a2121efb600bc71800: baseline-arm64-clabbe
2025-11-16 23:58:12,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:58:12,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:58:12,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a2121efb600bc71800/log.txt.gz
2025-11-16 23:58:12,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:58:12,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:58:12,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a2121efb600bc71800/lava_callback.json.gz
2025-11-16 23:58:12,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:12,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a2121efb600bc71800 HTTP/1.1" 200 None
2025-11-16 23:58:12,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:12,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:58:12,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:12,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a2121efb600bc71800 HTTP/1.1" 200 None
2025-11-16 23:58:12,877 - lava_callback - INFO - Completed processing callback for node 691a63a2121efb600bc71800
INFO:     172.20.0.1:59130 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:59142 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:42446 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:58:31,221 - lava_callback - INFO - Received callback for node 691a639a121efb600bc717c5
INFO:     172.20.0.1:42776 - "POST /node/691a639a121efb600bc717c5 HTTP/1.0" 202 Accepted
2025-11-16 23:58:31,231 - lava_callback - INFO - Starting async job submit for node 691a639a121efb600bc717c5
2025-11-16 23:58:31,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:31,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639a121efb600bc717c5 HTTP/1.1" 200 None
2025-11-16 23:58:31,308 - lava_callback - DEBUG - Processing node 691a639a121efb600bc717c5: baseline-arm64-broonie
2025-11-16 23:58:31,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:58:32,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:58:32,320 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639a121efb600bc717c5/log.txt.gz
2025-11-16 23:58:32,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:58:32,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:58:32,738 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639a121efb600bc717c5/lava_callback.json.gz
2025-11-16 23:58:32,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:32,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639a121efb600bc717c5 HTTP/1.1" 200 None
2025-11-16 23:58:32,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:32,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:58:32,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:58:32,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a639a121efb600bc717c5 HTTP/1.1" 200 None
2025-11-16 23:58:32,844 - lava_callback - INFO - Completed processing callback for node 691a639a121efb600bc717c5
INFO:     172.20.0.1:42778 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:39414 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:48690 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:48694 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:59:00,712 - lava_callback - INFO - Received callback for node 691a63a1121efb600bc717fd
INFO:     172.20.0.1:33508 - "POST /node/691a63a1121efb600bc717fd HTTP/1.0" 202 Accepted
2025-11-16 23:59:00,718 - lava_callback - INFO - Starting async job submit for node 691a63a1121efb600bc717fd
2025-11-16 23:59:00,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:00,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a1121efb600bc717fd HTTP/1.1" 200 None
2025-11-16 23:59:00,758 - lava_callback - DEBUG - Processing node 691a63a1121efb600bc717fd: baseline-arm64-clabbe
2025-11-16 23:59:01,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:01,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
2025-11-16 23:59:02,763 - lava_callback - INFO - Received callback for node 691a63a3121efb600bc71809
INFO:     172.20.0.1:33510 - "POST /node/691a63a3121efb600bc71809 HTTP/1.0" 202 Accepted
2025-11-16 23:59:02,770 - lava_callback - INFO - Starting async job submit for node 691a63a3121efb600bc71809
2025-11-16 23:59:02,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:02,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a3121efb600bc71809 HTTP/1.1" 200 None
2025-11-16 23:59:02,811 - lava_callback - DEBUG - Processing node 691a63a3121efb600bc71809: baseline-arm64-clabbe
2025-11-16 23:59:03,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:03,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:33512 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:59:10,760 - lava_callback - INFO - Received callback for node 691a6397121efb600bc717af
INFO:     172.20.0.1:47416 - "POST /node/691a6397121efb600bc717af HTTP/1.0" 202 Accepted
2025-11-16 23:59:10,766 - lava_callback - INFO - Starting async job submit for node 691a6397121efb600bc717af
2025-11-16 23:59:10,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:10,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6397121efb600bc717af HTTP/1.1" 200 None
2025-11-16 23:59:10,805 - lava_callback - DEBUG - Processing node 691a6397121efb600bc717af: baseline-arm64-broonie
2025-11-16 23:59:11,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:11,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:13,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:13,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
INFO:     172.20.0.1:47428 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:59:23,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:36106 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:35910 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:59:44,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:59:44,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a3121efb600bc71809/log.txt.gz
2025-11-16 23:59:44,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:59:44,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a1121efb600bc717fd/log.txt.gz
2025-11-16 23:59:44,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:44,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:44,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:59:44,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a6397121efb600bc717af/log.txt.gz
2025-11-16 23:59:44,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:44,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:59:44,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a6397121efb600bc717af/lava_callback.json.gz
2025-11-16 23:59:44,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:59:44,638 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a3121efb600bc71809/lava_callback.json.gz
2025-11-16 23:59:44,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:59:44,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a1121efb600bc717fd/lava_callback.json.gz
2025-11-16 23:59:44,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6397121efb600bc717af HTTP/1.1" 200 None
2025-11-16 23:59:44,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:59:44,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a3121efb600bc71809 HTTP/1.1" 200 None
2025-11-16 23:59:44,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a1121efb600bc717fd HTTP/1.1" 200 None
2025-11-16 23:59:44,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:59:44,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-16 23:59:44,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:44,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a6397121efb600bc717af HTTP/1.1" 200 None
2025-11-16 23:59:44,839 - lava_callback - INFO - Completed processing callback for node 691a6397121efb600bc717af
2025-11-16 23:59:44,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a3121efb600bc71809 HTTP/1.1" 200 None
2025-11-16 23:59:44,862 - lava_callback - INFO - Completed processing callback for node 691a63a3121efb600bc71809
2025-11-16 23:59:44,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a1121efb600bc717fd HTTP/1.1" 200 None
2025-11-16 23:59:44,952 - lava_callback - INFO - Completed processing callback for node 691a63a1121efb600bc717fd
INFO:     172.20.0.1:43254 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:57560 - "GET / HTTP/1.0" 200 OK
2025-11-16 23:59:51,533 - lava_callback - INFO - Received callback for node 691a53bd4a84e6a368676c8f
INFO:     172.20.0.1:57570 - "POST /node/691a53bd4a84e6a368676c8f HTTP/1.0" 202 Accepted
2025-11-16 23:59:51,542 - lava_callback - INFO - Starting async job submit for node 691a53bd4a84e6a368676c8f
2025-11-16 23:59:51,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:51,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a53bd4a84e6a368676c8f HTTP/1.1" 200 None
2025-11-16 23:59:51,631 - lava_callback - DEBUG - Processing node 691a53bd4a84e6a368676c8f: ltp-smoketest
2025-11-16 23:59:52,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:52,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:59:52,372 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-691a53bd4a84e6a368676c8f/log.txt.gz
2025-11-16 23:59:52,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-16 23:59:52,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-16 23:59:52,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-691a53bd4a84e6a368676c8f/lava_callback.json.gz
2025-11-16 23:59:52,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:52,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a53bd4a84e6a368676c8f HTTP/1.1" 200 None
2025-11-16 23:59:52,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:52,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a500f4a84e6a36867641a HTTP/1.1" 200 None
2025-11-16 23:59:52,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-16 23:59:52,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a53bd4a84e6a368676c8f HTTP/1.1" 200 None
2025-11-16 23:59:52,745 - lava_callback - INFO - Completed processing callback for node 691a53bd4a84e6a368676c8f
INFO:     172.20.0.1:57586 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:57888 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:44812 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:44822 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:00:19,941 - lava_callback - INFO - Received callback for node 691a6387121efb600bc7174f
INFO:     172.20.0.1:51202 - "POST /node/691a6387121efb600bc7174f HTTP/1.0" 202 Accepted
2025-11-17 00:00:19,952 - lava_callback - INFO - Starting async job submit for node 691a6387121efb600bc7174f
2025-11-17 00:00:19,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:20,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6387121efb600bc7174f HTTP/1.1" 200 None
2025-11-17 00:00:20,029 - lava_callback - DEBUG - Processing node 691a6387121efb600bc7174f: baseline-arm64
2025-11-17 00:00:20,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:00:20,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:00:20,852 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-691a6387121efb600bc7174f/log.txt.gz
2025-11-17 00:00:20,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:00:21,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:00:21,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-691a6387121efb600bc7174f/lava_callback.json.gz
2025-11-17 00:00:21,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:21,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6387121efb600bc7174f HTTP/1.1" 200 None
2025-11-17 00:00:21,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:21,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:00:21,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:21,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a6387121efb600bc7174f HTTP/1.1" 200 None
2025-11-17 00:00:21,144 - lava_callback - INFO - Completed processing callback for node 691a6387121efb600bc7174f
INFO:     172.20.0.1:51218 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:00:33,894 - lava_callback - INFO - Received callback for node 691a63a2121efb600bc71805
INFO:     172.20.0.1:54608 - "POST /node/691a63a2121efb600bc71805 HTTP/1.0" 202 Accepted
2025-11-17 00:00:33,900 - lava_callback - INFO - Starting async job submit for node 691a63a2121efb600bc71805
2025-11-17 00:00:33,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:33,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a2121efb600bc71805 HTTP/1.1" 200 None
2025-11-17 00:00:33,944 - lava_callback - DEBUG - Processing node 691a63a2121efb600bc71805: baseline-arm64-clabbe
2025-11-17 00:00:34,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:00:34,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:00:34,394 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a2121efb600bc71805/log.txt.gz
2025-11-17 00:00:34,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:00:34,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:00:34,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a2121efb600bc71805/lava_callback.json.gz
2025-11-17 00:00:34,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:34,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a2121efb600bc71805 HTTP/1.1" 200 None
2025-11-17 00:00:34,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:34,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:00:34,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:34,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a2121efb600bc71805 HTTP/1.1" 200 None
2025-11-17 00:00:34,673 - lava_callback - INFO - Completed processing callback for node 691a63a2121efb600bc71805
INFO:     172.20.0.1:54620 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:00:36,815 - lava_callback - INFO - Received callback for node 691a56304a84e6a368676ea7
INFO:     172.20.0.1:54628 - "POST /node/691a56304a84e6a368676ea7 HTTP/1.0" 202 Accepted
2025-11-17 00:00:36,824 - lava_callback - INFO - Starting async job submit for node 691a56304a84e6a368676ea7
2025-11-17 00:00:36,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:36,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a56304a84e6a368676ea7 HTTP/1.1" 200 None
2025-11-17 00:00:36,896 - lava_callback - DEBUG - Processing node 691a56304a84e6a368676ea7: baseline-x86
2025-11-17 00:00:38,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:00:38,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:00:38,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-691a56304a84e6a368676ea7/log.txt.gz
2025-11-17 00:00:38,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:00:38,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:00:38,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-691a56304a84e6a368676ea7/lava_callback.json.gz
DEBUG: Setup failed for 691a56304a84e6a368676ea7. Transitting job node result: incomplete -> fail
2025-11-17 00:00:38,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:38,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a56304a84e6a368676ea7 HTTP/1.1" 200 None
2025-11-17 00:00:38,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:38,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a3619df7c70114a62377b HTTP/1.1" 200 None
2025-11-17 00:00:38,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:00:38,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a56304a84e6a368676ea7 HTTP/1.1" 200 None
2025-11-17 00:00:38,639 - lava_callback - INFO - Completed processing callback for node 691a56304a84e6a368676ea7
INFO:     172.20.0.1:48066 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:32838 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:32850 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:59276 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:01:14,310 - lava_callback - INFO - Received callback for node 691a638b121efb600bc7176a
INFO:     172.20.0.1:37526 - "POST /node/691a638b121efb600bc7176a HTTP/1.0" 202 Accepted
2025-11-17 00:01:14,320 - lava_callback - INFO - Starting async job submit for node 691a638b121efb600bc7176a
2025-11-17 00:01:14,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:01:14,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a638b121efb600bc7176a HTTP/1.1" 200 None
2025-11-17 00:01:14,369 - lava_callback - DEBUG - Processing node 691a638b121efb600bc7176a: baseline-arm64
2025-11-17 00:01:14,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:37528 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:37544 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:54574 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:01:30,080 - lava_callback - INFO - Received callback for node 691a6399121efb600bc717bf
INFO:     172.20.0.1:53852 - "POST /node/691a6399121efb600bc717bf HTTP/1.0" 202 Accepted
2025-11-17 00:01:30,087 - lava_callback - INFO - Starting async job submit for node 691a6399121efb600bc717bf
2025-11-17 00:01:30,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:01:30,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6399121efb600bc717bf HTTP/1.1" 200 None
2025-11-17 00:01:30,127 - lava_callback - DEBUG - Processing node 691a6399121efb600bc717bf: baseline-arm64-broonie
2025-11-17 00:01:30,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:01:30,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:53868 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:01:40,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:57524 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:59406 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:01:52,690 - lava_callback - INFO - Received callback for node 691a63a3121efb600bc7180c
INFO:     172.20.0.1:59422 - "POST /node/691a63a3121efb600bc7180c HTTP/1.0" 202 Accepted
2025-11-17 00:01:52,697 - lava_callback - INFO - Starting async job submit for node 691a63a3121efb600bc7180c
2025-11-17 00:01:52,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:01:52,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a3121efb600bc7180c HTTP/1.1" 200 None
2025-11-17 00:01:52,739 - lava_callback - DEBUG - Processing node 691a63a3121efb600bc7180c: baseline-arm64-clabbe
2025-11-17 00:01:52,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:59428 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:35220 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:02:13,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:02:13,922 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-691a638b121efb600bc7176a/log.txt.gz
2025-11-17 00:02:13,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:02:13,930 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a6399121efb600bc717bf/log.txt.gz
2025-11-17 00:02:13,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:02:13,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:02:13,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:02:13,981 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a3121efb600bc7180c/log.txt.gz
2025-11-17 00:02:13,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:02:14,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:02:14,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-691a638b121efb600bc7176a/lava_callback.json.gz
2025-11-17 00:02:14,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a638b121efb600bc7176a HTTP/1.1" 200 None
2025-11-17 00:02:14,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:02:14,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:02:14,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a6399121efb600bc717bf/lava_callback.json.gz
2025-11-17 00:02:14,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a638b121efb600bc7176a HTTP/1.1" 200 None
2025-11-17 00:02:14,394 - lava_callback - INFO - Completed processing callback for node 691a638b121efb600bc7176a
2025-11-17 00:02:14,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6399121efb600bc717bf HTTP/1.1" 200 None
2025-11-17 00:02:14,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:02:14,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a63a3121efb600bc7180c/lava_callback.json.gz
2025-11-17 00:02:14,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:02:14,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a3121efb600bc7180c HTTP/1.1" 200 None
2025-11-17 00:02:14,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a6399121efb600bc717bf HTTP/1.1" 200 None
2025-11-17 00:02:14,587 - lava_callback - INFO - Completed processing callback for node 691a6399121efb600bc717bf
2025-11-17 00:02:14,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:02:14,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:02:14,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a3121efb600bc7180c HTTP/1.1" 200 None
2025-11-17 00:02:14,647 - lava_callback - INFO - Completed processing callback for node 691a63a3121efb600bc7180c
INFO:     172.20.0.1:37254 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:37256 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:48212 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:56412 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:51018 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:51030 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:03:06,163 - lava_callback - INFO - Received callback for node 691a63a7121efb600bc71821
INFO:     172.20.0.1:36584 - "POST /node/691a63a7121efb600bc71821 HTTP/1.0" 202 Accepted
2025-11-17 00:03:06,172 - lava_callback - INFO - Starting async job submit for node 691a63a7121efb600bc71821
2025-11-17 00:03:06,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:03:06,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a7121efb600bc71821 HTTP/1.1" 200 None
2025-11-17 00:03:06,191 - lava_callback - DEBUG - Processing node 691a63a7121efb600bc71821: baseline-arm64-foundriesio
2025-11-17 00:03:06,216 - lava_callback - WARNING - Failed to upload log
2025-11-17 00:03:06,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:03:06,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:03:06,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-691a63a7121efb600bc71821/lava_callback.json.gz
2025-11-17 00:03:06,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
INFO:     172.20.0.1:36590 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:03:06,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a7121efb600bc71821 HTTP/1.1" 200 None
2025-11-17 00:03:06,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:03:06,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:03:06,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:03:06,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a7121efb600bc71821 HTTP/1.1" 200 None
2025-11-17 00:03:06,575 - lava_callback - INFO - Completed processing callback for node 691a63a7121efb600bc71821
INFO:     172.20.0.1:51488 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:51492 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:53866 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:03:45,660 - lava_callback - INFO - Received callback for node 691a63a9121efb600bc71827
INFO:     172.20.0.1:60194 - "POST /node/691a63a9121efb600bc71827 HTTP/1.0" 202 Accepted
2025-11-17 00:03:45,668 - lava_callback - INFO - Starting async job submit for node 691a63a9121efb600bc71827
2025-11-17 00:03:45,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:03:45,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a9121efb600bc71827 HTTP/1.1" 200 None
2025-11-17 00:03:45,686 - lava_callback - DEBUG - Processing node 691a63a9121efb600bc71827: baseline-arm64-foundriesio
2025-11-17 00:03:45,693 - lava_callback - WARNING - Failed to upload log
2025-11-17 00:03:45,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:03:45,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:60204 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:55470 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:03:55,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:03:56,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:03:56,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-691a63a9121efb600bc71827/lava_callback.json.gz
2025-11-17 00:03:56,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:03:56,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a9121efb600bc71827 HTTP/1.1" 200 None
2025-11-17 00:03:56,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:03:56,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:03:56,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:03:56,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a9121efb600bc71827 HTTP/1.1" 200 None
2025-11-17 00:03:56,067 - lava_callback - INFO - Completed processing callback for node 691a63a9121efb600bc71827
INFO:     172.20.0.1:55480 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:38688 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:04:10,502 - lava_callback - INFO - Received callback for node 69188dd8be9adb01fa8e5f40
INFO:     172.20.0.1:44064 - "POST /node/69188dd8be9adb01fa8e5f40 HTTP/1.0" 202 Accepted
2025-11-17 00:04:10,516 - lava_callback - INFO - Starting async job submit for node 69188dd8be9adb01fa8e5f40
2025-11-17 00:04:10,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:10,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dd8be9adb01fa8e5f40 HTTP/1.1" 200 None
2025-11-17 00:04:10,966 - lava_callback - DEBUG - Processing node 69188dd8be9adb01fa8e5f40: ltp-controllers
2025-11-17 00:04:12,246 - lava_callback - INFO - Received callback for node 69188de9be9adb01fa8e5f4a
INFO:     172.20.0.1:44078 - "POST /node/69188de9be9adb01fa8e5f4a HTTP/1.0" 202 Accepted
2025-11-17 00:04:12,268 - lava_callback - INFO - Starting async job submit for node 69188de9be9adb01fa8e5f4a
2025-11-17 00:04:12,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:12,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188de9be9adb01fa8e5f4a HTTP/1.1" 200 None
2025-11-17 00:04:12,599 - lava_callback - DEBUG - Processing node 69188de9be9adb01fa8e5f4a: ltp-fs-bind
2025-11-17 00:04:14,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:14,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
2025-11-17 00:04:14,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:14,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:44090 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:44098 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:04:24,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:24,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
2025-11-17 00:04:24,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:24,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
INFO:     172.20.0.1:52674 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:04:29,610 - lava_callback - INFO - Received callback for node 691a663b5a241304011d513c
INFO:     172.20.0.1:52678 - "POST /node/691a663b5a241304011d513c HTTP/1.0" 202 Accepted
2025-11-17 00:04:29,619 - lava_callback - INFO - Starting async job submit for node 691a663b5a241304011d513c
2025-11-17 00:04:29,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:29,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a663b5a241304011d513c HTTP/1.1" 200 None
2025-11-17 00:04:29,665 - lava_callback - DEBUG - Processing node 691a663b5a241304011d513c: baseline-arm64-foundriesio
2025-11-17 00:04:29,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:29,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
2025-11-17 00:04:34,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:34,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:04:34,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs-bind-69188de9be9adb01fa8e5f4a/log.txt.gz
2025-11-17 00:04:34,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:34,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:04:34,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs-bind-69188de9be9adb01fa8e5f4a/lava_callback.json.gz
2025-11-17 00:04:34,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:34,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188de9be9adb01fa8e5f4a HTTP/1.1" 200 None
2025-11-17 00:04:34,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:34,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-17 00:04:34,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:34,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:34,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 3 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (2 retries remaining)
2025-11-17 00:04:35,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188de9be9adb01fa8e5f4a HTTP/1.1" 200 None
2025-11-17 00:04:35,064 - lava_callback - INFO - Completed processing callback for node 69188de9be9adb01fa8e5f4a
INFO:     172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:04:39,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:39,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
2025-11-17 00:04:44,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:44,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 4 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (1 retries remaining)
INFO:     172.20.0.1:59726 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:04:49,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:50,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:04:50,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-691a663b5a241304011d513c/log.txt.gz
2025-11-17 00:04:50,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:50,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:04:50,435 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-691a663b5a241304011d513c/lava_callback.json.gz
2025-11-17 00:04:50,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:50,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a663b5a241304011d513c HTTP/1.1" 200 None
2025-11-17 00:04:50,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:50,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:04:50,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:50,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a663b5a241304011d513c HTTP/1.1" 200 None
2025-11-17 00:04:50,549 - lava_callback - INFO - Completed processing callback for node 691a663b5a241304011d513c
INFO:     172.20.0.1:44220 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:04:54,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:55,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:04:55,084 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69188dd8be9adb01fa8e5f40/log.txt.gz
2025-11-17 00:04:55,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:04:55,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:04:55,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69188dd8be9adb01fa8e5f40/lava_callback.json.gz
DEBUG: 69188dd8be9adb01fa8e5f40 Transitting job node result: pass -> fail
2025-11-17 00:04:55,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:55,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dd8be9adb01fa8e5f40 HTTP/1.1" 200 None
2025-11-17 00:04:55,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:55,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-17 00:04:55,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:04:56,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188dd8be9adb01fa8e5f40 HTTP/1.1" 200 None
2025-11-17 00:04:56,533 - lava_callback - INFO - Completed processing callback for node 69188dd8be9adb01fa8e5f40
INFO:     172.20.0.1:44226 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:38152 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:53230 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:53240 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:36078 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:05:32,810 - lava_callback - INFO - Received callback for node 691a639c121efb600bc717d9
INFO:     172.20.0.1:49852 - "POST /node/691a639c121efb600bc717d9 HTTP/1.0" 202 Accepted
2025-11-17 00:05:32,819 - lava_callback - INFO - Starting async job submit for node 691a639c121efb600bc717d9
2025-11-17 00:05:32,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:05:32,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639c121efb600bc717d9 HTTP/1.1" 200 None
2025-11-17 00:05:32,903 - lava_callback - DEBUG - Processing node 691a639c121efb600bc717d9: baseline-arm64-broonie
2025-11-17 00:05:33,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:05:33,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:05:33,512 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639c121efb600bc717d9/log.txt.gz
2025-11-17 00:05:33,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:05:33,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:05:33,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639c121efb600bc717d9/lava_callback.json.gz
2025-11-17 00:05:33,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:05:33,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639c121efb600bc717d9 HTTP/1.1" 200 None
2025-11-17 00:05:33,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:05:33,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:05:33,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:05:33,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a639c121efb600bc717d9 HTTP/1.1" 200 None
2025-11-17 00:05:33,850 - lava_callback - INFO - Completed processing callback for node 691a639c121efb600bc717d9
INFO:     172.20.0.1:49864 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:50698 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:60458 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:60472 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:53744 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:60560 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:60572 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:57244 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:06:29,976 - lava_callback - INFO - Received callback for node 69188dfabe9adb01fa8e5f52
INFO:     172.20.0.1:42344 - "POST /node/69188dfabe9adb01fa8e5f52 HTTP/1.0" 202 Accepted
2025-11-17 00:06:29,985 - lava_callback - INFO - Starting async job submit for node 69188dfabe9adb01fa8e5f52
2025-11-17 00:06:30,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:06:30,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dfabe9adb01fa8e5f52 HTTP/1.1" 200 None
2025-11-17 00:06:30,065 - lava_callback - DEBUG - Processing node 69188dfabe9adb01fa8e5f52: ltp-input
2025-11-17 00:06:30,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:06:31,932 - lava_callback - INFO - Received callback for node 691a639b121efb600bc717d1
INFO:     172.20.0.1:42348 - "POST /node/691a639b121efb600bc717d1 HTTP/1.0" 202 Accepted
2025-11-17 00:06:31,941 - lava_callback - INFO - Starting async job submit for node 691a639b121efb600bc717d1
2025-11-17 00:06:31,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:06:32,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639b121efb600bc717d1 HTTP/1.1" 200 None
2025-11-17 00:06:32,004 - lava_callback - DEBUG - Processing node 691a639b121efb600bc717d1: baseline-arm64-broonie
2025-11-17 00:06:32,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:42350 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:48240 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:38756 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:38760 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:35008 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:52022 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:52032 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:49850 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:07:31,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:07:31,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69188dfabe9adb01fa8e5f52/log.txt.gz
2025-11-17 00:07:31,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:07:31,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:07:31,363 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639b121efb600bc717d1/log.txt.gz
2025-11-17 00:07:31,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:07:31,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:07:31,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69188dfabe9adb01fa8e5f52/lava_callback.json.gz
2025-11-17 00:07:31,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:07:31,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:07:31,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-691a639b121efb600bc717d1/lava_callback.json.gz
2025-11-17 00:07:31,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:07:31,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dfabe9adb01fa8e5f52 HTTP/1.1" 200 None
2025-11-17 00:07:31,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:07:31,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a639b121efb600bc717d1 HTTP/1.1" 200 None
2025-11-17 00:07:31,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:07:31,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-17 00:07:31,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:07:31,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:07:31,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:07:31,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188dfabe9adb01fa8e5f52 HTTP/1.1" 200 None
2025-11-17 00:07:31,745 - lava_callback - INFO - Completed processing callback for node 69188dfabe9adb01fa8e5f52
2025-11-17 00:07:31,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a639b121efb600bc717d1 HTTP/1.1" 200 None
2025-11-17 00:07:31,766 - lava_callback - INFO - Completed processing callback for node 691a639b121efb600bc717d1
2025-11-17 00:07:33,045 - lava_callback - INFO - Received callback for node 691a62e2121efb600bc71626
INFO:     172.20.0.1:42326 - "POST /node/691a62e2121efb600bc71626 HTTP/1.0" 202 Accepted
2025-11-17 00:07:33,053 - lava_callback - INFO - Starting async job submit for node 691a62e2121efb600bc71626
2025-11-17 00:07:33,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:07:33,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a62e2121efb600bc71626 HTTP/1.1" 200 None
2025-11-17 00:07:33,108 - lava_callback - DEBUG - Processing node 691a62e2121efb600bc71626: baseline-arm
2025-11-17 00:07:33,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:07:33,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:42328 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:07:43,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:07:43,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
INFO:     172.20.0.1:55732 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:56534 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:07:53,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:07:53,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 3 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (2 retries remaining)
INFO:     172.20.0.1:56548 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:08:03,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:08:03,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 4 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (1 retries remaining)
INFO:     172.20.0.1:33650 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:08:13,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:08:13,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload failed after 5 attempts
2025-11-17 00:08:13,618 - lava_callback - ERROR - Error processing callback for node 691a62e2121efb600bc71626: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Traceback (most recent call last):
  File "/home/kernelci/pipeline/lava_callback.py", line 283, in async_job_submit
    log_txt_url = _upload_log(log_parser, job_node, storage)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/kernelci/pipeline/lava_callback.py", line 216, in _upload_log
    return _upload_file(storage, job_node, src, 'log.txt.gz')
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/kernelci/pipeline/lava_callback.py", line 182, in _upload_file
    return storage.upload_single((source_name, destination_name), upload_dir)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/kernelci/storage/__init__.py", line 69, in upload_single
    urls = self._upload([file_path], dest_path)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/kernelci/storage/backend.py", line 118, in _upload
    raise last_exception
  File "/usr/local/lib/python3.12/site-packages/kernelci/storage/backend.py", line 84, in _upload
    resp.raise_for_status()
  File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1026, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
INFO:     172.20.0.1:59372 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:59374 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:39694 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:34978 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:08:50,721 - lava_callback - INFO - Received callback for node 69188dfebe9adb01fa8e5f58
INFO:     172.20.0.1:41850 - "POST /node/69188dfebe9adb01fa8e5f58 HTTP/1.0" 202 Accepted
2025-11-17 00:08:50,728 - lava_callback - INFO - Starting async job submit for node 69188dfebe9adb01fa8e5f58
2025-11-17 00:08:50,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:08:50,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dfebe9adb01fa8e5f58 HTTP/1.1" 200 None
2025-11-17 00:08:50,807 - lava_callback - DEBUG - Processing node 69188dfebe9adb01fa8e5f58: ltp-pty
2025-11-17 00:08:51,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:41862 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:08:51,607 - lava_callback - INFO - Received callback for node 691a6327121efb600bc716fd
INFO:     172.20.0.1:41872 - "POST /node/691a6327121efb600bc716fd HTTP/1.0" 202 Accepted
2025-11-17 00:08:51,614 - lava_callback - INFO - Starting async job submit for node 691a6327121efb600bc716fd
2025-11-17 00:08:51,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:08:51,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6327121efb600bc716fd HTTP/1.1" 200 None
2025-11-17 00:08:51,680 - lava_callback - DEBUG - Processing node 691a6327121efb600bc716fd: baseline-arm-pengutronix
2025-11-17 00:08:51,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:08:52,211 - lava_callback - INFO - Received callback for node 691a666d5a241304011d5140
INFO:     172.20.0.1:41874 - "POST /node/691a666d5a241304011d5140 HTTP/1.0" 202 Accepted
2025-11-17 00:08:52,222 - lava_callback - INFO - Starting async job submit for node 691a666d5a241304011d5140
2025-11-17 00:08:52,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:08:52,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a666d5a241304011d5140 HTTP/1.1" 200 None
2025-11-17 00:08:52,243 - lava_callback - DEBUG - Processing node 691a666d5a241304011d5140: baseline-arm64-foundriesio
2025-11-17 00:08:52,250 - lava_callback - WARNING - Failed to upload log
2025-11-17 00:08:52,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:41884 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:53740 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:33764 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:33772 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:09:16,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:09:16,638 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-691a666d5a241304011d5140/lava_callback.json.gz
2025-11-17 00:09:16,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:16,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a666d5a241304011d5140 HTTP/1.1" 200 None
2025-11-17 00:09:16,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:16,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:09:16,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:16,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:09:16,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69188dfebe9adb01fa8e5f58/log.txt.gz
2025-11-17 00:09:16,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:09:16,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:09:16,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-691a6327121efb600bc716fd/log.txt.gz
2025-11-17 00:09:16,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a666d5a241304011d5140 HTTP/1.1" 200 None
2025-11-17 00:09:16,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:09:16,728 - lava_callback - INFO - Completed processing callback for node 691a666d5a241304011d5140
2025-11-17 00:09:16,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:09:16,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-691a6327121efb600bc716fd/lava_callback.json.gz
DEBUG: Setup failed for 691a6327121efb600bc716fd. Transitting job node result: incomplete -> fail
2025-11-17 00:09:17,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a6327121efb600bc716fd HTTP/1.1" 200 None
2025-11-17 00:09:17,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c2e121efb600bc70ece HTTP/1.1" 200 None
2025-11-17 00:09:17,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:09:17,301 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69188dfebe9adb01fa8e5f58/lava_callback.json.gz
2025-11-17 00:09:17,383 - lava_callback - INFO - Received callback for node 691a65a35a241304011d5125
INFO:     172.20.0.1:33780 - "POST /node/691a65a35a241304011d5125 HTTP/1.0" 202 Accepted
2025-11-17 00:09:17,392 - lava_callback - INFO - Starting async job submit for node 691a65a35a241304011d5125
2025-11-17 00:09:17,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a6327121efb600bc716fd HTTP/1.1" 200 None
2025-11-17 00:09:17,409 - lava_callback - INFO - Completed processing callback for node 691a6327121efb600bc716fd
2025-11-17 00:09:17,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a65a35a241304011d5125 HTTP/1.1" 200 None
2025-11-17 00:09:17,478 - lava_callback - DEBUG - Processing node 691a65a35a241304011d5125: baseline-arm64-clabbe
2025-11-17 00:09:17,487 - lava_callback - WARNING - Failed to upload log
2025-11-17 00:09:17,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dfebe9adb01fa8e5f58 HTTP/1.1" 200 None
2025-11-17 00:09:17,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:09:17,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-17 00:09:17,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188dfebe9adb01fa8e5f58 HTTP/1.1" 200 None
2025-11-17 00:09:17,603 - lava_callback - INFO - Completed processing callback for node 69188dfebe9adb01fa8e5f58
2025-11-17 00:09:17,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:09:17,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-691a65a35a241304011d5125/lava_callback.json.gz
2025-11-17 00:09:17,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a65a35a241304011d5125 HTTP/1.1" 200 None
2025-11-17 00:09:17,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:09:17,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:17,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a65a35a241304011d5125 HTTP/1.1" 200 None
2025-11-17 00:09:17,900 - lava_callback - INFO - Completed processing callback for node 691a65a35a241304011d5125
INFO:     172.20.0.1:34650 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:35848 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:60542 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:09:50,107 - lava_callback - INFO - Received callback for node 69188dfdbe9adb01fa8e5f55
INFO:     172.20.0.1:50524 - "POST /node/69188dfdbe9adb01fa8e5f55 HTTP/1.0" 202 Accepted
2025-11-17 00:09:50,115 - lava_callback - INFO - Starting async job submit for node 69188dfdbe9adb01fa8e5f55
2025-11-17 00:09:50,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:09:50,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dfdbe9adb01fa8e5f55 HTTP/1.1" 200 None
2025-11-17 00:09:50,232 - lava_callback - DEBUG - Processing node 69188dfdbe9adb01fa8e5f55: ltp-ipc
2025-11-17 00:09:50,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:09:50,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:50540 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:50546 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:10:00,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
Upload attempt 2 failed with ConnectionError: HTTPSConnectionPool(host='files-staging.kernelci.org', port=443): Max retries exceeded with url: /upload (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f908e9ecb30>: Failed to resolve 'files-staging.kernelci.org' ([Errno -2] Name or service not known)"))
Retrying in 10 seconds... (3 retries remaining)
INFO:     172.20.0.1:36368 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:10:14,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:10:14,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:10:14,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69188dfdbe9adb01fa8e5f55/log.txt.gz
2025-11-17 00:10:14,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:50726 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:50742 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:10:18,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:10:18,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69188dfdbe9adb01fa8e5f55/lava_callback.json.gz
2025-11-17 00:10:18,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:10:18,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188dfdbe9adb01fa8e5f55 HTTP/1.1" 200 None
2025-11-17 00:10:18,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:10:18,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-17 00:10:18,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:10:18,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188dfdbe9adb01fa8e5f55 HTTP/1.1" 200 None
2025-11-17 00:10:18,981 - lava_callback - INFO - Completed processing callback for node 69188dfdbe9adb01fa8e5f55
INFO:     172.20.0.1:42760 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:56642 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:49604 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:49608 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:47412 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:47928 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:34218 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:11:28,896 - lava_callback - INFO - Received callback for node 6917ce0c4a7acaa232fb2f0f
INFO:     172.20.0.1:34220 - "POST /node/6917ce0c4a7acaa232fb2f0f HTTP/1.0" 202 Accepted
2025-11-17 00:11:28,903 - lava_callback - INFO - Starting async job submit for node 6917ce0c4a7acaa232fb2f0f
2025-11-17 00:11:28,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:11:28,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6917ce0c4a7acaa232fb2f0f HTTP/1.1" 200 None
2025-11-17 00:11:28,958 - lava_callback - DEBUG - Processing node 6917ce0c4a7acaa232fb2f0f: baseline-arm64
2025-11-17 00:11:29,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:11:29,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:57654 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:11:39,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:11:41,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (3 retries remaining)
INFO:     172.20.0.1:44316 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:49676 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:11:51,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:11:51,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:11:51,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6917ce0c4a7acaa232fb2f0f/log.txt.gz
2025-11-17 00:11:51,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:11:52,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:11:52,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6917ce0c4a7acaa232fb2f0f/lava_callback.json.gz
DEBUG: Setup failed for 6917ce0c4a7acaa232fb2f0f. Transitting job node result: incomplete -> fail
2025-11-17 00:11:52,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:11:52,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6917ce0c4a7acaa232fb2f0f HTTP/1.1" 200 None
2025-11-17 00:11:52,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:11:52,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69127d98e314d938f239f6a0 HTTP/1.1" 200 None
2025-11-17 00:11:52,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:11:52,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6917ce0c4a7acaa232fb2f0f HTTP/1.1" 200 None
2025-11-17 00:11:52,301 - lava_callback - INFO - Completed processing callback for node 6917ce0c4a7acaa232fb2f0f
INFO:     172.20.0.1:49688 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:12:09,596 - lava_callback - INFO - Received callback for node 6917c549364b1cb06de8540a
INFO:     172.20.0.1:51496 - "POST /node/6917c549364b1cb06de8540a HTTP/1.0" 202 Accepted
2025-11-17 00:12:09,602 - lava_callback - INFO - Starting async job submit for node 6917c549364b1cb06de8540a
2025-11-17 00:12:09,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:12:09,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6917c549364b1cb06de8540a HTTP/1.1" 200 None
2025-11-17 00:12:09,622 - lava_callback - DEBUG - Processing node 6917c549364b1cb06de8540a: baseline-arm-pengutronix
2025-11-17 00:12:09,622 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 6917c549364b1cb06de8540a
2025-11-17 00:12:09,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:12:09,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6917c549364b1cb06de8540a HTTP/1.1" 200 None
2025-11-17 00:12:09,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:12:09,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691523ca31ca249f61533b00 HTTP/1.1" 200 None
2025-11-17 00:12:09,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:12:09,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6917c549364b1cb06de8540a HTTP/1.1" 200 None
2025-11-17 00:12:09,675 - lava_callback - INFO - Completed processing callback for node 6917c549364b1cb06de8540a
INFO:     172.20.0.1:45850 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:45862 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:32936 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:12:27,642 - lava_callback - INFO - Received callback for node 691a638f121efb600bc71781
INFO:     172.20.0.1:32942 - "POST /node/691a638f121efb600bc71781 HTTP/1.0" 202 Accepted
2025-11-17 00:12:27,649 - lava_callback - INFO - Starting async job submit for node 691a638f121efb600bc71781
2025-11-17 00:12:27,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:12:27,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a638f121efb600bc71781 HTTP/1.1" 200 None
2025-11-17 00:12:27,699 - lava_callback - DEBUG - Processing node 691a638f121efb600bc71781: baseline-arm
2025-11-17 00:12:28,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:37930 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:58184 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:34720 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:34732 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:54712 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:13:09,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:13:09,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-691a638f121efb600bc71781/log.txt.gz
2025-11-17 00:13:09,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:13:10,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:13:10,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-691a638f121efb600bc71781/lava_callback.json.gz
DEBUG: Setup failed for 691a638f121efb600bc71781. Transitting job node result: incomplete -> fail
2025-11-17 00:13:10,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:10,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a638f121efb600bc71781 HTTP/1.1" 200 None
2025-11-17 00:13:10,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:10,407 - lava_callback - INFO - Received callback for node 69188e00be9adb01fa8e5f5b
INFO:     172.20.0.1:53848 - "POST /node/69188e00be9adb01fa8e5f5b HTTP/1.0" 202 Accepted
2025-11-17 00:13:10,425 - lava_callback - INFO - Starting async job submit for node 69188e00be9adb01fa8e5f5b
2025-11-17 00:13:10,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:10,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188e00be9adb01fa8e5f5b HTTP/1.1" 200 None
2025-11-17 00:13:10,522 - lava_callback - DEBUG - Processing node 69188e00be9adb01fa8e5f5b: ltp-sched
2025-11-17 00:13:10,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a50074a84e6a368676410 HTTP/1.1" 200 None
2025-11-17 00:13:10,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:10,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a638f121efb600bc71781 HTTP/1.1" 200 None
2025-11-17 00:13:10,681 - lava_callback - INFO - Completed processing callback for node 691a638f121efb600bc71781
2025-11-17 00:13:11,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:13:11,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:13:11,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69188e00be9adb01fa8e5f5b/log.txt.gz
2025-11-17 00:13:11,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:13:11,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:53864 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:53872 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:13:21,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:13:21,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:13:21,459 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69188e00be9adb01fa8e5f5b/lava_callback.json.gz
2025-11-17 00:13:21,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:21,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188e00be9adb01fa8e5f5b HTTP/1.1" 200 None
2025-11-17 00:13:21,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:21,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-17 00:13:21,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:21,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188e00be9adb01fa8e5f5b HTTP/1.1" 200 None
2025-11-17 00:13:21,559 - lava_callback - INFO - Completed processing callback for node 69188e00be9adb01fa8e5f5b
INFO:     172.20.0.1:55988 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:33430 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:13:50,609 - lava_callback - INFO - Received callback for node 69188df8be9adb01fa8e5f4f
INFO:     172.20.0.1:55788 - "POST /node/69188df8be9adb01fa8e5f4f HTTP/1.0" 202 Accepted
2025-11-17 00:13:50,619 - lava_callback - INFO - Starting async job submit for node 69188df8be9adb01fa8e5f4f
2025-11-17 00:13:50,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:50,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188df8be9adb01fa8e5f4f HTTP/1.1" 200 None
2025-11-17 00:13:50,703 - lava_callback - DEBUG - Processing node 69188df8be9adb01fa8e5f4f: ltp-fsx
INFO:     172.20.0.1:55804 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:13:51,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:13:51,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:13:51,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69188df8be9adb01fa8e5f4f/log.txt.gz
2025-11-17 00:13:51,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:13:51,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:13:51,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69188df8be9adb01fa8e5f4f/lava_callback.json.gz
DEBUG: 69188df8be9adb01fa8e5f4f Transitting job node result: pass -> incomplete
2025-11-17 00:13:51,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:51,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188df8be9adb01fa8e5f4f HTTP/1.1" 200 None
2025-11-17 00:13:51,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:51,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691833f84a7acaa232fb8c1e HTTP/1.1" 200 None
2025-11-17 00:13:51,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:13:51,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69188df8be9adb01fa8e5f4f HTTP/1.1" 200 None
2025-11-17 00:13:51,938 - lava_callback - INFO - Completed processing callback for node 69188df8be9adb01fa8e5f4f
INFO:     172.20.0.1:55810 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:45032 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:49586 - "GET /api/metrics HTTP/1.0" 200 OK
INFO:     172.20.0.1:49600 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:14:25,145 - lava_callback - INFO - Received callback for node 691a63a7121efb600bc7181e
INFO:     172.20.0.1:58390 - "POST /node/691a63a7121efb600bc7181e HTTP/1.0" 202 Accepted
2025-11-17 00:14:25,154 - lava_callback - INFO - Starting async job submit for node 691a63a7121efb600bc7181e
2025-11-17 00:14:25,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:14:25,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a7121efb600bc7181e HTTP/1.1" 200 None
2025-11-17 00:14:25,211 - lava_callback - DEBUG - Processing node 691a63a7121efb600bc7181e: baseline-arm64-pengutronix
2025-11-17 00:14:25,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:14:25,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Retrying in 10 seconds... (4 retries remaining)
INFO:     172.20.0.1:58402 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:14:35,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:14:35,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:14:35,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-691a63a7121efb600bc7181e/log.txt.gz
2025-11-17 00:14:35,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2025-11-17 00:14:35,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2025-11-17 00:14:35,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-691a63a7121efb600bc7181e/lava_callback.json.gz
2025-11-17 00:14:36,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:14:36,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a63a7121efb600bc7181e HTTP/1.1" 200 None
2025-11-17 00:14:36,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:14:36,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/691a5c3f121efb600bc70ede HTTP/1.1" 200 None
2025-11-17 00:14:36,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:14:36,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/691a63a7121efb600bc7181e HTTP/1.1" 200 None
2025-11-17 00:14:36,129 - lava_callback - INFO - Completed processing callback for node 691a63a7121efb600bc7181e
INFO:     172.20.0.1:35218 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:35266 - "GET / HTTP/1.0" 200 OK
INFO:     172.20.0.1:52212 - "GET / HTTP/1.0" 200 OK
2025-11-17 00:14:52,300 - lava_callback - INFO - Received callback for node 69188ddabe9adb01fa8e5f43
INFO:     172.20.0.1:52226 - "POST /node/69188ddabe9adb01fa8e5f43 HTTP/1.0" 202 Accepted
2025-11-17 00:14:52,312 - lava_callback - INFO - Starting async job submit for node 69188ddabe9adb01fa8e5f43
2025-11-17 00:14:52,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2025-11-17 00:14:52,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69188ddabe9adb01fa8e5f43 HTTP/1.1" 200 None
2025-11-17 00:14:52,502 - lava_callback - DEBUG - Processing node 69188ddabe9adb01fa8e5f43: ltp-cve
2025-11-17 00:14:53,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO:     172.20.0.1:52242 - "GET / HTTP/1.0" 200 OK
INFO:     Shutting down
INFO:     Waiting for application shutdown.
INFO:     Application shutdown complete.
INFO:     Finished server process [1]