INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:24:29,498 - lava_callback - INFO - Received callback for node 69acceb8bcd207e915d7778b 2026-03-08 08:24:29,511 - lava_callback - INFO - Starting async job submit for node 69acceb8bcd207e915d7778b INFO: 172.21.0.1:37680 - "POST /node/69acceb8bcd207e915d7778b HTTP/1.0" 202 Accepted 2026-03-08 08:24:29,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:24:29,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acceb8bcd207e915d7778b HTTP/1.1" 200 None 2026-03-08 08:24:29,552 - lava_callback - DEBUG - Processing node 69acceb8bcd207e915d7778b: baseline-arm64-broonie 2026-03-08 08:24:29,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:24:30,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:24:30,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69acceb8bcd207e915d7778b/log.txt.gz 2026-03-08 08:24:30,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:24:30,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:24:30,492 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69acceb8bcd207e915d7778b/lava-logs.yaml 2026-03-08 08:24:30,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:24:30,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:24:30,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69acceb8bcd207e915d7778b/lava_callback.json.gz 2026-03-08 08:24:30,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:24:30,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acceb8bcd207e915d7778b HTTP/1.1" 200 None 2026-03-08 08:24:30,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:24:30,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-08 08:24:30,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:24:30,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69acceb8bcd207e915d7778b HTTP/1.1" 200 None 2026-03-08 08:24:30,891 - lava_callback - INFO - Completed processing callback for node 69acceb8bcd207e915d7778b INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48114 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:25:00,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:25:00,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:25:49,425 - lava_callback - INFO - Received callback for node 69ad25c3bcd207e915d79492 INFO: 172.21.0.1:41262 - "POST /node/69ad25c3bcd207e915d79492 HTTP/1.0" 202 Accepted 2026-03-08 08:25:49,431 - lava_callback - INFO - Starting async job submit for node 69ad25c3bcd207e915d79492 2026-03-08 08:25:49,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:25:49,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad25c3bcd207e915d79492 HTTP/1.1" 200 None 2026-03-08 08:25:49,463 - lava_callback - DEBUG - Processing node 69ad25c3bcd207e915d79492: baseline-arm64-broonie 2026-03-08 08:25:49,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:25:49,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:25:49,990 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad25c3bcd207e915d79492/log.txt.gz 2026-03-08 08:25:50,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:25:50,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:25:50,457 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad25c3bcd207e915d79492/lava-logs.yaml 2026-03-08 08:25:50,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:25:50,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:25:50,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad25c3bcd207e915d79492/lava_callback.json.gz 2026-03-08 08:25:50,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:25:50,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad25c3bcd207e915d79492 HTTP/1.1" 200 None 2026-03-08 08:25:50,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:25:50,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-08 08:25:50,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:25:50,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad25c3bcd207e915d79492 HTTP/1.1" 200 None 2026-03-08 08:25:50,788 - lava_callback - INFO - Completed processing callback for node 69ad25c3bcd207e915d79492 INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:26:00,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:26:00,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:27:49,541 - lava_callback - INFO - Received callback for node 69ad3251ed37758c525e1662 INFO: 172.21.0.1:35556 - "POST /node/69ad3251ed37758c525e1662 HTTP/1.0" 202 Accepted 2026-03-08 08:27:49,547 - lava_callback - INFO - Starting async job submit for node 69ad3251ed37758c525e1662 2026-03-08 08:27:49,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:27:49,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3251ed37758c525e1662 HTTP/1.1" 200 None 2026-03-08 08:27:49,584 - lava_callback - DEBUG - Processing node 69ad3251ed37758c525e1662: baseline-arm64-broonie 2026-03-08 08:27:49,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:27:50,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:27:50,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3251ed37758c525e1662/log.txt.gz 2026-03-08 08:27:50,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:27:50,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:27:50,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3251ed37758c525e1662/lava-logs.yaml 2026-03-08 08:27:50,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:27:50,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:27:50,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3251ed37758c525e1662/lava_callback.json.gz 2026-03-08 08:27:50,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:27:50,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3251ed37758c525e1662 HTTP/1.1" 200 None 2026-03-08 08:27:50,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:27:50,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-08 08:27:50,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:27:50,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3251ed37758c525e1662 HTTP/1.1" 200 None 2026-03-08 08:27:50,812 - lava_callback - INFO - Completed processing callback for node 69ad3251ed37758c525e1662 INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:28:00,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:28:00,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:29:09,759 - lava_callback - INFO - Received callback for node 69ad32a0ed37758c525e1852 INFO: 172.21.0.1:40200 - "POST /node/69ad32a0ed37758c525e1852 HTTP/1.0" 202 Accepted 2026-03-08 08:29:09,765 - lava_callback - INFO - Starting async job submit for node 69ad32a0ed37758c525e1852 2026-03-08 08:29:09,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:29:09,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad32a0ed37758c525e1852 HTTP/1.1" 200 None 2026-03-08 08:29:09,800 - lava_callback - DEBUG - Processing node 69ad32a0ed37758c525e1852: baseline-arm64-broonie 2026-03-08 08:29:10,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:29:10,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:29:10,438 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad32a0ed37758c525e1852/log.txt.gz 2026-03-08 08:29:10,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:29:10,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:29:10,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad32a0ed37758c525e1852/lava-logs.yaml 2026-03-08 08:29:11,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:29:11,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:29:11,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad32a0ed37758c525e1852/lava_callback.json.gz 2026-03-08 08:29:11,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:29:11,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad32a0ed37758c525e1852 HTTP/1.1" 200 None 2026-03-08 08:29:11,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:29:11,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-08 08:29:11,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:29:11,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad32a0ed37758c525e1852 HTTP/1.1" 200 None 2026-03-08 08:29:11,499 - lava_callback - INFO - Completed processing callback for node 69ad32a0ed37758c525e1852 INFO: 172.21.0.1:40212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:29:30,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:29:30,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:31:09,672 - lava_callback - INFO - Received callback for node 69ad3318ed37758c525e1871 INFO: 172.21.0.1:57802 - "POST /node/69ad3318ed37758c525e1871 HTTP/1.0" 202 Accepted 2026-03-08 08:31:09,678 - lava_callback - INFO - Starting async job submit for node 69ad3318ed37758c525e1871 2026-03-08 08:31:09,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:09,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3318ed37758c525e1871 HTTP/1.1" 200 None 2026-03-08 08:31:09,722 - lava_callback - DEBUG - Processing node 69ad3318ed37758c525e1871: baseline-arm64-broonie 2026-03-08 08:31:10,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:31:10,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:31:10,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3318ed37758c525e1871/log.txt.gz 2026-03-08 08:31:10,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:31:10,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:31:10,669 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3318ed37758c525e1871/lava-logs.yaml 2026-03-08 08:31:10,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:31:10,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:31:10,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3318ed37758c525e1871/lava_callback.json.gz 2026-03-08 08:31:10,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:10,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3318ed37758c525e1871 HTTP/1.1" 200 None 2026-03-08 08:31:10,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:10,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-08 08:31:10,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:10,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3318ed37758c525e1871 HTTP/1.1" 200 None 2026-03-08 08:31:10,996 - lava_callback - INFO - Completed processing callback for node 69ad3318ed37758c525e1871 INFO: 172.21.0.1:48470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58164 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:31:29,624 - lava_callback - INFO - Received callback for node 69ad3369ed37758c525e188e INFO: 172.21.0.1:58166 - "POST /node/69ad3369ed37758c525e188e HTTP/1.0" 202 Accepted 2026-03-08 08:31:29,630 - lava_callback - INFO - Starting async job submit for node 69ad3369ed37758c525e188e 2026-03-08 08:31:29,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:29,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3369ed37758c525e188e HTTP/1.1" 200 None 2026-03-08 08:31:29,667 - lava_callback - DEBUG - Processing node 69ad3369ed37758c525e188e: baseline-arm64-broonie 2026-03-08 08:31:30,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:31:30,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:31:30,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3369ed37758c525e188e/log.txt.gz 2026-03-08 08:31:30,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:31:30,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:31:30,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3369ed37758c525e188e/lava-logs.yaml 2026-03-08 08:31:30,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:31:30,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:31:30,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3369ed37758c525e188e/lava_callback.json.gz 2026-03-08 08:31:30,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:30,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3369ed37758c525e188e HTTP/1.1" 200 None 2026-03-08 08:31:30,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:30,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-08 08:31:30,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:30,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3369ed37758c525e188e HTTP/1.1" 200 None 2026-03-08 08:31:30,829 - lava_callback - INFO - Completed processing callback for node 69ad3369ed37758c525e188e 2026-03-08 08:31:30,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:31:30,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:34:29,755 - lava_callback - INFO - Received callback for node 69ad341eed37758c525e18cc INFO: 172.21.0.1:53924 - "POST /node/69ad341eed37758c525e18cc HTTP/1.0" 202 Accepted 2026-03-08 08:34:29,760 - lava_callback - INFO - Starting async job submit for node 69ad341eed37758c525e18cc 2026-03-08 08:34:29,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:34:29,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad341eed37758c525e18cc HTTP/1.1" 200 None 2026-03-08 08:34:29,803 - lava_callback - DEBUG - Processing node 69ad341eed37758c525e18cc: baseline-arm 2026-03-08 08:34:29,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:34:30,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:34:30,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad341eed37758c525e18cc/log.txt.gz 2026-03-08 08:34:30,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:34:30,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:34:30,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad341eed37758c525e18cc/lava-logs.yaml 2026-03-08 08:34:30,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:34:30,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:34:30,769 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad341eed37758c525e18cc/lava_callback.json.gz 2026-03-08 08:34:30,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:34:30,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad341eed37758c525e18cc HTTP/1.1" 200 None 2026-03-08 08:34:30,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:34:30,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c1ed37758c525e15d9 HTTP/1.1" 200 None 2026-03-08 08:34:30,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:34:30,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad341eed37758c525e18cc HTTP/1.1" 200 None 2026-03-08 08:34:30,886 - lava_callback - INFO - Completed processing callback for node 69ad341eed37758c525e18cc 2026-03-08 08:34:30,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:34:30,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:39:57,995 - lava_callback - INFO - Received callback for node 69aa92cc76ddd5d9e606d7d4 INFO: 172.21.0.1:56916 - "POST /node/69aa92cc76ddd5d9e606d7d4 HTTP/1.0" 202 Accepted 2026-03-08 08:39:58,000 - lava_callback - INFO - Starting async job submit for node 69aa92cc76ddd5d9e606d7d4 2026-03-08 08:39:58,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:58,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92cc76ddd5d9e606d7d4 HTTP/1.1" 200 None 2026-03-08 08:39:58,023 - lava_callback - DEBUG - Processing node 69aa92cc76ddd5d9e606d7d4: baseline-arm-baylibre 2026-03-08 08:39:58,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa92cc76ddd5d9e606d7d4 2026-03-08 08:39:58,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:58,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92cc76ddd5d9e606d7d4 HTTP/1.1" 200 None 2026-03-08 08:39:58,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:58,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 08:39:58,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:58,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa92cc76ddd5d9e606d7d4 HTTP/1.1" 200 None 2026-03-08 08:39:58,081 - lava_callback - ERROR - Error processing callback for node 69aa92cc76ddd5d9e606d7d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:39:58,637 - lava_callback - INFO - Received callback for node 69aa92cd76ddd5d9e606d7d7 INFO: 172.21.0.1:56922 - "POST /node/69aa92cd76ddd5d9e606d7d7 HTTP/1.0" 202 Accepted 2026-03-08 08:39:58,643 - lava_callback - INFO - Starting async job submit for node 69aa92cd76ddd5d9e606d7d7 2026-03-08 08:39:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:58,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92cd76ddd5d9e606d7d7 HTTP/1.1" 200 None 2026-03-08 08:39:58,663 - lava_callback - DEBUG - Processing node 69aa92cd76ddd5d9e606d7d7: baseline-arm-baylibre 2026-03-08 08:39:58,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa92cd76ddd5d9e606d7d7 2026-03-08 08:39:58,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:58,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92cd76ddd5d9e606d7d7 HTTP/1.1" 200 None 2026-03-08 08:39:58,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:58,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 08:39:58,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:58,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa92cd76ddd5d9e606d7d7 HTTP/1.1" 200 None 2026-03-08 08:39:58,732 - lava_callback - ERROR - Error processing callback for node 69aa92cd76ddd5d9e606d7d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:39:59,303 - lava_callback - INFO - Received callback for node 69aa92cf76ddd5d9e606d7da INFO: 172.21.0.1:56928 - "POST /node/69aa92cf76ddd5d9e606d7da HTTP/1.0" 202 Accepted 2026-03-08 08:39:59,308 - lava_callback - INFO - Starting async job submit for node 69aa92cf76ddd5d9e606d7da 2026-03-08 08:39:59,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:59,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92cf76ddd5d9e606d7da HTTP/1.1" 200 None 2026-03-08 08:39:59,324 - lava_callback - DEBUG - Processing node 69aa92cf76ddd5d9e606d7da: baseline-arm-baylibre 2026-03-08 08:39:59,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa92cf76ddd5d9e606d7da 2026-03-08 08:39:59,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:59,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92cf76ddd5d9e606d7da HTTP/1.1" 200 None 2026-03-08 08:39:59,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:59,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 08:39:59,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:39:59,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa92cf76ddd5d9e606d7da HTTP/1.1" 200 None 2026-03-08 08:39:59,388 - lava_callback - ERROR - Error processing callback for node 69aa92cf76ddd5d9e606d7da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:39:59,986 - lava_callback - INFO - Received callback for node 69aa92d076ddd5d9e606d7dd INFO: 172.21.0.1:47614 - "POST /node/69aa92d076ddd5d9e606d7dd HTTP/1.0" 202 Accepted 2026-03-08 08:39:59,991 - lava_callback - INFO - Starting async job submit for node 69aa92d076ddd5d9e606d7dd 2026-03-08 08:39:59,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:00,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92d076ddd5d9e606d7dd HTTP/1.1" 200 None 2026-03-08 08:40:00,008 - lava_callback - DEBUG - Processing node 69aa92d076ddd5d9e606d7dd: baseline-arm-baylibre 2026-03-08 08:40:00,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa92d076ddd5d9e606d7dd 2026-03-08 08:40:00,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:00,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92d076ddd5d9e606d7dd HTTP/1.1" 200 None 2026-03-08 08:40:00,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:00,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 08:40:00,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:00,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa92d076ddd5d9e606d7dd HTTP/1.1" 200 None 2026-03-08 08:40:00,077 - lava_callback - ERROR - Error processing callback for node 69aa92d076ddd5d9e606d7dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:40:00,647 - lava_callback - INFO - Received callback for node 69aa92d376ddd5d9e606d7e9 INFO: 172.21.0.1:47626 - "POST /node/69aa92d376ddd5d9e606d7e9 HTTP/1.0" 202 Accepted 2026-03-08 08:40:00,653 - lava_callback - INFO - Starting async job submit for node 69aa92d376ddd5d9e606d7e9 2026-03-08 08:40:00,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:00,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92d376ddd5d9e606d7e9 HTTP/1.1" 200 None 2026-03-08 08:40:00,707 - lava_callback - DEBUG - Processing node 69aa92d376ddd5d9e606d7e9: baseline-arm-baylibre 2026-03-08 08:40:00,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa92d376ddd5d9e606d7e9 2026-03-08 08:40:00,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:00,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92d376ddd5d9e606d7e9 HTTP/1.1" 200 None 2026-03-08 08:40:00,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:00,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 08:40:00,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:00,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa92d376ddd5d9e606d7e9 HTTP/1.1" 200 None 2026-03-08 08:40:00,771 - lava_callback - ERROR - Error processing callback for node 69aa92d376ddd5d9e606d7e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:40:13,742 - lava_callback - INFO - Received callback for node 69aa92df76ddd5d9e606d810 INFO: 172.21.0.1:40416 - "POST /node/69aa92df76ddd5d9e606d810 HTTP/1.0" 202 Accepted 2026-03-08 08:40:13,747 - lava_callback - INFO - Starting async job submit for node 69aa92df76ddd5d9e606d810 2026-03-08 08:40:13,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:13,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92df76ddd5d9e606d810 HTTP/1.1" 200 None 2026-03-08 08:40:13,763 - lava_callback - DEBUG - Processing node 69aa92df76ddd5d9e606d810: baseline-arm-clabbe 2026-03-08 08:40:13,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa92df76ddd5d9e606d810 2026-03-08 08:40:13,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:13,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92df76ddd5d9e606d810 HTTP/1.1" 200 None 2026-03-08 08:40:13,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:13,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 08:40:13,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:13,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa92df76ddd5d9e606d810 HTTP/1.1" 200 None 2026-03-08 08:40:13,816 - lava_callback - ERROR - Error processing callback for node 69aa92df76ddd5d9e606d810: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:40:14,723 - lava_callback - INFO - Received callback for node 69aa92e076ddd5d9e606d813 INFO: 172.21.0.1:40432 - "POST /node/69aa92e076ddd5d9e606d813 HTTP/1.0" 202 Accepted 2026-03-08 08:40:14,728 - lava_callback - INFO - Starting async job submit for node 69aa92e076ddd5d9e606d813 2026-03-08 08:40:14,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:14,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92e076ddd5d9e606d813 HTTP/1.1" 200 None 2026-03-08 08:40:14,745 - lava_callback - DEBUG - Processing node 69aa92e076ddd5d9e606d813: baseline-arm-clabbe 2026-03-08 08:40:14,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa92e076ddd5d9e606d813 2026-03-08 08:40:14,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:14,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92e076ddd5d9e606d813 HTTP/1.1" 200 None 2026-03-08 08:40:14,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:14,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 08:40:14,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:14,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa92e076ddd5d9e606d813 HTTP/1.1" 200 None 2026-03-08 08:40:14,804 - lava_callback - ERROR - Error processing callback for node 69aa92e076ddd5d9e606d813: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40444 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-08 08:40:15,385 - lava_callback - INFO - Received callback for node 69aa92e476ddd5d9e606d822 INFO: 172.21.0.1:40456 - "POST /node/69aa92e476ddd5d9e606d822 HTTP/1.0" 202 Accepted 2026-03-08 08:40:15,391 - lava_callback - INFO - Starting async job submit for node 69aa92e476ddd5d9e606d822 2026-03-08 08:40:15,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:15,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92e476ddd5d9e606d822 HTTP/1.1" 200 None 2026-03-08 08:40:15,408 - lava_callback - DEBUG - Processing node 69aa92e476ddd5d9e606d822: baseline-arm-clabbe 2026-03-08 08:40:15,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa92e476ddd5d9e606d822 2026-03-08 08:40:15,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:15,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa92e476ddd5d9e606d822 HTTP/1.1" 200 None 2026-03-08 08:40:15,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:15,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 08:40:15,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:40:15,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa92e476ddd5d9e606d822 HTTP/1.1" 200 None 2026-03-08 08:40:15,479 - lava_callback - ERROR - Error processing callback for node 69aa92e476ddd5d9e606d822: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:45:58,280 - lava_callback - INFO - Received callback for node 69aa943576ddd5d9e606dac3 INFO: 172.21.0.1:37922 - "POST /node/69aa943576ddd5d9e606dac3 HTTP/1.0" 202 Accepted 2026-03-08 08:45:58,286 - lava_callback - INFO - Starting async job submit for node 69aa943576ddd5d9e606dac3 2026-03-08 08:45:58,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:58,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943576ddd5d9e606dac3 HTTP/1.1" 200 None 2026-03-08 08:45:58,303 - lava_callback - DEBUG - Processing node 69aa943576ddd5d9e606dac3: baseline-arm64-baylibre 2026-03-08 08:45:58,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa943576ddd5d9e606dac3 2026-03-08 08:45:58,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:58,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943576ddd5d9e606dac3 HTTP/1.1" 200 None 2026-03-08 08:45:58,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:58,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 08:45:58,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:58,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa943576ddd5d9e606dac3 HTTP/1.1" 200 None 2026-03-08 08:45:58,401 - lava_callback - ERROR - Error processing callback for node 69aa943576ddd5d9e606dac3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:45:58,930 - lava_callback - INFO - Received callback for node 69aa943776ddd5d9e606dacb INFO: 172.21.0.1:37934 - "POST /node/69aa943776ddd5d9e606dacb HTTP/1.0" 202 Accepted 2026-03-08 08:45:58,936 - lava_callback - INFO - Starting async job submit for node 69aa943776ddd5d9e606dacb 2026-03-08 08:45:58,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:58,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943776ddd5d9e606dacb HTTP/1.1" 200 None 2026-03-08 08:45:58,952 - lava_callback - DEBUG - Processing node 69aa943776ddd5d9e606dacb: baseline-arm64-baylibre 2026-03-08 08:45:58,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa943776ddd5d9e606dacb 2026-03-08 08:45:58,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:58,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943776ddd5d9e606dacb HTTP/1.1" 200 None 2026-03-08 08:45:58,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:58,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 08:45:58,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:59,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa943776ddd5d9e606dacb HTTP/1.1" 200 None 2026-03-08 08:45:59,014 - lava_callback - ERROR - Error processing callback for node 69aa943776ddd5d9e606dacb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:45:59,600 - lava_callback - INFO - Received callback for node 69aa943976ddd5d9e606dad2 INFO: 172.21.0.1:37944 - "POST /node/69aa943976ddd5d9e606dad2 HTTP/1.0" 202 Accepted 2026-03-08 08:45:59,607 - lava_callback - INFO - Starting async job submit for node 69aa943976ddd5d9e606dad2 2026-03-08 08:45:59,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:59,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943976ddd5d9e606dad2 HTTP/1.1" 200 None 2026-03-08 08:45:59,625 - lava_callback - DEBUG - Processing node 69aa943976ddd5d9e606dad2: baseline-arm64-baylibre 2026-03-08 08:45:59,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa943976ddd5d9e606dad2 2026-03-08 08:45:59,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:59,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943976ddd5d9e606dad2 HTTP/1.1" 200 None 2026-03-08 08:45:59,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:59,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 08:45:59,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:45:59,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa943976ddd5d9e606dad2 HTTP/1.1" 200 None 2026-03-08 08:45:59,741 - lava_callback - ERROR - Error processing callback for node 69aa943976ddd5d9e606dad2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:46:00,260 - lava_callback - INFO - Received callback for node 69aa943d76ddd5d9e606dada INFO: 172.21.0.1:46310 - "POST /node/69aa943d76ddd5d9e606dada HTTP/1.0" 202 Accepted 2026-03-08 08:46:00,270 - lava_callback - INFO - Starting async job submit for node 69aa943d76ddd5d9e606dada 2026-03-08 08:46:00,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:00,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943d76ddd5d9e606dada HTTP/1.1" 200 None 2026-03-08 08:46:00,326 - lava_callback - DEBUG - Processing node 69aa943d76ddd5d9e606dada: baseline-arm64-baylibre 2026-03-08 08:46:00,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa943d76ddd5d9e606dada 2026-03-08 08:46:00,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:00,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943d76ddd5d9e606dada HTTP/1.1" 200 None 2026-03-08 08:46:00,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:00,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 08:46:00,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:00,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa943d76ddd5d9e606dada HTTP/1.1" 200 None 2026-03-08 08:46:00,447 - lava_callback - ERROR - Error processing callback for node 69aa943d76ddd5d9e606dada: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:46:00,934 - lava_callback - INFO - Received callback for node 69aa943f76ddd5d9e606dadd INFO: 172.21.0.1:46312 - "POST /node/69aa943f76ddd5d9e606dadd HTTP/1.0" 202 Accepted 2026-03-08 08:46:00,943 - lava_callback - INFO - Starting async job submit for node 69aa943f76ddd5d9e606dadd 2026-03-08 08:46:00,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:00,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943f76ddd5d9e606dadd HTTP/1.1" 200 None 2026-03-08 08:46:00,983 - lava_callback - DEBUG - Processing node 69aa943f76ddd5d9e606dadd: baseline-arm64-baylibre 2026-03-08 08:46:00,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa943f76ddd5d9e606dadd 2026-03-08 08:46:00,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:01,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa943f76ddd5d9e606dadd HTTP/1.1" 200 None 2026-03-08 08:46:01,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:01,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 08:46:01,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:01,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa943f76ddd5d9e606dadd HTTP/1.1" 200 None 2026-03-08 08:46:01,074 - lava_callback - ERROR - Error processing callback for node 69aa943f76ddd5d9e606dadd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:46:01,587 - lava_callback - INFO - Received callback for node 69aa944176ddd5d9e606dae0 INFO: 172.21.0.1:46314 - "POST /node/69aa944176ddd5d9e606dae0 HTTP/1.0" 202 Accepted 2026-03-08 08:46:01,597 - lava_callback - INFO - Starting async job submit for node 69aa944176ddd5d9e606dae0 2026-03-08 08:46:01,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:01,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa944176ddd5d9e606dae0 HTTP/1.1" 200 None 2026-03-08 08:46:01,626 - lava_callback - DEBUG - Processing node 69aa944176ddd5d9e606dae0: baseline-arm64-baylibre 2026-03-08 08:46:01,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa944176ddd5d9e606dae0 2026-03-08 08:46:01,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:01,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa944176ddd5d9e606dae0 HTTP/1.1" 200 None 2026-03-08 08:46:01,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:01,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 08:46:01,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:01,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa944176ddd5d9e606dae0 HTTP/1.1" 200 None 2026-03-08 08:46:01,793 - lava_callback - ERROR - Error processing callback for node 69aa944176ddd5d9e606dae0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:46:13,921 - lava_callback - INFO - Received callback for node 69ad3747ed37758c525e19d1 INFO: 172.21.0.1:43598 - "POST /node/69ad3747ed37758c525e19d1 HTTP/1.0" 202 Accepted 2026-03-08 08:46:13,931 - lava_callback - INFO - Starting async job submit for node 69ad3747ed37758c525e19d1 2026-03-08 08:46:13,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:13,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3747ed37758c525e19d1 HTTP/1.1" 200 None 2026-03-08 08:46:13,968 - lava_callback - DEBUG - Processing node 69ad3747ed37758c525e19d1: baseline-x86 2026-03-08 08:46:13,976 - lava_callback - WARNING - Failed to upload log 2026-03-08 08:46:13,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:46:14,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:46:14,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3747ed37758c525e19d1/lava-logs.yaml 2026-03-08 08:46:14,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:46:14,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:46:14,411 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3747ed37758c525e19d1/lava_callback.json.gz 2026-03-08 08:46:14,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:14,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3747ed37758c525e19d1 HTTP/1.1" 200 None 2026-03-08 08:46:14,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:14,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30dded37758c525e1606 HTTP/1.1" 200 None 2026-03-08 08:46:14,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:14,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3747ed37758c525e19d1 HTTP/1.1" 200 None 2026-03-08 08:46:14,479 - lava_callback - INFO - Completed processing callback for node 69ad3747ed37758c525e19d1 INFO: 172.21.0.1:43610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:46:30,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:31,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-08 08:46:34,015 - lava_callback - INFO - Received callback for node 69aa945576ddd5d9e606db30 INFO: 172.21.0.1:54464 - "POST /node/69aa945576ddd5d9e606db30 HTTP/1.0" 202 Accepted 2026-03-08 08:46:34,024 - lava_callback - INFO - Starting async job submit for node 69aa945576ddd5d9e606db30 2026-03-08 08:46:34,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:34,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa945576ddd5d9e606db30 HTTP/1.1" 200 None 2026-03-08 08:46:34,066 - lava_callback - DEBUG - Processing node 69aa945576ddd5d9e606db30: baseline-arm64-clabbe 2026-03-08 08:46:34,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa945576ddd5d9e606db30 2026-03-08 08:46:34,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:34,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa945576ddd5d9e606db30 HTTP/1.1" 200 None 2026-03-08 08:46:34,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:34,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 08:46:34,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:34,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa945576ddd5d9e606db30 HTTP/1.1" 200 None 2026-03-08 08:46:34,163 - lava_callback - ERROR - Error processing callback for node 69aa945576ddd5d9e606db30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:46:34,706 - lava_callback - INFO - Received callback for node 69aa945f76ddd5d9e606db41 INFO: 172.21.0.1:54470 - "POST /node/69aa945f76ddd5d9e606db41 HTTP/1.0" 202 Accepted 2026-03-08 08:46:34,711 - lava_callback - INFO - Starting async job submit for node 69aa945f76ddd5d9e606db41 2026-03-08 08:46:34,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:34,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa945f76ddd5d9e606db41 HTTP/1.1" 200 None 2026-03-08 08:46:34,740 - lava_callback - DEBUG - Processing node 69aa945f76ddd5d9e606db41: baseline-arm64-clabbe 2026-03-08 08:46:34,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa945f76ddd5d9e606db41 2026-03-08 08:46:34,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:34,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa945f76ddd5d9e606db41 HTTP/1.1" 200 None 2026-03-08 08:46:34,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:34,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 08:46:34,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:34,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa945f76ddd5d9e606db41 HTTP/1.1" 200 None 2026-03-08 08:46:34,810 - lava_callback - ERROR - Error processing callback for node 69aa945f76ddd5d9e606db41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:46:38,289 - lava_callback - INFO - Received callback for node 69ad374aed37758c525e19e2 INFO: 172.21.0.1:54486 - "POST /node/69ad374aed37758c525e19e2 HTTP/1.0" 202 Accepted 2026-03-08 08:46:38,300 - lava_callback - INFO - Starting async job submit for node 69ad374aed37758c525e19e2 2026-03-08 08:46:38,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:38,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad374aed37758c525e19e2 HTTP/1.1" 200 None 2026-03-08 08:46:38,365 - lava_callback - DEBUG - Processing node 69ad374aed37758c525e19e2: baseline-x86 2026-03-08 08:46:38,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:46:38,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:46:38,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ad374aed37758c525e19e2/log.txt.gz 2026-03-08 08:46:38,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:46:39,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:46:39,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ad374aed37758c525e19e2/lava-logs.yaml 2026-03-08 08:46:39,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:46:39,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:46:39,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ad374aed37758c525e19e2/lava_callback.json.gz 2026-03-08 08:46:39,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:39,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad374aed37758c525e19e2 HTTP/1.1" 200 None 2026-03-08 08:46:39,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:39,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30dded37758c525e1606 HTTP/1.1" 200 None 2026-03-08 08:46:39,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:46:39,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad374aed37758c525e19e2 HTTP/1.1" 200 None 2026-03-08 08:46:39,778 - lava_callback - INFO - Completed processing callback for node 69ad374aed37758c525e19e2 INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:47:01,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:01,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:47:18,014 - lava_callback - INFO - Received callback for node 69ad3748ed37758c525e19d6 INFO: 172.21.0.1:47110 - "POST /node/69ad3748ed37758c525e19d6 HTTP/1.0" 202 Accepted 2026-03-08 08:47:18,023 - lava_callback - INFO - Starting async job submit for node 69ad3748ed37758c525e19d6 2026-03-08 08:47:18,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:18,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3748ed37758c525e19d6 HTTP/1.1" 200 None 2026-03-08 08:47:18,064 - lava_callback - DEBUG - Processing node 69ad3748ed37758c525e19d6: baseline-x86 2026-03-08 08:47:18,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:47:18,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:47:18,695 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3748ed37758c525e19d6/log.txt.gz 2026-03-08 08:47:18,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:47:19,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:47:19,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3748ed37758c525e19d6/lava-logs.yaml 2026-03-08 08:47:19,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:47:19,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:47:19,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3748ed37758c525e19d6/lava_callback.json.gz 2026-03-08 08:47:19,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:19,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3748ed37758c525e19d6 HTTP/1.1" 200 None 2026-03-08 08:47:19,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:19,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30dded37758c525e1606 HTTP/1.1" 200 None 2026-03-08 08:47:19,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:19,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3748ed37758c525e19d6 HTTP/1.1" 200 None 2026-03-08 08:47:19,639 - lava_callback - INFO - Completed processing callback for node 69ad3748ed37758c525e19d6 INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:47:31,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:31,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-08 08:47:34,680 - lava_callback - INFO - Received callback for node 69ad37a0ed37758c525e1a2f INFO: 172.21.0.1:44858 - "POST /node/69ad37a0ed37758c525e1a2f HTTP/1.0" 202 Accepted 2026-03-08 08:47:34,686 - lava_callback - INFO - Starting async job submit for node 69ad37a0ed37758c525e1a2f 2026-03-08 08:47:34,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:34,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a0ed37758c525e1a2f HTTP/1.1" 200 None 2026-03-08 08:47:34,704 - lava_callback - DEBUG - Processing node 69ad37a0ed37758c525e1a2f: baseline-arm 2026-03-08 08:47:34,709 - lava_callback - WARNING - Failed to upload log 2026-03-08 08:47:34,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:47:34,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:47:34,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a0ed37758c525e1a2f/lava-logs.yaml 2026-03-08 08:47:34,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:47:34,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:47:35,003 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a0ed37758c525e1a2f/lava_callback.json.gz 2026-03-08 08:47:35,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:35,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a0ed37758c525e1a2f HTTP/1.1" 200 None 2026-03-08 08:47:35,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:35,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:47:35,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:47:35,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37a0ed37758c525e1a2f HTTP/1.1" 200 None 2026-03-08 08:47:35,089 - lava_callback - INFO - Completed processing callback for node 69ad37a0ed37758c525e1a2f INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:48:01,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:01,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:48:09,752 - lava_callback - INFO - Received callback for node 69ad37a0ed37758c525e1a33 INFO: 172.21.0.1:48404 - "POST /node/69ad37a0ed37758c525e1a33 HTTP/1.0" 202 Accepted 2026-03-08 08:48:09,804 - lava_callback - INFO - Starting async job submit for node 69ad37a0ed37758c525e1a33 2026-03-08 08:48:09,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:09,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a0ed37758c525e1a33 HTTP/1.1" 200 None 2026-03-08 08:48:09,841 - lava_callback - DEBUG - Processing node 69ad37a0ed37758c525e1a33: baseline-arm 2026-03-08 08:48:09,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:10,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:10,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a0ed37758c525e1a33/log.txt.gz 2026-03-08 08:48:10,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:10,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:10,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a0ed37758c525e1a33/lava-logs.yaml 2026-03-08 08:48:10,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:10,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:10,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a0ed37758c525e1a33/lava_callback.json.gz 2026-03-08 08:48:10,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:10,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a0ed37758c525e1a33 HTTP/1.1" 200 None 2026-03-08 08:48:10,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:10,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:48:10,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:10,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37a0ed37758c525e1a33 HTTP/1.1" 200 None 2026-03-08 08:48:10,596 - lava_callback - INFO - Completed processing callback for node 69ad37a0ed37758c525e1a33 INFO: 172.21.0.1:48410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:48:27,868 - lava_callback - INFO - Received callback for node 69ad37a3ed37758c525e1a42 INFO: 172.21.0.1:55294 - "POST /node/69ad37a3ed37758c525e1a42 HTTP/1.0" 202 Accepted 2026-03-08 08:48:27,920 - lava_callback - INFO - Starting async job submit for node 69ad37a3ed37758c525e1a42 2026-03-08 08:48:27,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:27,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a3ed37758c525e1a42 HTTP/1.1" 200 None 2026-03-08 08:48:27,961 - lava_callback - DEBUG - Processing node 69ad37a3ed37758c525e1a42: baseline-arm 2026-03-08 08:48:28,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:28,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:28,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a3ed37758c525e1a42/log.txt.gz 2026-03-08 08:48:28,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:28,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:28,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a3ed37758c525e1a42/lava-logs.yaml 2026-03-08 08:48:28,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:29,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:29,100 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a3ed37758c525e1a42/lava_callback.json.gz 2026-03-08 08:48:29,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:29,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a3ed37758c525e1a42 HTTP/1.1" 200 None 2026-03-08 08:48:29,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:29,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:48:29,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:29,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37a3ed37758c525e1a42 HTTP/1.1" 200 None 2026-03-08 08:48:29,251 - lava_callback - INFO - Completed processing callback for node 69ad37a3ed37758c525e1a42 2026-03-08 08:48:31,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:31,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-08 08:48:35,786 - lava_callback - INFO - Received callback for node 69ad37b6ed37758c525e1a7e INFO: 172.21.0.1:59596 - "POST /node/69ad37b6ed37758c525e1a7e HTTP/1.0" 202 Accepted 2026-03-08 08:48:35,796 - lava_callback - INFO - Starting async job submit for node 69ad37b6ed37758c525e1a7e 2026-03-08 08:48:35,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:35,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b6ed37758c525e1a7e HTTP/1.1" 200 None 2026-03-08 08:48:35,871 - lava_callback - DEBUG - Processing node 69ad37b6ed37758c525e1a7e: baseline-arm-clabbe 2026-03-08 08:48:36,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:48:36,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:36,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b6ed37758c525e1a7e/log.txt.gz 2026-03-08 08:48:36,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:37,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:37,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b6ed37758c525e1a7e/lava-logs.yaml 2026-03-08 08:48:37,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:37,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:37,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b6ed37758c525e1a7e/lava_callback.json.gz 2026-03-08 08:48:37,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:37,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b6ed37758c525e1a7e HTTP/1.1" 200 None 2026-03-08 08:48:37,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:37,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:48:37,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:37,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37b6ed37758c525e1a7e HTTP/1.1" 200 None 2026-03-08 08:48:37,531 - lava_callback - INFO - Completed processing callback for node 69ad37b6ed37758c525e1a7e INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:48:47,233 - lava_callback - INFO - Received callback for node 69ad379fed37758c525e1a2c INFO: 172.21.0.1:57680 - "POST /node/69ad379fed37758c525e1a2c HTTP/1.0" 202 Accepted 2026-03-08 08:48:47,243 - lava_callback - INFO - Starting async job submit for node 69ad379fed37758c525e1a2c 2026-03-08 08:48:47,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:47,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad379fed37758c525e1a2c HTTP/1.1" 200 None 2026-03-08 08:48:47,311 - lava_callback - DEBUG - Processing node 69ad379fed37758c525e1a2c: baseline-arm 2026-03-08 08:48:47,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:47,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:47,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad379fed37758c525e1a2c/log.txt.gz 2026-03-08 08:48:48,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:48,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:48,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad379fed37758c525e1a2c/lava-logs.yaml 2026-03-08 08:48:48,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:48,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:48,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad379fed37758c525e1a2c/lava_callback.json.gz 2026-03-08 08:48:48,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:48,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad379fed37758c525e1a2c HTTP/1.1" 200 None 2026-03-08 08:48:48,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:48,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:48:48,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:48,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad379fed37758c525e1a2c HTTP/1.1" 200 None 2026-03-08 08:48:48,994 - lava_callback - INFO - Completed processing callback for node 69ad379fed37758c525e1a2c 2026-03-08 08:48:51,836 - lava_callback - INFO - Received callback for node 69ad37a2ed37758c525e1a3c INFO: 172.21.0.1:49830 - "POST /node/69ad37a2ed37758c525e1a3c HTTP/1.0" 202 Accepted 2026-03-08 08:48:51,843 - lava_callback - INFO - Starting async job submit for node 69ad37a2ed37758c525e1a3c 2026-03-08 08:48:51,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:51,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a2ed37758c525e1a3c HTTP/1.1" 200 None 2026-03-08 08:48:51,888 - lava_callback - DEBUG - Processing node 69ad37a2ed37758c525e1a3c: baseline-arm 2026-03-08 08:48:52,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:52,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:52,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a2ed37758c525e1a3c/log.txt.gz 2026-03-08 08:48:52,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:53,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:53,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a2ed37758c525e1a3c/lava-logs.yaml 2026-03-08 08:48:53,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:48:53,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:48:53,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a2ed37758c525e1a3c/lava_callback.json.gz 2026-03-08 08:48:53,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:53,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a2ed37758c525e1a3c HTTP/1.1" 200 None 2026-03-08 08:48:53,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:53,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:48:53,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:48:53,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37a2ed37758c525e1a3c HTTP/1.1" 200 None 2026-03-08 08:48:53,420 - lava_callback - INFO - Completed processing callback for node 69ad37a2ed37758c525e1a3c INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:49:01,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:01,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:49:10,441 - lava_callback - INFO - Received callback for node 69ad37b1ed37758c525e1a67 INFO: 172.21.0.1:48120 - "POST /node/69ad37b1ed37758c525e1a67 HTTP/1.0" 202 Accepted 2026-03-08 08:49:10,451 - lava_callback - INFO - Starting async job submit for node 69ad37b1ed37758c525e1a67 2026-03-08 08:49:10,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:10,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b1ed37758c525e1a67 HTTP/1.1" 200 None 2026-03-08 08:49:10,527 - lava_callback - DEBUG - Processing node 69ad37b1ed37758c525e1a67: baseline-arm-broonie 2026-03-08 08:49:10,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:10,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:10,991 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b1ed37758c525e1a67/log.txt.gz 2026-03-08 08:49:11,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:11,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:11,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b1ed37758c525e1a67/lava-logs.yaml 2026-03-08 08:49:11,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:11,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:11,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b1ed37758c525e1a67/lava_callback.json.gz 2026-03-08 08:49:11,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:11,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b1ed37758c525e1a67 HTTP/1.1" 200 None 2026-03-08 08:49:11,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:11,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:11,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:11,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37b1ed37758c525e1a67 HTTP/1.1" 200 None 2026-03-08 08:49:11,730 - lava_callback - INFO - Completed processing callback for node 69ad37b1ed37758c525e1a67 2026-03-08 08:49:11,868 - lava_callback - INFO - Received callback for node 69ad37b3ed37758c525e1a6a INFO: 172.21.0.1:48130 - "POST /node/69ad37b3ed37758c525e1a6a HTTP/1.0" 202 Accepted 2026-03-08 08:49:11,878 - lava_callback - INFO - Starting async job submit for node 69ad37b3ed37758c525e1a6a 2026-03-08 08:49:11,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:11,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b3ed37758c525e1a6a HTTP/1.1" 200 None 2026-03-08 08:49:11,971 - lava_callback - DEBUG - Processing node 69ad37b3ed37758c525e1a6a: baseline-arm-broonie 2026-03-08 08:49:12,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:12,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:12,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b3ed37758c525e1a6a/log.txt.gz 2026-03-08 08:49:12,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:13,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:13,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b3ed37758c525e1a6a/lava-logs.yaml 2026-03-08 08:49:13,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:13,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:13,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b3ed37758c525e1a6a/lava_callback.json.gz 2026-03-08 08:49:13,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:13,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b3ed37758c525e1a6a HTTP/1.1" 200 None 2026-03-08 08:49:13,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:13,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:13,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:13,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37b3ed37758c525e1a6a HTTP/1.1" 200 None 2026-03-08 08:49:13,343 - lava_callback - INFO - Completed processing callback for node 69ad37b3ed37758c525e1a6a 2026-03-08 08:49:15,029 - lava_callback - INFO - Received callback for node 69ad37c7ed37758c525e1ad1 INFO: 172.21.0.1:48140 - "POST /node/69ad37c7ed37758c525e1ad1 HTTP/1.0" 202 Accepted 2026-03-08 08:49:15,080 - lava_callback - INFO - Starting async job submit for node 69ad37c7ed37758c525e1ad1 2026-03-08 08:49:15,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:15,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c7ed37758c525e1ad1 HTTP/1.1" 200 None 2026-03-08 08:49:15,150 - lava_callback - DEBUG - Processing node 69ad37c7ed37758c525e1ad1: baseline-arm-pengutronix INFO: 172.21.0.1:48142 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-08 08:49:15,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:15,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:15,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c7ed37758c525e1ad1/log.txt.gz 2026-03-08 08:49:15,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:15,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:15,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c7ed37758c525e1ad1/lava-logs.yaml 2026-03-08 08:49:16,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:16,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:16,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c7ed37758c525e1ad1/lava_callback.json.gz 2026-03-08 08:49:16,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:16,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c7ed37758c525e1ad1 HTTP/1.1" 200 None 2026-03-08 08:49:16,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:16,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:16,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:16,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37c7ed37758c525e1ad1 HTTP/1.1" 200 None 2026-03-08 08:49:16,231 - lava_callback - INFO - Completed processing callback for node 69ad37c7ed37758c525e1ad1 2026-03-08 08:49:16,278 - lava_callback - INFO - Received callback for node 69ad37b8ed37758c525e1a85 INFO: 172.21.0.1:48150 - "POST /node/69ad37b8ed37758c525e1a85 HTTP/1.0" 202 Accepted 2026-03-08 08:49:16,294 - lava_callback - INFO - Starting async job submit for node 69ad37b8ed37758c525e1a85 2026-03-08 08:49:16,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:16,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b8ed37758c525e1a85 HTTP/1.1" 200 None 2026-03-08 08:49:16,372 - lava_callback - DEBUG - Processing node 69ad37b8ed37758c525e1a85: baseline-arm-clabbe INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:49:16,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:16,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:16,959 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b8ed37758c525e1a85/log.txt.gz 2026-03-08 08:49:17,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:17,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:17,347 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b8ed37758c525e1a85/lava-logs.yaml 2026-03-08 08:49:17,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:17,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:17,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b8ed37758c525e1a85/lava_callback.json.gz 2026-03-08 08:49:17,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:17,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b8ed37758c525e1a85 HTTP/1.1" 200 None 2026-03-08 08:49:17,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:17,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:17,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:17,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37b8ed37758c525e1a85 HTTP/1.1" 200 None 2026-03-08 08:49:17,939 - lava_callback - INFO - Completed processing callback for node 69ad37b8ed37758c525e1a85 2026-03-08 08:49:18,364 - lava_callback - INFO - Received callback for node 69aa950676ddd5d9e606dc75 INFO: 172.21.0.1:48174 - "POST /node/69aa950676ddd5d9e606dc75 HTTP/1.0" 202 Accepted 2026-03-08 08:49:18,374 - lava_callback - INFO - Starting async job submit for node 69aa950676ddd5d9e606dc75 2026-03-08 08:49:18,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:18,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa950676ddd5d9e606dc75 HTTP/1.1" 200 None 2026-03-08 08:49:18,393 - lava_callback - DEBUG - Processing node 69aa950676ddd5d9e606dc75: baseline-arm64-baylibre 2026-03-08 08:49:18,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa950676ddd5d9e606dc75 2026-03-08 08:49:18,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:18,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa950676ddd5d9e606dc75 HTTP/1.1" 200 None 2026-03-08 08:49:18,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:18,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-08 08:49:18,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:18,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa950676ddd5d9e606dc75 HTTP/1.1" 200 None 2026-03-08 08:49:18,475 - lava_callback - ERROR - Error processing callback for node 69aa950676ddd5d9e606dc75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 08:49:21,108 - lava_callback - INFO - Received callback for node 69ad37c3ed37758c525e1ac8 INFO: 172.21.0.1:38192 - "POST /node/69ad37c3ed37758c525e1ac8 HTTP/1.0" 202 Accepted 2026-03-08 08:49:21,117 - lava_callback - INFO - Starting async job submit for node 69ad37c3ed37758c525e1ac8 2026-03-08 08:49:21,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:21,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c3ed37758c525e1ac8 HTTP/1.1" 200 None 2026-03-08 08:49:21,165 - lava_callback - DEBUG - Processing node 69ad37c3ed37758c525e1ac8: baseline-arm-pengutronix 2026-03-08 08:49:21,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:21,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:21,482 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c3ed37758c525e1ac8/log.txt.gz 2026-03-08 08:49:21,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:22,012 - lava_callback - INFO - Received callback for node 69ad37bced37758c525e1ab0 2026-03-08 08:49:22,020 - lava_callback - INFO - Starting async job submit for node 69ad37bced37758c525e1ab0 INFO: 172.21.0.1:38198 - "POST /node/69ad37bced37758c525e1ab0 HTTP/1.0" 202 Accepted 2026-03-08 08:49:22,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:22,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:22,059 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c3ed37758c525e1ac8/lava-logs.yaml 2026-03-08 08:49:22,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:22,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37bced37758c525e1ab0 HTTP/1.1" 200 None 2026-03-08 08:49:22,065 - lava_callback - DEBUG - Processing node 69ad37bced37758c525e1ab0: baseline-arm-clabbe 2026-03-08 08:49:22,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:22,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:22,279 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c3ed37758c525e1ac8/lava_callback.json.gz 2026-03-08 08:49:22,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:22,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c3ed37758c525e1ac8 HTTP/1.1" 200 None 2026-03-08 08:49:22,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:22,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:22,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:22,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37c3ed37758c525e1ac8 HTTP/1.1" 200 None 2026-03-08 08:49:22,402 - lava_callback - INFO - Completed processing callback for node 69ad37c3ed37758c525e1ac8 2026-03-08 08:49:22,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:22,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37bced37758c525e1ab0/log.txt.gz 2026-03-08 08:49:22,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:23,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:23,100 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37bced37758c525e1ab0/lava-logs.yaml 2026-03-08 08:49:23,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:23,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:23,583 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37bced37758c525e1ab0/lava_callback.json.gz 2026-03-08 08:49:23,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:23,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37bced37758c525e1ab0 HTTP/1.1" 200 None 2026-03-08 08:49:23,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:23,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:23,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:23,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37bced37758c525e1ab0 HTTP/1.1" 200 None 2026-03-08 08:49:23,690 - lava_callback - INFO - Completed processing callback for node 69ad37bced37758c525e1ab0 2026-03-08 08:49:25,897 - lava_callback - INFO - Received callback for node 69ad37c4ed37758c525e1acb INFO: 172.21.0.1:38208 - "POST /node/69ad37c4ed37758c525e1acb HTTP/1.0" 202 Accepted 2026-03-08 08:49:25,906 - lava_callback - INFO - Starting async job submit for node 69ad37c4ed37758c525e1acb 2026-03-08 08:49:25,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:25,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c4ed37758c525e1acb HTTP/1.1" 200 None 2026-03-08 08:49:25,947 - lava_callback - DEBUG - Processing node 69ad37c4ed37758c525e1acb: baseline-arm-pengutronix 2026-03-08 08:49:26,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:26,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:26,521 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c4ed37758c525e1acb/log.txt.gz INFO: 172.21.0.1:38218 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:49:26,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:26,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:26,866 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c4ed37758c525e1acb/lava-logs.yaml 2026-03-08 08:49:26,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:49:27,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:27,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c4ed37758c525e1acb/lava_callback.json.gz 2026-03-08 08:49:27,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:27,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c4ed37758c525e1acb HTTP/1.1" 200 None 2026-03-08 08:49:27,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:27,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:27,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:27,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37c4ed37758c525e1acb HTTP/1.1" 200 None 2026-03-08 08:49:27,476 - lava_callback - INFO - Completed processing callback for node 69ad37c4ed37758c525e1acb 2026-03-08 08:49:31,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:31,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:49:40,478 - lava_callback - INFO - Received callback for node 69ad37b4ed37758c525e1a6d INFO: 172.21.0.1:43664 - "POST /node/69ad37b4ed37758c525e1a6d HTTP/1.0" 202 Accepted 2026-03-08 08:49:40,487 - lava_callback - INFO - Starting async job submit for node 69ad37b4ed37758c525e1a6d 2026-03-08 08:49:40,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:40,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b4ed37758c525e1a6d HTTP/1.1" 200 None 2026-03-08 08:49:40,555 - lava_callback - DEBUG - Processing node 69ad37b4ed37758c525e1a6d: baseline-arm-broonie 2026-03-08 08:49:40,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:41,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:41,236 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b4ed37758c525e1a6d/log.txt.gz 2026-03-08 08:49:41,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:42,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:42,364 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b4ed37758c525e1a6d/lava-logs.yaml 2026-03-08 08:49:42,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:42,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:42,506 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b4ed37758c525e1a6d/lava_callback.json.gz 2026-03-08 08:49:42,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:42,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b4ed37758c525e1a6d HTTP/1.1" 200 None 2026-03-08 08:49:42,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:42,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:42,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:42,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37b4ed37758c525e1a6d HTTP/1.1" 200 None 2026-03-08 08:49:42,598 - lava_callback - INFO - Completed processing callback for node 69ad37b4ed37758c525e1a6d INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:49:50,331 - lava_callback - INFO - Received callback for node 69ad37b0ed37758c525e1a62 INFO: 172.21.0.1:42472 - "POST /node/69ad37b0ed37758c525e1a62 HTTP/1.0" 202 Accepted 2026-03-08 08:49:50,341 - lava_callback - INFO - Starting async job submit for node 69ad37b0ed37758c525e1a62 2026-03-08 08:49:50,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:50,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b0ed37758c525e1a62 HTTP/1.1" 200 None 2026-03-08 08:49:50,415 - lava_callback - DEBUG - Processing node 69ad37b0ed37758c525e1a62: baseline-arm-broonie 2026-03-08 08:49:50,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:51,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:51,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b0ed37758c525e1a62/log.txt.gz 2026-03-08 08:49:51,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:52,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:52,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b0ed37758c525e1a62/lava-logs.yaml 2026-03-08 08:49:52,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:52,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:52,558 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ad37b0ed37758c525e1a62/lava_callback.json.gz 2026-03-08 08:49:52,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:52,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b0ed37758c525e1a62 HTTP/1.1" 200 None 2026-03-08 08:49:52,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:52,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:52,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:52,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37b0ed37758c525e1a62 HTTP/1.1" 200 None 2026-03-08 08:49:52,754 - lava_callback - INFO - Completed processing callback for node 69ad37b0ed37758c525e1a62 2026-03-08 08:49:55,437 - lava_callback - INFO - Received callback for node 69ad37c0ed37758c525e1abc INFO: 172.21.0.1:42484 - "POST /node/69ad37c0ed37758c525e1abc HTTP/1.0" 202 Accepted 2026-03-08 08:49:55,443 - lava_callback - INFO - Starting async job submit for node 69ad37c0ed37758c525e1abc 2026-03-08 08:49:55,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:55,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c0ed37758c525e1abc HTTP/1.1" 200 None 2026-03-08 08:49:55,483 - lava_callback - DEBUG - Processing node 69ad37c0ed37758c525e1abc: baseline-arm-kontron 2026-03-08 08:49:55,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:55,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:55,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ad37c0ed37758c525e1abc/log.txt.gz 2026-03-08 08:49:56,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:49:56,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:56,440 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ad37c0ed37758c525e1abc/lava-logs.yaml 2026-03-08 08:49:56,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:49:56,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:49:56,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ad37c0ed37758c525e1abc/lava_callback.json.gz 2026-03-08 08:49:56,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:56,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c0ed37758c525e1abc HTTP/1.1" 200 None 2026-03-08 08:49:56,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:56,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:49:56,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:49:56,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37c0ed37758c525e1abc HTTP/1.1" 200 None 2026-03-08 08:49:56,674 - lava_callback - INFO - Completed processing callback for node 69ad37c0ed37758c525e1abc 2026-03-08 08:50:01,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:01,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41042 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:50:32,487 - lava_callback - INFO - Received callback for node 69ad37dfed37758c525e1b0a INFO: 172.21.0.1:39870 - "POST /node/69ad37dfed37758c525e1b0a HTTP/1.0" 202 Accepted 2026-03-08 08:50:32,494 - lava_callback - INFO - Starting async job submit for node 69ad37dfed37758c525e1b0a 2026-03-08 08:50:32,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:32,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37dfed37758c525e1b0a HTTP/1.1" 200 None 2026-03-08 08:50:32,539 - lava_callback - DEBUG - Processing node 69ad37dfed37758c525e1b0a: ltp-dio 2026-03-08 08:50:33,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:50:33,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:50:33,647 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69ad37dfed37758c525e1b0a/log.txt.gz 2026-03-08 08:50:33,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:50:34,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:50:34,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69ad37dfed37758c525e1b0a/lava-logs.yaml 2026-03-08 08:50:34,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:50:34,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:50:35,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69ad37dfed37758c525e1b0a/lava_callback.json.gz 2026-03-08 08:50:35,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:35,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37dfed37758c525e1b0a HTTP/1.1" 200 None 2026-03-08 08:50:35,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:35,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:50:35,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:35,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37dfed37758c525e1b0a HTTP/1.1" 200 None 2026-03-08 08:50:35,168 - lava_callback - INFO - Completed processing callback for node 69ad37dfed37758c525e1b0a INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:50:38,432 - lava_callback - INFO - Received callback for node 69aa955b76ddd5d9e606dcfd INFO: 172.21.0.1:39894 - "POST /node/69aa955b76ddd5d9e606dcfd HTTP/1.0" 202 Accepted 2026-03-08 08:50:38,443 - lava_callback - INFO - Starting async job submit for node 69aa955b76ddd5d9e606dcfd 2026-03-08 08:50:38,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:38,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa955b76ddd5d9e606dcfd HTTP/1.1" 200 None 2026-03-08 08:50:38,484 - lava_callback - DEBUG - Processing node 69aa955b76ddd5d9e606dcfd: baseline-arm64-baylibre 2026-03-08 08:50:38,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa955b76ddd5d9e606dcfd 2026-03-08 08:50:38,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa955b76ddd5d9e606dcfd HTTP/1.1" 200 None 2026-03-08 08:50:38,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:38,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-08 08:50:38,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:50:38,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa955b76ddd5d9e606dcfd HTTP/1.1" 200 None 2026-03-08 08:50:38,604 - lava_callback - ERROR - Error processing callback for node 69aa955b76ddd5d9e606dcfd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:51:01,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:01,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:51:07,382 - lava_callback - INFO - Received callback for node 69ad37b9ed37758c525e1aa7 INFO: 172.21.0.1:46960 - "POST /node/69ad37b9ed37758c525e1aa7 HTTP/1.0" 202 Accepted 2026-03-08 08:51:07,392 - lava_callback - INFO - Starting async job submit for node 69ad37b9ed37758c525e1aa7 2026-03-08 08:51:07,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:07,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b9ed37758c525e1aa7 HTTP/1.1" 200 None 2026-03-08 08:51:07,479 - lava_callback - DEBUG - Processing node 69ad37b9ed37758c525e1aa7: baseline-arm-clabbe 2026-03-08 08:51:07,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:51:08,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:51:08,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b9ed37758c525e1aa7/log.txt.gz 2026-03-08 08:51:08,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:51:09,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:51:09,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b9ed37758c525e1aa7/lava-logs.yaml 2026-03-08 08:51:09,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:51:10,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:51:10,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37b9ed37758c525e1aa7/lava_callback.json.gz 2026-03-08 08:51:10,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:10,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37b9ed37758c525e1aa7 HTTP/1.1" 200 None 2026-03-08 08:51:10,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:10,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:51:10,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:10,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37b9ed37758c525e1aa7 HTTP/1.1" 200 None 2026-03-08 08:51:10,418 - lava_callback - INFO - Completed processing callback for node 69ad37b9ed37758c525e1aa7 INFO: 172.21.0.1:46802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:51:31,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:31,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:51:58,555 - lava_callback - INFO - Received callback for node 69aa95a876ddd5d9e606dd1e INFO: 172.21.0.1:50128 - "POST /node/69aa95a876ddd5d9e606dd1e HTTP/1.0" 202 Accepted 2026-03-08 08:51:58,561 - lava_callback - INFO - Starting async job submit for node 69aa95a876ddd5d9e606dd1e 2026-03-08 08:51:58,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:58,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa95a876ddd5d9e606dd1e HTTP/1.1" 200 None 2026-03-08 08:51:58,585 - lava_callback - DEBUG - Processing node 69aa95a876ddd5d9e606dd1e: baseline-arm64-baylibre 2026-03-08 08:51:58,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa95a876ddd5d9e606dd1e 2026-03-08 08:51:58,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:58,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa95a876ddd5d9e606dd1e HTTP/1.1" 200 None 2026-03-08 08:51:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:58,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-08 08:51:58,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:51:58,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa95a876ddd5d9e606dd1e HTTP/1.1" 200 None 2026-03-08 08:51:58,697 - lava_callback - ERROR - Error processing callback for node 69aa95a876ddd5d9e606dd1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:52:10,889 - lava_callback - INFO - Received callback for node 69ad3420ed37758c525e18cf INFO: 172.21.0.1:42858 - "POST /node/69ad3420ed37758c525e18cf HTTP/1.0" 202 Accepted 2026-03-08 08:52:10,896 - lava_callback - INFO - Starting async job submit for node 69ad3420ed37758c525e18cf 2026-03-08 08:52:10,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:10,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3420ed37758c525e18cf HTTP/1.1" 200 None 2026-03-08 08:52:10,979 - lava_callback - DEBUG - Processing node 69ad3420ed37758c525e18cf: ltp-smoke 2026-03-08 08:52:11,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:52:11,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:52:11,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad3420ed37758c525e18cf/log.txt.gz 2026-03-08 08:52:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:52:12,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:52:12,408 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad3420ed37758c525e18cf/lava-logs.yaml 2026-03-08 08:52:12,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:52:12,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:52:12,614 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad3420ed37758c525e18cf/lava_callback.json.gz 2026-03-08 08:52:12,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:12,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3420ed37758c525e18cf HTTP/1.1" 200 None 2026-03-08 08:52:12,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:12,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c1ed37758c525e15d9 HTTP/1.1" 200 None 2026-03-08 08:52:12,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:12,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3420ed37758c525e18cf HTTP/1.1" 200 None 2026-03-08 08:52:13,017 - lava_callback - INFO - Completed processing callback for node 69ad3420ed37758c525e18cf INFO: 172.21.0.1:42862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39956 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:52:31,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:31,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:52:46,467 - lava_callback - INFO - Received callback for node 69ad37bded37758c525e1ab3 INFO: 172.21.0.1:52362 - "POST /node/69ad37bded37758c525e1ab3 HTTP/1.0" 202 Accepted 2026-03-08 08:52:46,473 - lava_callback - INFO - Starting async job submit for node 69ad37bded37758c525e1ab3 2026-03-08 08:52:46,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:46,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37bded37758c525e1ab3 HTTP/1.1" 200 None 2026-03-08 08:52:46,511 - lava_callback - DEBUG - Processing node 69ad37bded37758c525e1ab3: baseline-arm-clabbe INFO: 172.21.0.1:52376 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:52:46,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:52:46,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:52:46,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37bded37758c525e1ab3/log.txt.gz 2026-03-08 08:52:46,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:52:47,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:52:47,148 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37bded37758c525e1ab3/lava-logs.yaml 2026-03-08 08:52:47,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:52:47,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:52:47,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37bded37758c525e1ab3/lava_callback.json.gz 2026-03-08 08:52:47,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:47,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37bded37758c525e1ab3 HTTP/1.1" 200 None 2026-03-08 08:52:47,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:47,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:52:47,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:52:47,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37bded37758c525e1ab3 HTTP/1.1" 200 None 2026-03-08 08:52:47,381 - lava_callback - INFO - Completed processing callback for node 69ad37bded37758c525e1ab3 INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:53:01,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:01,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:53:20,911 - lava_callback - INFO - Received callback for node 69ad37eded37758c525e1b26 INFO: 172.21.0.1:48784 - "POST /node/69ad37eded37758c525e1b26 HTTP/1.0" 202 Accepted 2026-03-08 08:53:20,918 - lava_callback - INFO - Starting async job submit for node 69ad37eded37758c525e1b26 2026-03-08 08:53:20,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:20,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37eded37758c525e1b26 HTTP/1.1" 200 None 2026-03-08 08:53:20,960 - lava_callback - DEBUG - Processing node 69ad37eded37758c525e1b26: ltp-syscalls 2026-03-08 08:53:21,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:53:21,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:53:21,890 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ad37eded37758c525e1b26/log.txt.gz 2026-03-08 08:53:22,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:53:22,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:53:22,554 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ad37eded37758c525e1b26/lava-logs.yaml 2026-03-08 08:53:22,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:53:22,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:53:22,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ad37eded37758c525e1b26/lava_callback.json.gz 2026-03-08 08:53:22,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:22,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37eded37758c525e1b26 HTTP/1.1" 200 None 2026-03-08 08:53:22,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:22,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:53:22,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:22,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37eded37758c525e1b26 HTTP/1.1" 200 None 2026-03-08 08:53:22,896 - lava_callback - INFO - Completed processing callback for node 69ad37eded37758c525e1b26 INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:53:31,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:31,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:53:50,731 - lava_callback - INFO - Received callback for node 69ad37d7ed37758c525e1af3 INFO: 172.21.0.1:46724 - "POST /node/69ad37d7ed37758c525e1af3 HTTP/1.0" 202 Accepted 2026-03-08 08:53:50,738 - lava_callback - INFO - Starting async job submit for node 69ad37d7ed37758c525e1af3 2026-03-08 08:53:50,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:50,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37d7ed37758c525e1af3 HTTP/1.1" 200 None 2026-03-08 08:53:50,785 - lava_callback - DEBUG - Processing node 69ad37d7ed37758c525e1af3: ltp-cap_bounds 2026-03-08 08:53:51,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:53:51,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:53:51,308 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ad37d7ed37758c525e1af3/log.txt.gz 2026-03-08 08:53:51,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:53:51,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:53:51,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ad37d7ed37758c525e1af3/lava-logs.yaml 2026-03-08 08:53:51,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:53:51,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:53:51,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ad37d7ed37758c525e1af3/lava_callback.json.gz 2026-03-08 08:53:51,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:51,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37d7ed37758c525e1af3 HTTP/1.1" 200 None 2026-03-08 08:53:51,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:51,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:53:51,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:53:52,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37d7ed37758c525e1af3 HTTP/1.1" 200 None 2026-03-08 08:53:52,003 - lava_callback - INFO - Completed processing callback for node 69ad37d7ed37758c525e1af3 INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:54:01,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:01,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:54:25,549 - lava_callback - INFO - Received callback for node 69ad37beed37758c525e1ab6 INFO: 172.21.0.1:43304 - "POST /node/69ad37beed37758c525e1ab6 HTTP/1.0" 202 Accepted 2026-03-08 08:54:25,554 - lava_callback - INFO - Starting async job submit for node 69ad37beed37758c525e1ab6 2026-03-08 08:54:25,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:25,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37beed37758c525e1ab6 HTTP/1.1" 200 None 2026-03-08 08:54:25,590 - lava_callback - DEBUG - Processing node 69ad37beed37758c525e1ab6: baseline-arm-clabbe 2026-03-08 08:54:25,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:54:25,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:54:25,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37beed37758c525e1ab6/log.txt.gz 2026-03-08 08:54:26,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:54:26,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:54:26,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37beed37758c525e1ab6/lava-logs.yaml 2026-03-08 08:54:26,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:54:26,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:54:26,469 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ad37beed37758c525e1ab6/lava_callback.json.gz 2026-03-08 08:54:26,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:26,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37beed37758c525e1ab6 HTTP/1.1" 200 None 2026-03-08 08:54:26,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:26,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:54:26,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:54:26,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37beed37758c525e1ab6 HTTP/1.1" 200 None 2026-03-08 08:54:26,555 - lava_callback - INFO - Completed processing callback for node 69ad37beed37758c525e1ab6 INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:54:31,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:31,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:54:38,679 - lava_callback - INFO - Received callback for node 69aa963b76ddd5d9e606dd6d INFO: 172.21.0.1:55862 - "POST /node/69aa963b76ddd5d9e606dd6d HTTP/1.0" 202 Accepted 2026-03-08 08:54:38,684 - lava_callback - INFO - Starting async job submit for node 69aa963b76ddd5d9e606dd6d 2026-03-08 08:54:38,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:38,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa963b76ddd5d9e606dd6d HTTP/1.1" 200 None 2026-03-08 08:54:38,702 - lava_callback - DEBUG - Processing node 69aa963b76ddd5d9e606dd6d: baseline-arm64-baylibre 2026-03-08 08:54:38,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa963b76ddd5d9e606dd6d 2026-03-08 08:54:38,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:38,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa963b76ddd5d9e606dd6d HTTP/1.1" 200 None 2026-03-08 08:54:38,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:38,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-08 08:54:38,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:54:38,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa963b76ddd5d9e606dd6d HTTP/1.1" 200 None 2026-03-08 08:54:38,772 - lava_callback - ERROR - Error processing callback for node 69aa963b76ddd5d9e606dd6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:55:38,695 - lava_callback - INFO - Received callback for node 69aa968776ddd5d9e606dd96 INFO: 172.21.0.1:49012 - "POST /node/69aa968776ddd5d9e606dd96 HTTP/1.0" 202 Accepted 2026-03-08 08:55:38,700 - lava_callback - INFO - Starting async job submit for node 69aa968776ddd5d9e606dd96 2026-03-08 08:55:38,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:55:38,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa968776ddd5d9e606dd96 HTTP/1.1" 200 None 2026-03-08 08:55:38,718 - lava_callback - DEBUG - Processing node 69aa968776ddd5d9e606dd96: baseline-arm64-baylibre 2026-03-08 08:55:38,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa968776ddd5d9e606dd96 2026-03-08 08:55:38,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:55:38,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa968776ddd5d9e606dd96 HTTP/1.1" 200 None 2026-03-08 08:55:38,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:55:38,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-08 08:55:38,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:55:38,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa968776ddd5d9e606dd96 HTTP/1.1" 200 None 2026-03-08 08:55:38,778 - lava_callback - ERROR - Error processing callback for node 69aa968776ddd5d9e606dd96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:56:29,409 - lava_callback - INFO - Received callback for node 69ad398fed37758c525e1c5c INFO: 172.21.0.1:43168 - "POST /node/69ad398fed37758c525e1c5c HTTP/1.0" 202 Accepted 2026-03-08 08:56:29,418 - lava_callback - INFO - Starting async job submit for node 69ad398fed37758c525e1c5c 2026-03-08 08:56:29,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:29,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad398fed37758c525e1c5c HTTP/1.1" 200 None 2026-03-08 08:56:29,457 - lava_callback - DEBUG - Processing node 69ad398fed37758c525e1c5c: baseline-x86 2026-03-08 08:56:29,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:56:29,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:56:29,811 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ad398fed37758c525e1c5c/log.txt.gz 2026-03-08 08:56:29,844 - lava_callback - INFO - Received callback for node 69ad3990ed37758c525e1c5f INFO: 172.21.0.1:37346 - "POST /node/69ad3990ed37758c525e1c5f HTTP/1.0" 202 Accepted 2026-03-08 08:56:29,859 - lava_callback - INFO - Starting async job submit for node 69ad3990ed37758c525e1c5f 2026-03-08 08:56:29,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:29,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:56:29,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3990ed37758c525e1c5f HTTP/1.1" 200 None 2026-03-08 08:56:29,945 - lava_callback - DEBUG - Processing node 69ad3990ed37758c525e1c5f: baseline-x86 2026-03-08 08:56:30,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:56:30,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:56:30,255 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ad398fed37758c525e1c5c/lava-logs.yaml 2026-03-08 08:56:30,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:56:30,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:56:30,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3990ed37758c525e1c5f/log.txt.gz 2026-03-08 08:56:30,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:56:30,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:56:30,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ad398fed37758c525e1c5c/lava_callback.json.gz 2026-03-08 08:56:30,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:30,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad398fed37758c525e1c5c HTTP/1.1" 200 None 2026-03-08 08:56:30,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:30,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30dded37758c525e1606 HTTP/1.1" 200 None 2026-03-08 08:56:30,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:30,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad398fed37758c525e1c5c HTTP/1.1" 200 None 2026-03-08 08:56:30,564 - lava_callback - INFO - Completed processing callback for node 69ad398fed37758c525e1c5c 2026-03-08 08:56:30,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:56:30,597 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3990ed37758c525e1c5f/lava-logs.yaml 2026-03-08 08:56:30,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:56:30,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:56:30,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3990ed37758c525e1c5f/lava_callback.json.gz 2026-03-08 08:56:30,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:30,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3990ed37758c525e1c5f HTTP/1.1" 200 None 2026-03-08 08:56:30,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:30,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30dded37758c525e1606 HTTP/1.1" 200 None 2026-03-08 08:56:30,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:30,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3990ed37758c525e1c5f HTTP/1.1" 200 None 2026-03-08 08:56:30,872 - lava_callback - INFO - Completed processing callback for node 69ad3990ed37758c525e1c5f 2026-03-08 08:56:31,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:31,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:56:58,873 - lava_callback - INFO - Received callback for node 69aa96d276ddd5d9e606ddc2 INFO: 172.21.0.1:58274 - "POST /node/69aa96d276ddd5d9e606ddc2 HTTP/1.0" 202 Accepted 2026-03-08 08:56:58,879 - lava_callback - INFO - Starting async job submit for node 69aa96d276ddd5d9e606ddc2 2026-03-08 08:56:58,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:58,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa96d276ddd5d9e606ddc2 HTTP/1.1" 200 None 2026-03-08 08:56:58,899 - lava_callback - DEBUG - Processing node 69aa96d276ddd5d9e606ddc2: baseline-arm64-baylibre 2026-03-08 08:56:58,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa96d276ddd5d9e606ddc2 2026-03-08 08:56:58,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:58,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa96d276ddd5d9e606ddc2 HTTP/1.1" 200 None 2026-03-08 08:56:58,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:58,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-08 08:56:58,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:56:58,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa96d276ddd5d9e606ddc2 HTTP/1.1" 200 None 2026-03-08 08:56:58,982 - lava_callback - ERROR - Error processing callback for node 69aa96d276ddd5d9e606ddc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:57:50,854 - lava_callback - INFO - Received callback for node 69ad37d9ed37758c525e1af6 INFO: 172.21.0.1:52706 - "POST /node/69ad37d9ed37758c525e1af6 HTTP/1.0" 202 Accepted 2026-03-08 08:57:50,861 - lava_callback - INFO - Starting async job submit for node 69ad37d9ed37758c525e1af6 2026-03-08 08:57:50,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:57:50,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37d9ed37758c525e1af6 HTTP/1.1" 200 None 2026-03-08 08:57:50,910 - lava_callback - DEBUG - Processing node 69ad37d9ed37758c525e1af6: ltp-containers 2026-03-08 08:57:51,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:57:51,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:57:51,682 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69ad37d9ed37758c525e1af6/log.txt.gz 2026-03-08 08:57:52,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:57:52,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:57:52,440 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69ad37d9ed37758c525e1af6/lava-logs.yaml 2026-03-08 08:57:52,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:57:52,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:57:52,699 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69ad37d9ed37758c525e1af6/lava_callback.json.gz 2026-03-08 08:57:52,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:57:52,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37d9ed37758c525e1af6 HTTP/1.1" 200 None 2026-03-08 08:57:52,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:57:52,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:57:52,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:57:52,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37d9ed37758c525e1af6 HTTP/1.1" 200 None 2026-03-08 08:57:52,863 - lava_callback - INFO - Completed processing callback for node 69ad37d9ed37758c525e1af6 INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:58:01,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:58:01,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:58:34,248 - lava_callback - INFO - Received callback for node 69ad3a2bed37758c525e1cba INFO: 172.21.0.1:40302 - "POST /node/69ad3a2bed37758c525e1cba HTTP/1.0" 202 Accepted 2026-03-08 08:58:34,254 - lava_callback - INFO - Starting async job submit for node 69ad3a2bed37758c525e1cba 2026-03-08 08:58:34,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:58:34,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3a2bed37758c525e1cba HTTP/1.1" 200 None 2026-03-08 08:58:34,272 - lava_callback - DEBUG - Processing node 69ad3a2bed37758c525e1cba: baseline-arm 2026-03-08 08:58:34,277 - lava_callback - WARNING - Failed to upload log 2026-03-08 08:58:34,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:58:34,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:58:34,410 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad3a2bed37758c525e1cba/lava-logs.yaml 2026-03-08 08:58:34,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 08:58:34,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 08:58:34,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad3a2bed37758c525e1cba/lava_callback.json.gz 2026-03-08 08:58:34,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:58:34,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3a2bed37758c525e1cba HTTP/1.1" 200 None 2026-03-08 08:58:34,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:58:34,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 08:58:34,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:58:34,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3a2bed37758c525e1cba HTTP/1.1" 200 None 2026-03-08 08:58:34,614 - lava_callback - INFO - Completed processing callback for node 69ad3a2bed37758c525e1cba INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK 2026-03-08 08:59:01,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 08:59:01,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:01:50,998 - lava_callback - INFO - Received callback for node 69ad37daed37758c525e1af9 INFO: 172.21.0.1:34952 - "POST /node/69ad37daed37758c525e1af9 HTTP/1.0" 202 Accepted 2026-03-08 09:01:51,005 - lava_callback - INFO - Starting async job submit for node 69ad37daed37758c525e1af9 2026-03-08 09:01:51,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:01:51,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37daed37758c525e1af9 HTTP/1.1" 200 None 2026-03-08 09:01:51,082 - lava_callback - DEBUG - Processing node 69ad37daed37758c525e1af9: ltp-controllers 2026-03-08 09:01:51,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:01:51,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:01:51,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69ad37daed37758c525e1af9/log.txt.gz 2026-03-08 09:01:51,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:01:52,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:01:52,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69ad37daed37758c525e1af9/lava-logs.yaml 2026-03-08 09:01:52,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:01:52,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:01:52,267 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69ad37daed37758c525e1af9/lava_callback.json.gz 2026-03-08 09:01:52,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:01:52,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37daed37758c525e1af9 HTTP/1.1" 200 None 2026-03-08 09:01:52,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:01:52,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:01:52,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:01:52,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37daed37758c525e1af9 HTTP/1.1" 200 None 2026-03-08 09:01:52,350 - lava_callback - INFO - Completed processing callback for node 69ad37daed37758c525e1af9 INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:02:01,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:02:01,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:02:10,726 - lava_callback - INFO - Received callback for node 69ad3749ed37758c525e19dd INFO: 172.21.0.1:43224 - "POST /node/69ad3749ed37758c525e19dd HTTP/1.0" 202 Accepted 2026-03-08 09:02:10,733 - lava_callback - INFO - Starting async job submit for node 69ad3749ed37758c525e19dd 2026-03-08 09:02:10,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:02:10,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3749ed37758c525e19dd HTTP/1.1" 200 None 2026-03-08 09:02:10,792 - lava_callback - DEBUG - Processing node 69ad3749ed37758c525e19dd: baseline-x86 2026-03-08 09:02:11,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:02:11,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:02:11,676 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3749ed37758c525e19dd/log.txt.gz 2026-03-08 09:02:12,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:02:12,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:02:12,347 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3749ed37758c525e19dd/lava-logs.yaml 2026-03-08 09:02:12,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:02:12,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:02:12,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3749ed37758c525e19dd/lava_callback.json.gz DEBUG: Setup failed for 69ad3749ed37758c525e19dd. Transitting job node result: incomplete -> fail 2026-03-08 09:02:12,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:02:12,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3749ed37758c525e19dd HTTP/1.1" 200 None 2026-03-08 09:02:12,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:02:12,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30dded37758c525e1606 HTTP/1.1" 200 None 2026-03-08 09:02:12,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:02:12,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3749ed37758c525e19dd HTTP/1.1" 200 None 2026-03-08 09:02:12,839 - lava_callback - INFO - Completed processing callback for node 69ad3749ed37758c525e19dd INFO: 172.21.0.1:43232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:02:31,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:02:31,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:04:30,772 - lava_callback - INFO - Received callback for node 69ad33e0ed37758c525e18b1 INFO: 172.21.0.1:45620 - "POST /node/69ad33e0ed37758c525e18b1 HTTP/1.0" 202 Accepted 2026-03-08 09:04:30,778 - lava_callback - INFO - Starting async job submit for node 69ad33e0ed37758c525e18b1 2026-03-08 09:04:30,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:04:30,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad33e0ed37758c525e18b1 HTTP/1.1" 200 None 2026-03-08 09:04:30,837 - lava_callback - DEBUG - Processing node 69ad33e0ed37758c525e18b1: baseline-arm64-broonie 2026-03-08 09:04:30,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:04:31,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:04:31,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad33e0ed37758c525e18b1/log.txt.gz 2026-03-08 09:04:31,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:04:31,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:04:31,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad33e0ed37758c525e18b1/lava-logs.yaml 2026-03-08 09:04:31,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:04:31,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:04:31,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad33e0ed37758c525e18b1/lava_callback.json.gz 2026-03-08 09:04:31,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:04:31,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad33e0ed37758c525e18b1 HTTP/1.1" 200 None 2026-03-08 09:04:31,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:04:31,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-08 09:04:31,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:04:31,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad33e0ed37758c525e18b1 HTTP/1.1" 200 None 2026-03-08 09:04:31,695 - lava_callback - INFO - Completed processing callback for node 69ad33e0ed37758c525e18b1 INFO: 172.21.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41072 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:05:01,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:01,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:05:14,989 - lava_callback - INFO - Received callback for node 69ad37a1ed37758c525e1a38 INFO: 172.21.0.1:55982 - "POST /node/69ad37a1ed37758c525e1a38 HTTP/1.0" 202 Accepted 2026-03-08 09:05:14,996 - lava_callback - INFO - Starting async job submit for node 69ad37a1ed37758c525e1a38 2026-03-08 09:05:15,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:15,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a1ed37758c525e1a38 HTTP/1.1" 200 None 2026-03-08 09:05:15,076 - lava_callback - DEBUG - Processing node 69ad37a1ed37758c525e1a38: baseline-arm INFO: 172.21.0.1:55998 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-08 09:05:15,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:05:16,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:05:16,014 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a1ed37758c525e1a38/log.txt.gz 2026-03-08 09:05:16,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56012 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:05:16,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:05:16,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a1ed37758c525e1a38/lava-logs.yaml 2026-03-08 09:05:16,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:05:17,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:05:17,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad37a1ed37758c525e1a38/lava_callback.json.gz DEBUG: Setup failed for 69ad37a1ed37758c525e1a38. Transitting job node result: incomplete -> fail 2026-03-08 09:05:17,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:17,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37a1ed37758c525e1a38 HTTP/1.1" 200 None 2026-03-08 09:05:17,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:17,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:05:17,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:17,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37a1ed37758c525e1a38 HTTP/1.1" 200 None 2026-03-08 09:05:17,462 - lava_callback - INFO - Completed processing callback for node 69ad37a1ed37758c525e1a38 INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:05:31,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:31,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:05:51,496 - lava_callback - INFO - Received callback for node 69ad37dded37758c525e1b00 INFO: 172.21.0.1:57860 - "POST /node/69ad37dded37758c525e1b00 HTTP/1.0" 202 Accepted 2026-03-08 09:05:51,503 - lava_callback - INFO - Starting async job submit for node 69ad37dded37758c525e1b00 2026-03-08 09:05:51,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:51,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37dded37758c525e1b00 HTTP/1.1" 200 None 2026-03-08 09:05:51,546 - lava_callback - DEBUG - Processing node 69ad37dded37758c525e1b00: ltp-cve 2026-03-08 09:05:51,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:05:52,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:05:52,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69ad37dded37758c525e1b00/log.txt.gz 2026-03-08 09:05:52,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:05:52,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:05:52,544 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69ad37dded37758c525e1b00/lava-logs.yaml 2026-03-08 09:05:52,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:05:52,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:05:52,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69ad37dded37758c525e1b00/lava_callback.json.gz 2026-03-08 09:05:52,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:52,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37dded37758c525e1b00 HTTP/1.1" 200 None 2026-03-08 09:05:52,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:52,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:05:52,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:05:52,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37dded37758c525e1b00 HTTP/1.1" 200 None 2026-03-08 09:05:52,842 - lava_callback - INFO - Completed processing callback for node 69ad37dded37758c525e1b00 INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:06:01,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:01,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:06:37,328 - lava_callback - INFO - Received callback for node 69ad3c01ed37758c525e1e47 INFO: 172.21.0.1:44280 - "POST /node/69ad3c01ed37758c525e1e47 HTTP/1.0" 202 Accepted 2026-03-08 09:06:37,339 - lava_callback - INFO - Starting async job submit for node 69ad3c01ed37758c525e1e47 2026-03-08 09:06:37,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:37,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c01ed37758c525e1e47 HTTP/1.1" 200 None 2026-03-08 09:06:37,370 - lava_callback - DEBUG - Processing node 69ad3c01ed37758c525e1e47: baseline-nfs-arm64 2026-03-08 09:06:37,372 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:06:37,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:06:37,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:06:37,508 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c01ed37758c525e1e47/lava-logs.yaml 2026-03-08 09:06:37,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:06:37,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:06:37,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c01ed37758c525e1e47/lava_callback.json.gz 2026-03-08 09:06:37,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:37,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c01ed37758c525e1e47 HTTP/1.1" 200 None 2026-03-08 09:06:37,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:37,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:06:37,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:37,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c01ed37758c525e1e47 HTTP/1.1" 200 None 2026-03-08 09:06:37,706 - lava_callback - INFO - Completed processing callback for node 69ad3c01ed37758c525e1e47 2026-03-08 09:06:43,287 - lava_callback - INFO - Received callback for node 69ad3bf1ed37758c525e1e07 INFO: 172.21.0.1:57380 - "POST /node/69ad3bf1ed37758c525e1e07 HTTP/1.0" 202 Accepted 2026-03-08 09:06:43,294 - lava_callback - INFO - Starting async job submit for node 69ad3bf1ed37758c525e1e07 2026-03-08 09:06:43,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:43,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf1ed37758c525e1e07 HTTP/1.1" 200 None 2026-03-08 09:06:43,339 - lava_callback - DEBUG - Processing node 69ad3bf1ed37758c525e1e07: baseline-arm64 2026-03-08 09:06:43,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:06:43,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:06:43,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf1ed37758c525e1e07/log.txt.gz 2026-03-08 09:06:43,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:06:43,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:06:43,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf1ed37758c525e1e07/lava-logs.yaml 2026-03-08 09:06:43,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:06:44,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:06:44,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf1ed37758c525e1e07/lava_callback.json.gz 2026-03-08 09:06:44,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:44,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf1ed37758c525e1e07 HTTP/1.1" 200 None 2026-03-08 09:06:44,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:44,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:06:44,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:44,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bf1ed37758c525e1e07 HTTP/1.1" 200 None 2026-03-08 09:06:44,434 - lava_callback - INFO - Completed processing callback for node 69ad3bf1ed37758c525e1e07 INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:06:48,914 - lava_callback - INFO - Received callback for node 69ad3be6ed37758c525e1de1 INFO: 172.21.0.1:57398 - "POST /node/69ad3be6ed37758c525e1de1 HTTP/1.0" 202 Accepted 2026-03-08 09:06:48,926 - lava_callback - INFO - Starting async job submit for node 69ad3be6ed37758c525e1de1 2026-03-08 09:06:48,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:48,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be6ed37758c525e1de1 HTTP/1.1" 200 None 2026-03-08 09:06:48,991 - lava_callback - DEBUG - Processing node 69ad3be6ed37758c525e1de1: baseline-arm64 2026-03-08 09:06:49,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:06:49,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:06:49,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be6ed37758c525e1de1/log.txt.gz 2026-03-08 09:06:49,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:06:49,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:06:49,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be6ed37758c525e1de1/lava-logs.yaml 2026-03-08 09:06:49,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:06:49,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:06:49,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be6ed37758c525e1de1/lava_callback.json.gz 2026-03-08 09:06:49,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:49,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be6ed37758c525e1de1 HTTP/1.1" 200 None 2026-03-08 09:06:49,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:49,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:06:49,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:06:49,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3be6ed37758c525e1de1 HTTP/1.1" 200 None 2026-03-08 09:06:49,917 - lava_callback - INFO - Completed processing callback for node 69ad3be6ed37758c525e1de1 INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:07:01,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:01,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:07:09,683 - lava_callback - INFO - Received callback for node 69ad3beaed37758c525e1df0 INFO: 172.21.0.1:52212 - "POST /node/69ad3beaed37758c525e1df0 HTTP/1.0" 202 Accepted 2026-03-08 09:07:09,694 - lava_callback - INFO - Starting async job submit for node 69ad3beaed37758c525e1df0 2026-03-08 09:07:09,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:09,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3beaed37758c525e1df0 HTTP/1.1" 200 None 2026-03-08 09:07:09,754 - lava_callback - DEBUG - Processing node 69ad3beaed37758c525e1df0: baseline-arm64 2026-03-08 09:07:09,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:10,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:10,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beaed37758c525e1df0/log.txt.gz 2026-03-08 09:07:10,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:10,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:10,277 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beaed37758c525e1df0/lava-logs.yaml 2026-03-08 09:07:10,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:10,463 - lava_callback - INFO - Received callback for node 69ad3befed37758c525e1dfd INFO: 172.21.0.1:57404 - "POST /node/69ad3befed37758c525e1dfd HTTP/1.0" 202 Accepted 2026-03-08 09:07:10,473 - lava_callback - INFO - Starting async job submit for node 69ad3befed37758c525e1dfd 2026-03-08 09:07:10,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:10,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:10,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beaed37758c525e1df0/lava_callback.json.gz 2026-03-08 09:07:10,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:10,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3befed37758c525e1dfd HTTP/1.1" 200 None 2026-03-08 09:07:10,537 - lava_callback - DEBUG - Processing node 69ad3befed37758c525e1dfd: baseline-arm64 2026-03-08 09:07:10,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3beaed37758c525e1df0 HTTP/1.1" 200 None 2026-03-08 09:07:10,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:10,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:10,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:10,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3beaed37758c525e1df0 HTTP/1.1" 200 None 2026-03-08 09:07:10,898 - lava_callback - INFO - Completed processing callback for node 69ad3beaed37758c525e1df0 2026-03-08 09:07:11,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:11,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:11,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3befed37758c525e1dfd/log.txt.gz 2026-03-08 09:07:11,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:11,629 - lava_callback - INFO - Received callback for node 69ad3beeed37758c525e1df9 INFO: 172.21.0.1:57416 - "POST /node/69ad3beeed37758c525e1df9 HTTP/1.0" 202 Accepted 2026-03-08 09:07:11,636 - lava_callback - INFO - Starting async job submit for node 69ad3beeed37758c525e1df9 2026-03-08 09:07:11,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:11,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3beeed37758c525e1df9 HTTP/1.1" 200 None 2026-03-08 09:07:11,675 - lava_callback - DEBUG - Processing node 69ad3beeed37758c525e1df9: baseline-arm64 2026-03-08 09:07:11,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:11,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3befed37758c525e1dfd/lava-logs.yaml 2026-03-08 09:07:11,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:12,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:12,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3befed37758c525e1dfd/lava_callback.json.gz 2026-03-08 09:07:12,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:12,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:12,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3befed37758c525e1dfd HTTP/1.1" 200 None 2026-03-08 09:07:12,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:12,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:12,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:12,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3befed37758c525e1dfd HTTP/1.1" 200 None 2026-03-08 09:07:12,176 - lava_callback - INFO - Completed processing callback for node 69ad3befed37758c525e1dfd 2026-03-08 09:07:12,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:12,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beeed37758c525e1df9/log.txt.gz 2026-03-08 09:07:12,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:12,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:12,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beeed37758c525e1df9/lava-logs.yaml 2026-03-08 09:07:12,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:12,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:12,960 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beeed37758c525e1df9/lava_callback.json.gz 2026-03-08 09:07:12,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:12,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3beeed37758c525e1df9 HTTP/1.1" 200 None 2026-03-08 09:07:13,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:13,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:13,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:13,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3beeed37758c525e1df9 HTTP/1.1" 200 None 2026-03-08 09:07:13,072 - lava_callback - INFO - Completed processing callback for node 69ad3beeed37758c525e1df9 INFO: 172.21.0.1:57422 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-08 09:07:16,001 - lava_callback - INFO - Received callback for node 69ad3be6ed37758c525e1de4 INFO: 172.21.0.1:57434 - "POST /node/69ad3be6ed37758c525e1de4 HTTP/1.0" 202 Accepted 2026-03-08 09:07:16,007 - lava_callback - INFO - Starting async job submit for node 69ad3be6ed37758c525e1de4 2026-03-08 09:07:16,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:16,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be6ed37758c525e1de4 HTTP/1.1" 200 None 2026-03-08 09:07:16,046 - lava_callback - DEBUG - Processing node 69ad3be6ed37758c525e1de4: baseline-arm64 2026-03-08 09:07:16,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:16,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:16,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be6ed37758c525e1de4/log.txt.gz INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:07:16,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:16,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:16,729 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be6ed37758c525e1de4/lava-logs.yaml 2026-03-08 09:07:16,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:16,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:16,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be6ed37758c525e1de4/lava_callback.json.gz 2026-03-08 09:07:17,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:17,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be6ed37758c525e1de4 HTTP/1.1" 200 None 2026-03-08 09:07:17,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:17,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:17,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:17,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3be6ed37758c525e1de4 HTTP/1.1" 200 None 2026-03-08 09:07:17,111 - lava_callback - INFO - Completed processing callback for node 69ad3be6ed37758c525e1de4 2026-03-08 09:07:18,307 - lava_callback - INFO - Received callback for node 69ad3bf5ed37758c525e1e23 INFO: 172.21.0.1:57458 - "POST /node/69ad3bf5ed37758c525e1e23 HTTP/1.0" 202 Accepted 2026-03-08 09:07:18,314 - lava_callback - INFO - Starting async job submit for node 69ad3bf5ed37758c525e1e23 2026-03-08 09:07:18,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:18,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf5ed37758c525e1e23 HTTP/1.1" 200 None 2026-03-08 09:07:18,351 - lava_callback - DEBUG - Processing node 69ad3bf5ed37758c525e1e23: baseline-arm64 2026-03-08 09:07:18,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:18,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:18,774 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf5ed37758c525e1e23/log.txt.gz 2026-03-08 09:07:18,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:19,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:19,148 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf5ed37758c525e1e23/lava-logs.yaml 2026-03-08 09:07:19,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:19,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:19,294 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf5ed37758c525e1e23/lava_callback.json.gz 2026-03-08 09:07:19,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:19,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf5ed37758c525e1e23 HTTP/1.1" 200 None 2026-03-08 09:07:19,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:19,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:19,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:19,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bf5ed37758c525e1e23 HTTP/1.1" 200 None 2026-03-08 09:07:19,371 - lava_callback - INFO - Completed processing callback for node 69ad3bf5ed37758c525e1e23 2026-03-08 09:07:19,708 - lava_callback - INFO - Received callback for node 69ad3be8ed37758c525e1dea INFO: 172.21.0.1:47198 - "POST /node/69ad3be8ed37758c525e1dea HTTP/1.0" 202 Accepted 2026-03-08 09:07:19,727 - lava_callback - INFO - Starting async job submit for node 69ad3be8ed37758c525e1dea 2026-03-08 09:07:19,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:19,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be8ed37758c525e1dea HTTP/1.1" 200 None 2026-03-08 09:07:19,817 - lava_callback - DEBUG - Processing node 69ad3be8ed37758c525e1dea: baseline-arm64 2026-03-08 09:07:20,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:20,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:20,260 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be8ed37758c525e1dea/log.txt.gz 2026-03-08 09:07:20,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:20,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:20,607 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be8ed37758c525e1dea/lava-logs.yaml 2026-03-08 09:07:20,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:20,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:20,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be8ed37758c525e1dea/lava_callback.json.gz 2026-03-08 09:07:20,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:20,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be8ed37758c525e1dea HTTP/1.1" 200 None 2026-03-08 09:07:20,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:20,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:20,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:20,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3be8ed37758c525e1dea HTTP/1.1" 200 None 2026-03-08 09:07:20,852 - lava_callback - INFO - Completed processing callback for node 69ad3be8ed37758c525e1dea 2026-03-08 09:07:20,979 - lava_callback - INFO - Received callback for node 69ad3bf7ed37758c525e1e2a INFO: 172.21.0.1:47210 - "POST /node/69ad3bf7ed37758c525e1e2a HTTP/1.0" 202 Accepted 2026-03-08 09:07:20,988 - lava_callback - INFO - Starting async job submit for node 69ad3bf7ed37758c525e1e2a 2026-03-08 09:07:21,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:21,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf7ed37758c525e1e2a HTTP/1.1" 200 None 2026-03-08 09:07:21,044 - lava_callback - DEBUG - Processing node 69ad3bf7ed37758c525e1e2a: baseline-arm64 2026-03-08 09:07:21,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:21,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:21,464 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf7ed37758c525e1e2a/log.txt.gz 2026-03-08 09:07:21,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:21,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:21,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf7ed37758c525e1e2a/lava-logs.yaml 2026-03-08 09:07:21,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:22,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:22,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf7ed37758c525e1e2a/lava_callback.json.gz 2026-03-08 09:07:22,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:22,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf7ed37758c525e1e2a HTTP/1.1" 200 None 2026-03-08 09:07:22,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:22,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:22,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:22,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bf7ed37758c525e1e2a HTTP/1.1" 200 None 2026-03-08 09:07:22,115 - lava_callback - INFO - Completed processing callback for node 69ad3bf7ed37758c525e1e2a 2026-03-08 09:07:25,412 - lava_callback - INFO - Received callback for node 69ad3beded37758c525e1df6 INFO: 172.21.0.1:47214 - "POST /node/69ad3beded37758c525e1df6 HTTP/1.0" 202 Accepted 2026-03-08 09:07:25,419 - lava_callback - INFO - Starting async job submit for node 69ad3beded37758c525e1df6 2026-03-08 09:07:25,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:25,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3beded37758c525e1df6 HTTP/1.1" 200 None 2026-03-08 09:07:25,468 - lava_callback - DEBUG - Processing node 69ad3beded37758c525e1df6: baseline-arm64 2026-03-08 09:07:25,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:25,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:25,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beded37758c525e1df6/log.txt.gz 2026-03-08 09:07:26,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:26,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:26,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beded37758c525e1df6/lava-logs.yaml 2026-03-08 09:07:26,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47228 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:07:26,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:26,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beded37758c525e1df6/lava_callback.json.gz 2026-03-08 09:07:26,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:26,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3beded37758c525e1df6 HTTP/1.1" 200 None 2026-03-08 09:07:26,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:26,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:26,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:26,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3beded37758c525e1df6 HTTP/1.1" 200 None 2026-03-08 09:07:26,694 - lava_callback - INFO - Completed processing callback for node 69ad3beded37758c525e1df6 2026-03-08 09:07:26,730 - lava_callback - INFO - Received callback for node 69ad3bf3ed37758c525e1e1d INFO: 172.21.0.1:47236 - "POST /node/69ad3bf3ed37758c525e1e1d HTTP/1.0" 202 Accepted 2026-03-08 09:07:26,740 - lava_callback - INFO - Starting async job submit for node 69ad3bf3ed37758c525e1e1d 2026-03-08 09:07:26,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:26,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf3ed37758c525e1e1d HTTP/1.1" 200 None 2026-03-08 09:07:26,816 - lava_callback - DEBUG - Processing node 69ad3bf3ed37758c525e1e1d: baseline-arm64 2026-03-08 09:07:27,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:27,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:27,212 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf3ed37758c525e1e1d/log.txt.gz 2026-03-08 09:07:27,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:07:27,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:27,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf3ed37758c525e1e1d/lava-logs.yaml 2026-03-08 09:07:27,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:27,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:27,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf3ed37758c525e1e1d/lava_callback.json.gz 2026-03-08 09:07:27,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:27,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf3ed37758c525e1e1d HTTP/1.1" 200 None 2026-03-08 09:07:27,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:27,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:27,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:27,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bf3ed37758c525e1e1d HTTP/1.1" 200 None 2026-03-08 09:07:27,769 - lava_callback - INFO - Completed processing callback for node 69ad3bf3ed37758c525e1e1d 2026-03-08 09:07:27,848 - lava_callback - INFO - Received callback for node 69ad3be7ed37758c525e1de7 INFO: 172.21.0.1:47256 - "POST /node/69ad3be7ed37758c525e1de7 HTTP/1.0" 202 Accepted 2026-03-08 09:07:27,857 - lava_callback - INFO - Starting async job submit for node 69ad3be7ed37758c525e1de7 2026-03-08 09:07:27,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:27,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be7ed37758c525e1de7 HTTP/1.1" 200 None 2026-03-08 09:07:27,916 - lava_callback - DEBUG - Processing node 69ad3be7ed37758c525e1de7: baseline-arm64 2026-03-08 09:07:28,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:28,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:28,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be7ed37758c525e1de7/log.txt.gz 2026-03-08 09:07:28,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:28,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:28,795 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be7ed37758c525e1de7/lava-logs.yaml 2026-03-08 09:07:28,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:28,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:28,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be7ed37758c525e1de7/lava_callback.json.gz 2026-03-08 09:07:28,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:28,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be7ed37758c525e1de7 HTTP/1.1" 200 None 2026-03-08 09:07:28,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:28,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:28,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:29,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3be7ed37758c525e1de7 HTTP/1.1" 200 None 2026-03-08 09:07:29,022 - lava_callback - INFO - Completed processing callback for node 69ad3be7ed37758c525e1de7 2026-03-08 09:07:31,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:31,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-08 09:07:32,727 - lava_callback - INFO - Received callback for node 69ad3be9ed37758c525e1ded INFO: 172.21.0.1:53712 - "POST /node/69ad3be9ed37758c525e1ded HTTP/1.0" 202 Accepted 2026-03-08 09:07:32,735 - lava_callback - INFO - Starting async job submit for node 69ad3be9ed37758c525e1ded 2026-03-08 09:07:32,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:32,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be9ed37758c525e1ded HTTP/1.1" 200 None 2026-03-08 09:07:32,797 - lava_callback - DEBUG - Processing node 69ad3be9ed37758c525e1ded: baseline-arm64 2026-03-08 09:07:32,986 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:07:33,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:33,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:33,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be9ed37758c525e1ded/lava-logs.yaml 2026-03-08 09:07:33,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:33,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:33,357 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3be9ed37758c525e1ded/lava_callback.json.gz 2026-03-08 09:07:33,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:33,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3be9ed37758c525e1ded HTTP/1.1" 200 None 2026-03-08 09:07:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:33,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:33,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:33,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3be9ed37758c525e1ded HTTP/1.1" 200 None 2026-03-08 09:07:33,501 - lava_callback - INFO - Completed processing callback for node 69ad3be9ed37758c525e1ded INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:07:49,296 - lava_callback - INFO - Received callback for node 69ad37c5ed37758c525e1ace INFO: 172.21.0.1:42698 - "POST /node/69ad37c5ed37758c525e1ace HTTP/1.0" 202 Accepted 2026-03-08 09:07:49,345 - lava_callback - INFO - Starting async job submit for node 69ad37c5ed37758c525e1ace 2026-03-08 09:07:49,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:49,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c5ed37758c525e1ace HTTP/1.1" 200 None 2026-03-08 09:07:49,402 - lava_callback - DEBUG - Processing node 69ad37c5ed37758c525e1ace: baseline-arm-pengutronix 2026-03-08 09:07:49,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:49,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:49,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c5ed37758c525e1ace/log.txt.gz 2026-03-08 09:07:49,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:50,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:50,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c5ed37758c525e1ace/lava-logs.yaml 2026-03-08 09:07:50,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:50,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:50,191 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad37c5ed37758c525e1ace/lava_callback.json.gz DEBUG: Setup failed for 69ad37c5ed37758c525e1ace. Transitting job node result: incomplete -> fail 2026-03-08 09:07:50,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:50,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37c5ed37758c525e1ace HTTP/1.1" 200 None 2026-03-08 09:07:50,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:50,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:07:50,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:50,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37c5ed37758c525e1ace HTTP/1.1" 200 None 2026-03-08 09:07:50,352 - lava_callback - INFO - Completed processing callback for node 69ad37c5ed37758c525e1ace 2026-03-08 09:07:51,099 - lava_callback - INFO - Received callback for node 69ad3c13ed37758c525e1e91 INFO: 172.21.0.1:33832 - "POST /node/69ad3c13ed37758c525e1e91 HTTP/1.0" 202 Accepted 2026-03-08 09:07:51,105 - lava_callback - INFO - Starting async job submit for node 69ad3c13ed37758c525e1e91 2026-03-08 09:07:51,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:51,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c13ed37758c525e1e91 HTTP/1.1" 200 None 2026-03-08 09:07:51,145 - lava_callback - DEBUG - Processing node 69ad3c13ed37758c525e1e91: baseline-arm64-broonie 2026-03-08 09:07:51,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:51,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:51,499 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c13ed37758c525e1e91/log.txt.gz 2026-03-08 09:07:51,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:51,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:51,824 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c13ed37758c525e1e91/lava-logs.yaml 2026-03-08 09:07:51,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:51,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:51,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c13ed37758c525e1e91/lava_callback.json.gz 2026-03-08 09:07:52,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:52,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c13ed37758c525e1e91 HTTP/1.1" 200 None 2026-03-08 09:07:52,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:52,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:52,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:52,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c13ed37758c525e1e91 HTTP/1.1" 200 None 2026-03-08 09:07:52,100 - lava_callback - INFO - Completed processing callback for node 69ad3c13ed37758c525e1e91 2026-03-08 09:07:52,296 - lava_callback - INFO - Received callback for node 69ad3bf4ed37758c525e1e20 INFO: 172.21.0.1:33842 - "POST /node/69ad3bf4ed37758c525e1e20 HTTP/1.0" 202 Accepted 2026-03-08 09:07:52,306 - lava_callback - INFO - Starting async job submit for node 69ad3bf4ed37758c525e1e20 2026-03-08 09:07:52,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:52,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf4ed37758c525e1e20 HTTP/1.1" 200 None 2026-03-08 09:07:52,349 - lava_callback - DEBUG - Processing node 69ad3bf4ed37758c525e1e20: baseline-arm64 2026-03-08 09:07:52,572 - lava_callback - INFO - Received callback for node 69ad3c1ced37758c525e1ea8 INFO: 172.21.0.1:33858 - "POST /node/69ad3c1ced37758c525e1ea8 HTTP/1.0" 202 Accepted 2026-03-08 09:07:52,594 - lava_callback - INFO - Starting async job submit for node 69ad3c1ced37758c525e1ea8 2026-03-08 09:07:52,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:52,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c1ced37758c525e1ea8 HTTP/1.1" 200 None 2026-03-08 09:07:52,743 - lava_callback - DEBUG - Processing node 69ad3c1ced37758c525e1ea8: baseline-arm64-broonie 2026-03-08 09:07:52,817 - lava_callback - INFO - Received callback for node 69ad3bffed37758c525e1e40 2026-03-08 09:07:52,834 - lava_callback - INFO - Starting async job submit for node 69ad3bffed37758c525e1e40 INFO: 172.21.0.1:33862 - "POST /node/69ad3bffed37758c525e1e40 HTTP/1.0" 202 Accepted 2026-03-08 09:07:52,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:52,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:52,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bffed37758c525e1e40 HTTP/1.1" 200 None 2026-03-08 09:07:53,004 - lava_callback - DEBUG - Processing node 69ad3bffed37758c525e1e40: baseline-nfs-arm64 2026-03-08 09:07:53,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:53,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:53,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf4ed37758c525e1e20/log.txt.gz 2026-03-08 09:07:53,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:53,587 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1ced37758c525e1ea8/log.txt.gz 2026-03-08 09:07:53,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:53,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:54,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:54,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf4ed37758c525e1e20/lava-logs.yaml 2026-03-08 09:07:54,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:54,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:54,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bffed37758c525e1e40/log.txt.gz 2026-03-08 09:07:54,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:54,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1ced37758c525e1ea8/lava-logs.yaml 2026-03-08 09:07:54,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:54,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:54,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf4ed37758c525e1e20/lava_callback.json.gz 2026-03-08 09:07:54,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:54,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:54,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf4ed37758c525e1e20 HTTP/1.1" 200 None 2026-03-08 09:07:54,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:54,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:54,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:54,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bf4ed37758c525e1e20 HTTP/1.1" 200 None 2026-03-08 09:07:54,450 - lava_callback - INFO - Completed processing callback for node 69ad3bf4ed37758c525e1e20 2026-03-08 09:07:54,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:54,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1ced37758c525e1ea8/lava_callback.json.gz 2026-03-08 09:07:54,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:54,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c1ced37758c525e1ea8 HTTP/1.1" 200 None 2026-03-08 09:07:54,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:54,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:54,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:54,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c1ced37758c525e1ea8 HTTP/1.1" 200 None 2026-03-08 09:07:54,639 - lava_callback - INFO - Completed processing callback for node 69ad3c1ced37758c525e1ea8 2026-03-08 09:07:54,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:54,711 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bffed37758c525e1e40/lava-logs.yaml 2026-03-08 09:07:54,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:54,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:54,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bffed37758c525e1e40/lava_callback.json.gz 2026-03-08 09:07:54,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:54,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bffed37758c525e1e40 HTTP/1.1" 200 None 2026-03-08 09:07:54,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:54,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:55,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:55,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bffed37758c525e1e40 HTTP/1.1" 200 None 2026-03-08 09:07:55,036 - lava_callback - INFO - Completed processing callback for node 69ad3bffed37758c525e1e40 INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:07:56,869 - lava_callback - INFO - Received callback for node 69ad3bfced37758c525e1e39 INFO: 172.21.0.1:33876 - "POST /node/69ad3bfced37758c525e1e39 HTTP/1.0" 202 Accepted 2026-03-08 09:07:56,875 - lava_callback - INFO - Starting async job submit for node 69ad3bfced37758c525e1e39 2026-03-08 09:07:56,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:56,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bfced37758c525e1e39 HTTP/1.1" 200 None 2026-03-08 09:07:56,913 - lava_callback - DEBUG - Processing node 69ad3bfced37758c525e1e39: baseline-nfs-arm64 2026-03-08 09:07:57,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:57,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:57,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfced37758c525e1e39/log.txt.gz 2026-03-08 09:07:57,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:57,663 - lava_callback - INFO - Received callback for node 69ad3c02ed37758c525e1e4a INFO: 172.21.0.1:33882 - "POST /node/69ad3c02ed37758c525e1e4a HTTP/1.0" 202 Accepted 2026-03-08 09:07:57,671 - lava_callback - INFO - Starting async job submit for node 69ad3c02ed37758c525e1e4a 2026-03-08 09:07:57,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:57,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c02ed37758c525e1e4a HTTP/1.1" 200 None 2026-03-08 09:07:57,726 - lava_callback - DEBUG - Processing node 69ad3c02ed37758c525e1e4a: baseline-nfs-arm64 2026-03-08 09:07:57,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:57,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfced37758c525e1e39/lava-logs.yaml 2026-03-08 09:07:57,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:58,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:58,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:58,208 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfced37758c525e1e39/lava_callback.json.gz 2026-03-08 09:07:58,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:58,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:58,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c02ed37758c525e1e4a/log.txt.gz 2026-03-08 09:07:58,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bfced37758c525e1e39 HTTP/1.1" 200 None 2026-03-08 09:07:58,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:58,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:58,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:58,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:58,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bfced37758c525e1e39 HTTP/1.1" 200 None 2026-03-08 09:07:58,467 - lava_callback - INFO - Completed processing callback for node 69ad3bfced37758c525e1e39 2026-03-08 09:07:58,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:58,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c02ed37758c525e1e4a/lava-logs.yaml 2026-03-08 09:07:58,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:58,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:58,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c02ed37758c525e1e4a/lava_callback.json.gz 2026-03-08 09:07:58,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:58,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c02ed37758c525e1e4a HTTP/1.1" 200 None 2026-03-08 09:07:58,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:58,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:07:58,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:58,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c02ed37758c525e1e4a HTTP/1.1" 200 None 2026-03-08 09:07:58,913 - lava_callback - INFO - Completed processing callback for node 69ad3c02ed37758c525e1e4a 2026-03-08 09:07:59,373 - lava_callback - INFO - Received callback for node 69ad3c2bed37758c525e1edb INFO: 172.21.0.1:33896 - "POST /node/69ad3c2bed37758c525e1edb HTTP/1.0" 202 Accepted 2026-03-08 09:07:59,380 - lava_callback - INFO - Starting async job submit for node 69ad3c2bed37758c525e1edb 2026-03-08 09:07:59,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:07:59,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c2bed37758c525e1edb HTTP/1.1" 200 None 2026-03-08 09:07:59,423 - lava_callback - DEBUG - Processing node 69ad3c2bed37758c525e1edb: baseline-arm64-pengutronix 2026-03-08 09:07:59,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:07:59,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:07:59,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2bed37758c525e1edb/log.txt.gz 2026-03-08 09:07:59,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:00,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:00,017 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2bed37758c525e1edb/lava-logs.yaml 2026-03-08 09:08:00,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:00,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:00,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2bed37758c525e1edb/lava_callback.json.gz 2026-03-08 09:08:00,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:00,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c2bed37758c525e1edb HTTP/1.1" 200 None 2026-03-08 09:08:00,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:00,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:00,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:00,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c2bed37758c525e1edb HTTP/1.1" 200 None 2026-03-08 09:08:00,246 - lava_callback - INFO - Completed processing callback for node 69ad3c2bed37758c525e1edb 2026-03-08 09:08:01,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:01,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-08 09:08:05,808 - lava_callback - INFO - Received callback for node 69ad3c07ed37758c525e1e58 INFO: 172.21.0.1:40032 - "POST /node/69ad3c07ed37758c525e1e58 HTTP/1.0" 202 Accepted 2026-03-08 09:08:05,814 - lava_callback - INFO - Starting async job submit for node 69ad3c07ed37758c525e1e58 2026-03-08 09:08:05,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:05,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c07ed37758c525e1e58 HTTP/1.1" 200 None 2026-03-08 09:08:05,874 - lava_callback - DEBUG - Processing node 69ad3c07ed37758c525e1e58: baseline-nfs-arm64 2026-03-08 09:08:06,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:06,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:06,372 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c07ed37758c525e1e58/log.txt.gz INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:08:06,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:06,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:06,787 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c07ed37758c525e1e58/lava-logs.yaml 2026-03-08 09:08:06,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:06,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:06,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c07ed37758c525e1e58/lava_callback.json.gz 2026-03-08 09:08:06,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:06,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c07ed37758c525e1e58 HTTP/1.1" 200 None 2026-03-08 09:08:06,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:07,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:07,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:07,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c07ed37758c525e1e58 HTTP/1.1" 200 None 2026-03-08 09:08:07,031 - lava_callback - INFO - Completed processing callback for node 69ad3c07ed37758c525e1e58 2026-03-08 09:08:07,751 - lava_callback - INFO - Received callback for node 69ad3c2ded37758c525e1ede INFO: 172.21.0.1:40040 - "POST /node/69ad3c2ded37758c525e1ede HTTP/1.0" 202 Accepted 2026-03-08 09:08:07,759 - lava_callback - INFO - Starting async job submit for node 69ad3c2ded37758c525e1ede 2026-03-08 09:08:07,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:07,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c2ded37758c525e1ede HTTP/1.1" 200 None 2026-03-08 09:08:07,808 - lava_callback - DEBUG - Processing node 69ad3c2ded37758c525e1ede: baseline-arm64-pengutronix 2026-03-08 09:08:08,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:08,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:08,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2ded37758c525e1ede/log.txt.gz 2026-03-08 09:08:08,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:08,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:08,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2ded37758c525e1ede/lava-logs.yaml 2026-03-08 09:08:08,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:08,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:08,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2ded37758c525e1ede/lava_callback.json.gz 2026-03-08 09:08:08,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:08,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c2ded37758c525e1ede HTTP/1.1" 200 None 2026-03-08 09:08:08,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:08,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:08,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:08,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c2ded37758c525e1ede HTTP/1.1" 200 None 2026-03-08 09:08:08,737 - lava_callback - INFO - Completed processing callback for node 69ad3c2ded37758c525e1ede 2026-03-08 09:08:09,483 - lava_callback - INFO - Received callback for node 69ad3c2eed37758c525e1efe INFO: 172.21.0.1:40052 - "POST /node/69ad3c2eed37758c525e1efe HTTP/1.0" 202 Accepted 2026-03-08 09:08:09,490 - lava_callback - INFO - Starting async job submit for node 69ad3c2eed37758c525e1efe 2026-03-08 09:08:09,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:09,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c2eed37758c525e1efe HTTP/1.1" 200 None 2026-03-08 09:08:09,535 - lava_callback - DEBUG - Processing node 69ad3c2eed37758c525e1efe: baseline-arm64-pengutronix 2026-03-08 09:08:09,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:09,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:09,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2eed37758c525e1efe/log.txt.gz 2026-03-08 09:08:09,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:10,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:10,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2eed37758c525e1efe/lava-logs.yaml 2026-03-08 09:08:10,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:10,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:10,341 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ad3c2eed37758c525e1efe/lava_callback.json.gz 2026-03-08 09:08:10,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:10,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c2eed37758c525e1efe HTTP/1.1" 200 None 2026-03-08 09:08:10,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:10,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:10,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:10,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c2eed37758c525e1efe HTTP/1.1" 200 None 2026-03-08 09:08:10,434 - lava_callback - INFO - Completed processing callback for node 69ad3c2eed37758c525e1efe INFO: 172.21.0.1:41086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:08:17,780 - lava_callback - INFO - Received callback for node 69ad3bfaed37758c525e1e33 INFO: 172.21.0.1:41102 - "POST /node/69ad3bfaed37758c525e1e33 HTTP/1.0" 202 Accepted 2026-03-08 09:08:17,787 - lava_callback - INFO - Starting async job submit for node 69ad3bfaed37758c525e1e33 2026-03-08 09:08:17,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:17,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bfaed37758c525e1e33 HTTP/1.1" 200 None 2026-03-08 09:08:17,826 - lava_callback - DEBUG - Processing node 69ad3bfaed37758c525e1e33: baseline-nfs-arm64 2026-03-08 09:08:18,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:18,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:18,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfaed37758c525e1e33/log.txt.gz 2026-03-08 09:08:18,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:18,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:18,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfaed37758c525e1e33/lava-logs.yaml 2026-03-08 09:08:18,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:18,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:18,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfaed37758c525e1e33/lava_callback.json.gz 2026-03-08 09:08:18,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:18,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bfaed37758c525e1e33 HTTP/1.1" 200 None 2026-03-08 09:08:18,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:18,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:18,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:18,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bfaed37758c525e1e33 HTTP/1.1" 200 None 2026-03-08 09:08:18,879 - lava_callback - INFO - Completed processing callback for node 69ad3bfaed37758c525e1e33 2026-03-08 09:08:19,233 - lava_callback - INFO - Received callback for node 69ad3bf0ed37758c525e1e04 INFO: 172.21.0.1:41108 - "POST /node/69ad3bf0ed37758c525e1e04 HTTP/1.0" 202 Accepted 2026-03-08 09:08:19,242 - lava_callback - INFO - Starting async job submit for node 69ad3bf0ed37758c525e1e04 2026-03-08 09:08:19,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:19,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf0ed37758c525e1e04 HTTP/1.1" 200 None 2026-03-08 09:08:19,291 - lava_callback - DEBUG - Processing node 69ad3bf0ed37758c525e1e04: baseline-arm64 2026-03-08 09:08:19,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:19,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:19,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf0ed37758c525e1e04/log.txt.gz 2026-03-08 09:08:20,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:20,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:20,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf0ed37758c525e1e04/lava-logs.yaml 2026-03-08 09:08:20,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:20,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:20,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf0ed37758c525e1e04/lava_callback.json.gz 2026-03-08 09:08:20,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:20,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf0ed37758c525e1e04 HTTP/1.1" 200 None 2026-03-08 09:08:20,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:20,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:20,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:20,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bf0ed37758c525e1e04 HTTP/1.1" 200 None 2026-03-08 09:08:20,612 - lava_callback - INFO - Completed processing callback for node 69ad3bf0ed37758c525e1e04 INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:08:28,918 - lava_callback - INFO - Received callback for node 69ad3c25ed37758c525e1ec3 INFO: 172.21.0.1:43490 - "POST /node/69ad3c25ed37758c525e1ec3 HTTP/1.0" 202 Accepted 2026-03-08 09:08:28,924 - lava_callback - INFO - Starting async job submit for node 69ad3c25ed37758c525e1ec3 2026-03-08 09:08:28,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:28,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c25ed37758c525e1ec3 HTTP/1.1" 200 None 2026-03-08 09:08:28,966 - lava_callback - DEBUG - Processing node 69ad3c25ed37758c525e1ec3: baseline-arm64-clabbe 2026-03-08 09:08:29,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:29,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:29,298 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c25ed37758c525e1ec3/log.txt.gz 2026-03-08 09:08:29,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:29,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:29,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c25ed37758c525e1ec3/lava-logs.yaml 2026-03-08 09:08:29,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:29,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:29,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c25ed37758c525e1ec3/lava_callback.json.gz 2026-03-08 09:08:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c25ed37758c525e1ec3 HTTP/1.1" 200 None 2026-03-08 09:08:29,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:29,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:29,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:29,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c25ed37758c525e1ec3 HTTP/1.1" 200 None 2026-03-08 09:08:29,831 - lava_callback - INFO - Completed processing callback for node 69ad3c25ed37758c525e1ec3 2026-03-08 09:08:31,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:31,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-08 09:08:33,236 - lava_callback - INFO - Received callback for node 69ad3c03ed37758c525e1e4d INFO: 172.21.0.1:55480 - "POST /node/69ad3c03ed37758c525e1e4d HTTP/1.0" 202 Accepted 2026-03-08 09:08:33,242 - lava_callback - INFO - Starting async job submit for node 69ad3c03ed37758c525e1e4d 2026-03-08 09:08:33,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:33,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c03ed37758c525e1e4d HTTP/1.1" 200 None 2026-03-08 09:08:33,296 - lava_callback - DEBUG - Processing node 69ad3c03ed37758c525e1e4d: baseline-nfs-arm64 2026-03-08 09:08:33,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:33,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:33,852 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c03ed37758c525e1e4d/log.txt.gz 2026-03-08 09:08:34,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:34,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:34,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c03ed37758c525e1e4d/lava-logs.yaml 2026-03-08 09:08:34,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:34,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:34,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c03ed37758c525e1e4d/lava_callback.json.gz 2026-03-08 09:08:34,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:34,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c03ed37758c525e1e4d HTTP/1.1" 200 None 2026-03-08 09:08:34,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:34,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:34,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:34,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c03ed37758c525e1e4d HTTP/1.1" 200 None 2026-03-08 09:08:34,589 - lava_callback - INFO - Completed processing callback for node 69ad3c03ed37758c525e1e4d INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:08:41,246 - lava_callback - INFO - Received callback for node 69ad3c17ed37758c525e1e9f INFO: 172.21.0.1:57532 - "POST /node/69ad3c17ed37758c525e1e9f HTTP/1.0" 202 Accepted 2026-03-08 09:08:41,253 - lava_callback - INFO - Starting async job submit for node 69ad3c17ed37758c525e1e9f 2026-03-08 09:08:41,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:41,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c17ed37758c525e1e9f HTTP/1.1" 200 None 2026-03-08 09:08:41,290 - lava_callback - DEBUG - Processing node 69ad3c17ed37758c525e1e9f: baseline-arm64-broonie 2026-03-08 09:08:41,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:41,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:41,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c17ed37758c525e1e9f/log.txt.gz 2026-03-08 09:08:41,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:42,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:42,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c17ed37758c525e1e9f/lava-logs.yaml 2026-03-08 09:08:42,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:42,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:42,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c17ed37758c525e1e9f/lava_callback.json.gz 2026-03-08 09:08:42,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:42,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c17ed37758c525e1e9f HTTP/1.1" 200 None 2026-03-08 09:08:42,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:42,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:42,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:42,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c17ed37758c525e1e9f HTTP/1.1" 200 None 2026-03-08 09:08:42,284 - lava_callback - INFO - Completed processing callback for node 69ad3c17ed37758c525e1e9f 2026-03-08 09:08:42,634 - lava_callback - INFO - Received callback for node 69ad3c19ed37758c525e1ea2 INFO: 172.21.0.1:57542 - "POST /node/69ad3c19ed37758c525e1ea2 HTTP/1.0" 202 Accepted 2026-03-08 09:08:42,641 - lava_callback - INFO - Starting async job submit for node 69ad3c19ed37758c525e1ea2 2026-03-08 09:08:42,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:42,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c19ed37758c525e1ea2 HTTP/1.1" 200 None 2026-03-08 09:08:42,681 - lava_callback - DEBUG - Processing node 69ad3c19ed37758c525e1ea2: baseline-arm64-broonie 2026-03-08 09:08:42,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:43,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:43,064 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c19ed37758c525e1ea2/log.txt.gz 2026-03-08 09:08:43,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:43,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:43,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c19ed37758c525e1ea2/lava-logs.yaml 2026-03-08 09:08:43,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:43,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:43,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c19ed37758c525e1ea2/lava_callback.json.gz 2026-03-08 09:08:43,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:43,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c19ed37758c525e1ea2 HTTP/1.1" 200 None 2026-03-08 09:08:43,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:43,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:43,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:43,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c19ed37758c525e1ea2 HTTP/1.1" 200 None 2026-03-08 09:08:43,755 - lava_callback - INFO - Completed processing callback for node 69ad3c19ed37758c525e1ea2 2026-03-08 09:08:44,127 - lava_callback - INFO - Received callback for node 69ad3c1fed37758c525e1eb0 INFO: 172.21.0.1:57548 - "POST /node/69ad3c1fed37758c525e1eb0 HTTP/1.0" 202 Accepted 2026-03-08 09:08:44,133 - lava_callback - INFO - Starting async job submit for node 69ad3c1fed37758c525e1eb0 2026-03-08 09:08:44,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:44,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c1fed37758c525e1eb0 HTTP/1.1" 200 None 2026-03-08 09:08:44,170 - lava_callback - DEBUG - Processing node 69ad3c1fed37758c525e1eb0: baseline-arm64-broonie 2026-03-08 09:08:44,261 - lava_callback - INFO - Received callback for node 69ad3c24ed37758c525e1eba INFO: 172.21.0.1:57556 - "POST /node/69ad3c24ed37758c525e1eba HTTP/1.0" 202 Accepted 2026-03-08 09:08:44,298 - lava_callback - INFO - Starting async job submit for node 69ad3c24ed37758c525e1eba 2026-03-08 09:08:44,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:44,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c24ed37758c525e1eba HTTP/1.1" 200 None 2026-03-08 09:08:44,445 - lava_callback - DEBUG - Processing node 69ad3c24ed37758c525e1eba: baseline-arm64-clabbe 2026-03-08 09:08:44,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:44,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:44,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1fed37758c525e1eb0/log.txt.gz 2026-03-08 09:08:44,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:44,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:45,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:45,055 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c24ed37758c525e1eba/log.txt.gz 2026-03-08 09:08:45,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:45,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1fed37758c525e1eb0/lava-logs.yaml 2026-03-08 09:08:45,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:45,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:45,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:45,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1fed37758c525e1eb0/lava_callback.json.gz 2026-03-08 09:08:45,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:45,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c1fed37758c525e1eb0 HTTP/1.1" 200 None 2026-03-08 09:08:45,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:45,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:45,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:45,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:45,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c24ed37758c525e1eba/lava-logs.yaml 2026-03-08 09:08:45,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:08:45,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c1fed37758c525e1eb0 HTTP/1.1" 200 None 2026-03-08 09:08:45,542 - lava_callback - INFO - Completed processing callback for node 69ad3c1fed37758c525e1eb0 2026-03-08 09:08:45,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:08:45,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c24ed37758c525e1eba/lava_callback.json.gz 2026-03-08 09:08:45,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:45,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c24ed37758c525e1eba HTTP/1.1" 200 None 2026-03-08 09:08:45,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:45,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:08:45,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:08:45,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c24ed37758c525e1eba HTTP/1.1" 200 None 2026-03-08 09:08:45,852 - lava_callback - INFO - Completed processing callback for node 69ad3c24ed37758c525e1eba INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:09:01,248 - lava_callback - INFO - Received callback for node 69ad3c21ed37758c525e1eb3 INFO: 172.21.0.1:58022 - "POST /node/69ad3c21ed37758c525e1eb3 HTTP/1.0" 202 Accepted 2026-03-08 09:09:01,254 - lava_callback - INFO - Starting async job submit for node 69ad3c21ed37758c525e1eb3 2026-03-08 09:09:01,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:01,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c21ed37758c525e1eb3 HTTP/1.1" 200 None 2026-03-08 09:09:01,296 - lava_callback - DEBUG - Processing node 69ad3c21ed37758c525e1eb3: baseline-arm64-broonie 2026-03-08 09:09:01,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:01,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:01,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c21ed37758c525e1eb3/log.txt.gz 2026-03-08 09:09:01,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:01,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-08 09:09:01,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:02,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:02,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c21ed37758c525e1eb3/lava-logs.yaml 2026-03-08 09:09:02,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:02,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:02,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c21ed37758c525e1eb3/lava_callback.json.gz 2026-03-08 09:09:02,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:02,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c21ed37758c525e1eb3 HTTP/1.1" 200 None 2026-03-08 09:09:02,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:02,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:09:02,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:02,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c21ed37758c525e1eb3 HTTP/1.1" 200 None 2026-03-08 09:09:02,338 - lava_callback - INFO - Completed processing callback for node 69ad3c21ed37758c525e1eb3 INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:09:11,150 - lava_callback - INFO - Received callback for node 69ad3c15ed37758c525e1e95 INFO: 172.21.0.1:56976 - "POST /node/69ad3c15ed37758c525e1e95 HTTP/1.0" 202 Accepted 2026-03-08 09:09:11,156 - lava_callback - INFO - Starting async job submit for node 69ad3c15ed37758c525e1e95 2026-03-08 09:09:11,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:11,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c15ed37758c525e1e95 HTTP/1.1" 200 None 2026-03-08 09:09:11,199 - lava_callback - DEBUG - Processing node 69ad3c15ed37758c525e1e95: baseline-arm64-broonie 2026-03-08 09:09:11,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:11,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:11,574 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c15ed37758c525e1e95/log.txt.gz 2026-03-08 09:09:11,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:11,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:11,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c15ed37758c525e1e95/lava-logs.yaml 2026-03-08 09:09:11,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:12,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:12,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c15ed37758c525e1e95/lava_callback.json.gz 2026-03-08 09:09:12,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:12,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c15ed37758c525e1e95 HTTP/1.1" 200 None 2026-03-08 09:09:12,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:12,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:09:12,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:12,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c15ed37758c525e1e95 HTTP/1.1" 200 None 2026-03-08 09:09:12,160 - lava_callback - INFO - Completed processing callback for node 69ad3c15ed37758c525e1e95 INFO: 172.21.0.1:56982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:09:31,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:31,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:09:41,343 - lava_callback - INFO - Received callback for node 69ad3c1ded37758c525e1ead INFO: 172.21.0.1:59984 - "POST /node/69ad3c1ded37758c525e1ead HTTP/1.0" 202 Accepted 2026-03-08 09:09:41,349 - lava_callback - INFO - Starting async job submit for node 69ad3c1ded37758c525e1ead 2026-03-08 09:09:41,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:41,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c1ded37758c525e1ead HTTP/1.1" 200 None 2026-03-08 09:09:41,387 - lava_callback - DEBUG - Processing node 69ad3c1ded37758c525e1ead: baseline-arm64-broonie 2026-03-08 09:09:41,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:41,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:41,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1ded37758c525e1ead/log.txt.gz 2026-03-08 09:09:42,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:42,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:42,371 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1ded37758c525e1ead/lava-logs.yaml 2026-03-08 09:09:42,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:42,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:42,522 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1ded37758c525e1ead/lava_callback.json.gz 2026-03-08 09:09:42,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:42,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c1ded37758c525e1ead HTTP/1.1" 200 None 2026-03-08 09:09:42,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:42,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:09:42,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:42,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c1ded37758c525e1ead HTTP/1.1" 200 None 2026-03-08 09:09:42,605 - lava_callback - INFO - Completed processing callback for node 69ad3c1ded37758c525e1ead INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:09:47,428 - lava_callback - INFO - Received callback for node 69ad3c29ed37758c525e1ed0 INFO: 172.21.0.1:59998 - "POST /node/69ad3c29ed37758c525e1ed0 HTTP/1.0" 202 Accepted 2026-03-08 09:09:47,434 - lava_callback - INFO - Starting async job submit for node 69ad3c29ed37758c525e1ed0 2026-03-08 09:09:47,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:47,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c29ed37758c525e1ed0 HTTP/1.1" 200 None 2026-03-08 09:09:47,469 - lava_callback - DEBUG - Processing node 69ad3c29ed37758c525e1ed0: baseline-arm64-clabbe 2026-03-08 09:09:47,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:47,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:47,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c29ed37758c525e1ed0/log.txt.gz 2026-03-08 09:09:47,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:48,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:48,150 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c29ed37758c525e1ed0/lava-logs.yaml 2026-03-08 09:09:48,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:48,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:48,301 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c29ed37758c525e1ed0/lava_callback.json.gz 2026-03-08 09:09:48,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:48,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c29ed37758c525e1ed0 HTTP/1.1" 200 None 2026-03-08 09:09:48,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:48,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:09:48,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:48,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c29ed37758c525e1ed0 HTTP/1.1" 200 None 2026-03-08 09:09:48,421 - lava_callback - INFO - Completed processing callback for node 69ad3c29ed37758c525e1ed0 2026-03-08 09:09:51,305 - lava_callback - INFO - Received callback for node 69ad37e1ed37758c525e1b0d INFO: 172.21.0.1:50046 - "POST /node/69ad37e1ed37758c525e1b0d HTTP/1.0" 202 Accepted 2026-03-08 09:09:51,311 - lava_callback - INFO - Starting async job submit for node 69ad37e1ed37758c525e1b0d 2026-03-08 09:09:51,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:51,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e1ed37758c525e1b0d HTTP/1.1" 200 None 2026-03-08 09:09:51,351 - lava_callback - DEBUG - Processing node 69ad37e1ed37758c525e1b0d: ltp-fs_bind 2026-03-08 09:09:51,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:51,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:51,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ad37e1ed37758c525e1b0d/log.txt.gz 2026-03-08 09:09:52,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:52,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:52,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ad37e1ed37758c525e1b0d/lava-logs.yaml 2026-03-08 09:09:52,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:09:52,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:09:52,463 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ad37e1ed37758c525e1b0d/lava_callback.json.gz 2026-03-08 09:09:52,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:52,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e1ed37758c525e1b0d HTTP/1.1" 200 None 2026-03-08 09:09:52,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:52,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:09:52,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:09:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37e1ed37758c525e1b0d HTTP/1.1" 200 None 2026-03-08 09:09:52,573 - lava_callback - INFO - Completed processing callback for node 69ad37e1ed37758c525e1b0d INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:10:01,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:01,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:10:10,461 - lava_callback - INFO - Received callback for node 69ad3c26ed37758c525e1ec7 INFO: 172.21.0.1:45900 - "POST /node/69ad3c26ed37758c525e1ec7 HTTP/1.0" 202 Accepted 2026-03-08 09:10:10,467 - lava_callback - INFO - Starting async job submit for node 69ad3c26ed37758c525e1ec7 2026-03-08 09:10:10,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:10,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c26ed37758c525e1ec7 HTTP/1.1" 200 None 2026-03-08 09:10:10,506 - lava_callback - DEBUG - Processing node 69ad3c26ed37758c525e1ec7: baseline-arm64-clabbe 2026-03-08 09:10:10,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:10,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:10,935 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c26ed37758c525e1ec7/log.txt.gz 2026-03-08 09:10:11,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:11,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:11,324 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c26ed37758c525e1ec7/lava-logs.yaml 2026-03-08 09:10:11,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:11,400 - lava_callback - INFO - Received callback for node 69ad3c1aed37758c525e1ea5 INFO: 172.21.0.1:45908 - "POST /node/69ad3c1aed37758c525e1ea5 HTTP/1.0" 202 Accepted 2026-03-08 09:10:11,406 - lava_callback - INFO - Starting async job submit for node 69ad3c1aed37758c525e1ea5 2026-03-08 09:10:11,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:11,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c1aed37758c525e1ea5 HTTP/1.1" 200 None 2026-03-08 09:10:11,454 - lava_callback - DEBUG - Processing node 69ad3c1aed37758c525e1ea5: baseline-arm64-broonie 2026-03-08 09:10:11,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:11,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c26ed37758c525e1ec7/lava_callback.json.gz 2026-03-08 09:10:11,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:11,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c26ed37758c525e1ec7 HTTP/1.1" 200 None 2026-03-08 09:10:11,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:11,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:11,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:10:11,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:11,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c26ed37758c525e1ec7 HTTP/1.1" 200 None 2026-03-08 09:10:11,791 - lava_callback - INFO - Completed processing callback for node 69ad3c26ed37758c525e1ec7 2026-03-08 09:10:11,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:11,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1aed37758c525e1ea5/log.txt.gz 2026-03-08 09:10:12,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:12,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:12,347 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1aed37758c525e1ea5/lava-logs.yaml 2026-03-08 09:10:12,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:12,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:12,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c1aed37758c525e1ea5/lava_callback.json.gz 2026-03-08 09:10:12,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:12,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c1aed37758c525e1ea5 HTTP/1.1" 200 None 2026-03-08 09:10:12,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:12,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:10:12,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:12,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c1aed37758c525e1ea5 HTTP/1.1" 200 None 2026-03-08 09:10:12,643 - lava_callback - INFO - Completed processing callback for node 69ad3c1aed37758c525e1ea5 INFO: 172.21.0.1:45916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:10:19,038 - lava_callback - INFO - Received callback for node 69ad3beced37758c525e1df3 INFO: 172.21.0.1:45930 - "POST /node/69ad3beced37758c525e1df3 HTTP/1.0" 202 Accepted 2026-03-08 09:10:19,044 - lava_callback - INFO - Starting async job submit for node 69ad3beced37758c525e1df3 2026-03-08 09:10:19,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:19,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3beced37758c525e1df3 HTTP/1.1" 200 None 2026-03-08 09:10:19,080 - lava_callback - DEBUG - Processing node 69ad3beced37758c525e1df3: baseline-arm64 2026-03-08 09:10:19,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:19,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:19,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beced37758c525e1df3/log.txt.gz 2026-03-08 09:10:19,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:19,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:19,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beced37758c525e1df3/lava-logs.yaml 2026-03-08 09:10:19,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:20,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:20,119 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3beced37758c525e1df3/lava_callback.json.gz 2026-03-08 09:10:20,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:20,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3beced37758c525e1df3 HTTP/1.1" 200 None 2026-03-08 09:10:20,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:20,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:10:20,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:20,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3beced37758c525e1df3 HTTP/1.1" 200 None 2026-03-08 09:10:20,195 - lava_callback - INFO - Completed processing callback for node 69ad3beced37758c525e1df3 INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:10:31,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:31,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-08 09:10:32,327 - lava_callback - INFO - Received callback for node 69ad3bfbed37758c525e1e36 INFO: 172.21.0.1:59840 - "POST /node/69ad3bfbed37758c525e1e36 HTTP/1.0" 202 Accepted 2026-03-08 09:10:32,333 - lava_callback - INFO - Starting async job submit for node 69ad3bfbed37758c525e1e36 2026-03-08 09:10:32,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:32,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bfbed37758c525e1e36 HTTP/1.1" 200 None 2026-03-08 09:10:32,373 - lava_callback - DEBUG - Processing node 69ad3bfbed37758c525e1e36: baseline-nfs-arm64 2026-03-08 09:10:32,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:32,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:32,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfbed37758c525e1e36/log.txt.gz 2026-03-08 09:10:33,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:33,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:33,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfbed37758c525e1e36/lava-logs.yaml 2026-03-08 09:10:33,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:10:33,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:10:33,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfbed37758c525e1e36/lava_callback.json.gz 2026-03-08 09:10:33,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:33,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bfbed37758c525e1e36 HTTP/1.1" 200 None 2026-03-08 09:10:33,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:33,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:10:33,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:33,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bfbed37758c525e1e36 HTTP/1.1" 200 None 2026-03-08 09:10:33,689 - lava_callback - INFO - Completed processing callback for node 69ad3bfbed37758c525e1e36 INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:10:59,629 - lava_callback - INFO - Received callback for node 69aa9a0f76ddd5d9e606df74 INFO: 172.21.0.1:57476 - "POST /node/69aa9a0f76ddd5d9e606df74 HTTP/1.0" 202 Accepted 2026-03-08 09:10:59,636 - lava_callback - INFO - Starting async job submit for node 69aa9a0f76ddd5d9e606df74 2026-03-08 09:10:59,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:59,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a0f76ddd5d9e606df74 HTTP/1.1" 200 None 2026-03-08 09:10:59,658 - lava_callback - DEBUG - Processing node 69aa9a0f76ddd5d9e606df74: baseline-arm-baylibre 2026-03-08 09:10:59,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa9a0f76ddd5d9e606df74 2026-03-08 09:10:59,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:59,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a0f76ddd5d9e606df74 HTTP/1.1" 200 None 2026-03-08 09:10:59,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:59,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 09:10:59,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:10:59,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa9a0f76ddd5d9e606df74 HTTP/1.1" 200 None 2026-03-08 09:10:59,715 - lava_callback - ERROR - Error processing callback for node 69aa9a0f76ddd5d9e606df74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 09:11:01,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:01,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:11:19,475 - lava_callback - INFO - Received callback for node 69aa9a3276ddd5d9e606df83 INFO: 172.21.0.1:51696 - "POST /node/69aa9a3276ddd5d9e606df83 HTTP/1.0" 202 Accepted 2026-03-08 09:11:19,480 - lava_callback - INFO - Starting async job submit for node 69aa9a3276ddd5d9e606df83 2026-03-08 09:11:19,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:19,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a3276ddd5d9e606df83 HTTP/1.1" 200 None 2026-03-08 09:11:19,496 - lava_callback - DEBUG - Processing node 69aa9a3276ddd5d9e606df83: baseline-arm-baylibre 2026-03-08 09:11:19,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa9a3276ddd5d9e606df83 2026-03-08 09:11:19,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:19,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a3276ddd5d9e606df83 HTTP/1.1" 200 None 2026-03-08 09:11:19,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:19,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 09:11:19,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:19,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa9a3276ddd5d9e606df83 HTTP/1.1" 200 None 2026-03-08 09:11:19,563 - lava_callback - ERROR - Error processing callback for node 69aa9a3276ddd5d9e606df83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47878 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:11:34,864 - lava_callback - INFO - Received callback for node 69ad3d3aed37758c525e2076 INFO: 172.21.0.1:33038 - "POST /node/69ad3d3aed37758c525e2076 HTTP/1.0" 202 Accepted 2026-03-08 09:11:34,870 - lava_callback - INFO - Starting async job submit for node 69ad3d3aed37758c525e2076 2026-03-08 09:11:34,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:34,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3d3aed37758c525e2076 HTTP/1.1" 200 None 2026-03-08 09:11:34,894 - lava_callback - DEBUG - Processing node 69ad3d3aed37758c525e2076: baseline-arm 2026-03-08 09:11:34,901 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:11:34,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:11:35,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:11:35,141 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad3d3aed37758c525e2076/lava-logs.yaml 2026-03-08 09:11:35,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:11:35,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:11:35,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad3d3aed37758c525e2076/lava_callback.json.gz 2026-03-08 09:11:35,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:35,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3d3aed37758c525e2076 HTTP/1.1" 200 None 2026-03-08 09:11:35,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:35,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:11:35,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:35,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3d3aed37758c525e2076 HTTP/1.1" 200 None 2026-03-08 09:11:35,368 - lava_callback - INFO - Completed processing callback for node 69ad3d3aed37758c525e2076 INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:11:59,574 - lava_callback - INFO - Received callback for node 69aa9a5376ddd5d9e606df94 INFO: 172.21.0.1:51818 - "POST /node/69aa9a5376ddd5d9e606df94 HTTP/1.0" 202 Accepted 2026-03-08 09:11:59,579 - lava_callback - INFO - Starting async job submit for node 69aa9a5376ddd5d9e606df94 2026-03-08 09:11:59,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:59,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a5376ddd5d9e606df94 HTTP/1.1" 200 None 2026-03-08 09:11:59,598 - lava_callback - DEBUG - Processing node 69aa9a5376ddd5d9e606df94: baseline-arm-baylibre 2026-03-08 09:11:59,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa9a5376ddd5d9e606df94 2026-03-08 09:11:59,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:59,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a5376ddd5d9e606df94 HTTP/1.1" 200 None 2026-03-08 09:11:59,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:59,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 09:11:59,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:11:59,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa9a5376ddd5d9e606df94 HTTP/1.1" 200 None 2026-03-08 09:11:59,673 - lava_callback - ERROR - Error processing callback for node 69aa9a5376ddd5d9e606df94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 09:12:01,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:01,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:12:39,683 - lava_callback - INFO - Received callback for node 69aa9a7576ddd5d9e606dfaa INFO: 172.21.0.1:46588 - "POST /node/69aa9a7576ddd5d9e606dfaa HTTP/1.0" 202 Accepted 2026-03-08 09:12:39,688 - lava_callback - INFO - Starting async job submit for node 69aa9a7576ddd5d9e606dfaa 2026-03-08 09:12:39,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:39,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a7576ddd5d9e606dfaa HTTP/1.1" 200 None 2026-03-08 09:12:39,704 - lava_callback - DEBUG - Processing node 69aa9a7576ddd5d9e606dfaa: baseline-arm-baylibre 2026-03-08 09:12:39,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa9a7576ddd5d9e606dfaa 2026-03-08 09:12:39,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:39,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a7576ddd5d9e606dfaa HTTP/1.1" 200 None 2026-03-08 09:12:39,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:39,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 09:12:39,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:39,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa9a7576ddd5d9e606dfaa HTTP/1.1" 200 None 2026-03-08 09:12:39,766 - lava_callback - ERROR - Error processing callback for node 69aa9a7576ddd5d9e606dfaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60702 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:12:59,602 - lava_callback - INFO - Received callback for node 69aa9a9776ddd5d9e606dfc5 INFO: 172.21.0.1:60704 - "POST /node/69aa9a9776ddd5d9e606dfc5 HTTP/1.0" 202 Accepted 2026-03-08 09:12:59,607 - lava_callback - INFO - Starting async job submit for node 69aa9a9776ddd5d9e606dfc5 2026-03-08 09:12:59,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:59,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a9776ddd5d9e606dfc5 HTTP/1.1" 200 None 2026-03-08 09:12:59,624 - lava_callback - DEBUG - Processing node 69aa9a9776ddd5d9e606dfc5: baseline-arm-baylibre 2026-03-08 09:12:59,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa9a9776ddd5d9e606dfc5 2026-03-08 09:12:59,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:59,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9a9776ddd5d9e606dfc5 HTTP/1.1" 200 None 2026-03-08 09:12:59,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:59,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 09:12:59,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:12:59,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa9a9776ddd5d9e606dfc5 HTTP/1.1" 200 None 2026-03-08 09:12:59,679 - lava_callback - ERROR - Error processing callback for node 69aa9a9776ddd5d9e606dfc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:13:39,615 - lava_callback - INFO - Received callback for node 69aa9ab876ddd5d9e606dfd8 INFO: 172.21.0.1:41736 - "POST /node/69aa9ab876ddd5d9e606dfd8 HTTP/1.0" 202 Accepted 2026-03-08 09:13:39,620 - lava_callback - INFO - Starting async job submit for node 69aa9ab876ddd5d9e606dfd8 2026-03-08 09:13:39,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:13:39,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9ab876ddd5d9e606dfd8 HTTP/1.1" 200 None 2026-03-08 09:13:39,636 - lava_callback - DEBUG - Processing node 69aa9ab876ddd5d9e606dfd8: baseline-arm-baylibre 2026-03-08 09:13:39,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aa9ab876ddd5d9e606dfd8 2026-03-08 09:13:39,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:13:39,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa9ab876ddd5d9e606dfd8 HTTP/1.1" 200 None 2026-03-08 09:13:39,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:13:39,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 09:13:39,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:13:39,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa9ab876ddd5d9e606dfd8 HTTP/1.1" 200 None 2026-03-08 09:13:39,686 - lava_callback - ERROR - Error processing callback for node 69aa9ab876ddd5d9e606dfd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:13:51,538 - lava_callback - INFO - Received callback for node 69ad37e2ed37758c525e1b10 INFO: 172.21.0.1:51680 - "POST /node/69ad37e2ed37758c525e1b10 HTTP/1.0" 202 Accepted 2026-03-08 09:13:51,544 - lava_callback - INFO - Starting async job submit for node 69ad37e2ed37758c525e1b10 2026-03-08 09:13:51,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:13:51,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e2ed37758c525e1b10 HTTP/1.1" 200 None 2026-03-08 09:13:51,583 - lava_callback - DEBUG - Processing node 69ad37e2ed37758c525e1b10: ltp-fsx 2026-03-08 09:13:51,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:13:52,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:13:52,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69ad37e2ed37758c525e1b10/log.txt.gz 2026-03-08 09:13:52,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:13:52,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:13:52,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69ad37e2ed37758c525e1b10/lava-logs.yaml 2026-03-08 09:13:52,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:13:52,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:13:52,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69ad37e2ed37758c525e1b10/lava_callback.json.gz 2026-03-08 09:13:52,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:13:52,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e2ed37758c525e1b10 HTTP/1.1" 200 None 2026-03-08 09:13:52,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:13:52,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:13:52,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:13:52,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37e2ed37758c525e1b10 HTTP/1.1" 200 None 2026-03-08 09:13:52,829 - lava_callback - INFO - Completed processing callback for node 69ad37e2ed37758c525e1b10 INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:14:01,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:14:01,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50588 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:14:18,735 - lava_callback - INFO - Received callback for node 69ad3c05ed37758c525e1e51 INFO: 172.21.0.1:50600 - "POST /node/69ad3c05ed37758c525e1e51 HTTP/1.0" 202 Accepted 2026-03-08 09:14:18,741 - lava_callback - INFO - Starting async job submit for node 69ad3c05ed37758c525e1e51 2026-03-08 09:14:18,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:14:18,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c05ed37758c525e1e51 HTTP/1.1" 200 None 2026-03-08 09:14:18,783 - lava_callback - DEBUG - Processing node 69ad3c05ed37758c525e1e51: baseline-nfs-arm64 2026-03-08 09:14:19,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:14:19,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:14:19,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c05ed37758c525e1e51/log.txt.gz 2026-03-08 09:14:19,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:14:19,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:14:19,779 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c05ed37758c525e1e51/lava-logs.yaml 2026-03-08 09:14:19,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:14:19,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:14:19,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c05ed37758c525e1e51/lava_callback.json.gz 2026-03-08 09:14:19,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:14:19,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c05ed37758c525e1e51 HTTP/1.1" 200 None 2026-03-08 09:14:19,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:14:19,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:14:19,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:14:20,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c05ed37758c525e1e51 HTTP/1.1" 200 None 2026-03-08 09:14:20,052 - lava_callback - INFO - Completed processing callback for node 69ad3c05ed37758c525e1e51 INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:14:31,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:14:31,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:15:20,402 - lava_callback - INFO - Received callback for node 69ad3c27ed37758c525e1eca INFO: 172.21.0.1:35844 - "POST /node/69ad3c27ed37758c525e1eca HTTP/1.0" 202 Accepted 2026-03-08 09:15:20,409 - lava_callback - INFO - Starting async job submit for node 69ad3c27ed37758c525e1eca 2026-03-08 09:15:20,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:15:20,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c27ed37758c525e1eca HTTP/1.1" 200 None 2026-03-08 09:15:20,455 - lava_callback - DEBUG - Processing node 69ad3c27ed37758c525e1eca: baseline-arm64-clabbe 2026-03-08 09:15:20,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:15:21,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:15:21,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c27ed37758c525e1eca/log.txt.gz 2026-03-08 09:15:21,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:15:21,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:15:21,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c27ed37758c525e1eca/lava-logs.yaml 2026-03-08 09:15:21,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:15:21,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:15:21,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ad3c27ed37758c525e1eca/lava_callback.json.gz 2026-03-08 09:15:21,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:15:21,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c27ed37758c525e1eca HTTP/1.1" 200 None 2026-03-08 09:15:21,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:15:21,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:15:21,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:15:21,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c27ed37758c525e1eca HTTP/1.1" 200 None 2026-03-08 09:15:21,858 - lava_callback - INFO - Completed processing callback for node 69ad3c27ed37758c525e1eca INFO: 172.21.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:15:31,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:15:32,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:17:40,892 - lava_callback - INFO - Received callback for node 69ad3e51ed37758c525e211c INFO: 172.21.0.1:59350 - "POST /node/69ad3e51ed37758c525e211c HTTP/1.0" 202 Accepted 2026-03-08 09:17:40,898 - lava_callback - INFO - Starting async job submit for node 69ad3e51ed37758c525e211c 2026-03-08 09:17:40,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:17:40,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3e51ed37758c525e211c HTTP/1.1" 200 None 2026-03-08 09:17:40,932 - lava_callback - DEBUG - Processing node 69ad3e51ed37758c525e211c: baseline-x86 2026-03-08 09:17:41,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:17:41,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:17:41,328 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3e51ed37758c525e211c/log.txt.gz 2026-03-08 09:17:41,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:17:41,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:17:41,684 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3e51ed37758c525e211c/lava-logs.yaml 2026-03-08 09:17:41,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:17:41,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:17:41,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ad3e51ed37758c525e211c/lava_callback.json.gz 2026-03-08 09:17:41,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:17:41,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3e51ed37758c525e211c HTTP/1.1" 200 None 2026-03-08 09:17:41,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:17:41,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30dded37758c525e1606 HTTP/1.1" 200 None 2026-03-08 09:17:41,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:17:41,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3e51ed37758c525e211c HTTP/1.1" 200 None 2026-03-08 09:17:41,957 - lava_callback - INFO - Completed processing callback for node 69ad3e51ed37758c525e211c INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:17:51,877 - lava_callback - INFO - Received callback for node 69ad37e4ed37758c525e1b13 INFO: 172.21.0.1:50376 - "POST /node/69ad37e4ed37758c525e1b13 HTTP/1.0" 202 Accepted 2026-03-08 09:17:51,884 - lava_callback - INFO - Starting async job submit for node 69ad37e4ed37758c525e1b13 2026-03-08 09:17:51,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:17:51,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e4ed37758c525e1b13 HTTP/1.1" 200 None 2026-03-08 09:17:51,928 - lava_callback - DEBUG - Processing node 69ad37e4ed37758c525e1b13: ltp-input 2026-03-08 09:17:52,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:17:52,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:17:52,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69ad37e4ed37758c525e1b13/log.txt.gz 2026-03-08 09:17:52,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:17:52,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:17:52,878 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69ad37e4ed37758c525e1b13/lava-logs.yaml 2026-03-08 09:17:52,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:17:53,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:17:53,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69ad37e4ed37758c525e1b13/lava_callback.json.gz 2026-03-08 09:17:53,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:17:53,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e4ed37758c525e1b13 HTTP/1.1" 200 None 2026-03-08 09:17:53,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:17:53,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:17:53,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:17:53,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37e4ed37758c525e1b13 HTTP/1.1" 200 None 2026-03-08 09:17:53,150 - lava_callback - INFO - Completed processing callback for node 69ad37e4ed37758c525e1b13 INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:18:02,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:18:02,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37118 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:21:37,686 - lava_callback - INFO - Received callback for node 69ad3f88ed37758c525e21a9 INFO: 172.21.0.1:37132 - "POST /node/69ad3f88ed37758c525e21a9 HTTP/1.0" 202 Accepted 2026-03-08 09:21:37,691 - lava_callback - INFO - Starting async job submit for node 69ad3f88ed37758c525e21a9 2026-03-08 09:21:37,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:21:37,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3f88ed37758c525e21a9 HTTP/1.1" 200 None 2026-03-08 09:21:37,709 - lava_callback - DEBUG - Processing node 69ad3f88ed37758c525e21a9: baseline-nfs-arm64 2026-03-08 09:21:37,710 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:21:37,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:21:37,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:21:37,867 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3f88ed37758c525e21a9/lava-logs.yaml 2026-03-08 09:21:37,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:21:37,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:21:37,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3f88ed37758c525e21a9/lava_callback.json.gz 2026-03-08 09:21:37,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:21:38,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3f88ed37758c525e21a9 HTTP/1.1" 200 None 2026-03-08 09:21:38,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:21:38,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:21:38,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:21:38,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3f88ed37758c525e21a9 HTTP/1.1" 200 None 2026-03-08 09:21:38,060 - lava_callback - INFO - Completed processing callback for node 69ad3f88ed37758c525e21a9 INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:21:51,887 - lava_callback - INFO - Received callback for node 69ad37e6ed37758c525e1b1a INFO: 172.21.0.1:36298 - "POST /node/69ad37e6ed37758c525e1b1a HTTP/1.0" 202 Accepted 2026-03-08 09:21:51,894 - lava_callback - INFO - Starting async job submit for node 69ad37e6ed37758c525e1b1a 2026-03-08 09:21:51,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:21:51,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e6ed37758c525e1b1a HTTP/1.1" 200 None 2026-03-08 09:21:51,959 - lava_callback - DEBUG - Processing node 69ad37e6ed37758c525e1b1a: ltp-ipc 2026-03-08 09:21:52,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:21:52,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:21:52,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ad37e6ed37758c525e1b1a/log.txt.gz 2026-03-08 09:21:52,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:21:52,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:21:52,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ad37e6ed37758c525e1b1a/lava-logs.yaml 2026-03-08 09:21:52,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:21:53,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:21:53,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ad37e6ed37758c525e1b1a/lava_callback.json.gz 2026-03-08 09:21:53,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:21:53,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e6ed37758c525e1b1a HTTP/1.1" 200 None 2026-03-08 09:21:53,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:21:53,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:21:53,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:21:53,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37e6ed37758c525e1b1a HTTP/1.1" 200 None 2026-03-08 09:21:53,278 - lava_callback - INFO - Completed processing callback for node 69ad37e6ed37758c525e1b1a INFO: 172.21.0.1:36312 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:22:02,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:22:02,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36430 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:23:03,326 - lava_callback - INFO - Received callback for node 69ad3fcced37758c525e21d8 INFO: 172.21.0.1:55274 - "POST /node/69ad3fcced37758c525e21d8 HTTP/1.0" 202 Accepted 2026-03-08 09:23:03,333 - lava_callback - INFO - Starting async job submit for node 69ad3fcced37758c525e21d8 2026-03-08 09:23:03,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:23:03,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3fcced37758c525e21d8 HTTP/1.1" 200 None 2026-03-08 09:23:03,376 - lava_callback - DEBUG - Processing node 69ad3fcced37758c525e21d8: baseline-arm64 2026-03-08 09:23:03,511 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:23:03,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:23:03,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:23:03,801 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3fcced37758c525e21d8/lava-logs.yaml 2026-03-08 09:23:03,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:23:03,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:23:03,950 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3fcced37758c525e21d8/lava_callback.json.gz 2026-03-08 09:23:03,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:23:03,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3fcced37758c525e21d8 HTTP/1.1" 200 None 2026-03-08 09:23:03,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:23:04,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:23:04,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:23:04,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3fcced37758c525e21d8 HTTP/1.1" 200 None 2026-03-08 09:23:04,105 - lava_callback - INFO - Completed processing callback for node 69ad3fcced37758c525e21d8 INFO: 172.21.0.1:55278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:23:32,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:23:32,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:24:11,911 - lava_callback - INFO - Received callback for node 69ad3c15ed37758c525e1e97 INFO: 172.21.0.1:41578 - "POST /node/69ad3c15ed37758c525e1e97 HTTP/1.0" 202 Accepted 2026-03-08 09:24:11,922 - lava_callback - INFO - Starting async job submit for node 69ad3c15ed37758c525e1e97 2026-03-08 09:24:12,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:12,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c15ed37758c525e1e97 HTTP/1.1" 200 None 2026-03-08 09:24:12,035 - lava_callback - DEBUG - Processing node 69ad3c15ed37758c525e1e97: ltp-smoke 2026-03-08 09:24:12,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:24:12,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:24:12,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad3c15ed37758c525e1e97/log.txt.gz 2026-03-08 09:24:13,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:24:13,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:24:13,335 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad3c15ed37758c525e1e97/lava-logs.yaml 2026-03-08 09:24:13,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:24:13,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:24:13,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad3c15ed37758c525e1e97/lava_callback.json.gz 2026-03-08 09:24:13,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:13,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c15ed37758c525e1e97 HTTP/1.1" 200 None 2026-03-08 09:24:13,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:13,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c1ed37758c525e15d9 HTTP/1.1" 200 None 2026-03-08 09:24:13,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:13,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c15ed37758c525e1e97 HTTP/1.1" 200 None 2026-03-08 09:24:13,940 - lava_callback - INFO - Completed processing callback for node 69ad3c15ed37758c525e1e97 INFO: 172.21.0.1:41588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:24:23,124 - lava_callback - INFO - Received callback for node 69ad4015ed37758c525e21f6 INFO: 172.21.0.1:42406 - "POST /node/69ad4015ed37758c525e21f6 HTTP/1.0" 202 Accepted 2026-03-08 09:24:23,134 - lava_callback - INFO - Starting async job submit for node 69ad4015ed37758c525e21f6 2026-03-08 09:24:23,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:23,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4015ed37758c525e21f6 HTTP/1.1" 200 None 2026-03-08 09:24:23,200 - lava_callback - DEBUG - Processing node 69ad4015ed37758c525e21f6: baseline-arm64 2026-03-08 09:24:23,346 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:24:23,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:24:23,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:24:23,639 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4015ed37758c525e21f6/lava-logs.yaml 2026-03-08 09:24:23,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:24:23,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:24:23,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4015ed37758c525e21f6/lava_callback.json.gz 2026-03-08 09:24:23,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:23,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4015ed37758c525e21f6 HTTP/1.1" 200 None 2026-03-08 09:24:23,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:23,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:24:23,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:23,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4015ed37758c525e21f6 HTTP/1.1" 200 None 2026-03-08 09:24:24,032 - lava_callback - INFO - Completed processing callback for node 69ad4015ed37758c525e21f6 INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:24:32,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:24:32,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:26:14,130 - lava_callback - INFO - Received callback for node 69ad3bfeed37758c525e1e3d INFO: 172.21.0.1:51746 - "POST /node/69ad3bfeed37758c525e1e3d HTTP/1.0" 202 Accepted 2026-03-08 09:26:14,138 - lava_callback - INFO - Starting async job submit for node 69ad3bfeed37758c525e1e3d 2026-03-08 09:26:14,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:14,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bfeed37758c525e1e3d HTTP/1.1" 200 None 2026-03-08 09:26:14,201 - lava_callback - DEBUG - Processing node 69ad3bfeed37758c525e1e3d: baseline-nfs-arm64 INFO: 172.21.0.1:51760 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-08 09:26:15,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:26:15,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:26:15,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfeed37758c525e1e3d/log.txt.gz 2026-03-08 09:26:16,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:26:16,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:26:16,278 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfeed37758c525e1e3d/lava-logs.yaml 2026-03-08 09:26:16,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51768 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:26:16,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:26:16,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3bfeed37758c525e1e3d/lava_callback.json.gz DEBUG: Setup failed for 69ad3bfeed37758c525e1e3d. Transitting job node result: incomplete -> fail 2026-03-08 09:26:16,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:16,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bfeed37758c525e1e3d HTTP/1.1" 200 None 2026-03-08 09:26:16,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:16,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:26:16,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:16,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bfeed37758c525e1e3d HTTP/1.1" 200 None 2026-03-08 09:26:16,756 - lava_callback - INFO - Completed processing callback for node 69ad3bfeed37758c525e1e3d INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:26:32,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:32,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38934 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:26:43,028 - lava_callback - INFO - Received callback for node 69ad3c00ed37758c525e1e43 INFO: 172.21.0.1:48172 - "POST /node/69ad3c00ed37758c525e1e43 HTTP/1.0" 202 Accepted 2026-03-08 09:26:43,036 - lava_callback - INFO - Starting async job submit for node 69ad3c00ed37758c525e1e43 2026-03-08 09:26:43,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:43,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c00ed37758c525e1e43 HTTP/1.1" 200 None 2026-03-08 09:26:43,103 - lava_callback - DEBUG - Processing node 69ad3c00ed37758c525e1e43: baseline-nfs-arm64 2026-03-08 09:26:44,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:26:44,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:26:44,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c00ed37758c525e1e43/log.txt.gz 2026-03-08 09:26:44,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:26:45,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:26:45,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c00ed37758c525e1e43/lava-logs.yaml 2026-03-08 09:26:45,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:26:45,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:26:45,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad3c00ed37758c525e1e43/lava_callback.json.gz DEBUG: Setup failed for 69ad3c00ed37758c525e1e43. Transitting job node result: incomplete -> fail 2026-03-08 09:26:45,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:45,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c00ed37758c525e1e43 HTTP/1.1" 200 None 2026-03-08 09:26:45,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:45,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:26:45,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:26:45,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c00ed37758c525e1e43 HTTP/1.1" 200 None 2026-03-08 09:26:45,706 - lava_callback - INFO - Completed processing callback for node 69ad3c00ed37758c525e1e43 INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:27:02,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:27:02,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:27:40,458 - lava_callback - INFO - Received callback for node 69ad4088ed37758c525e222c INFO: 172.21.0.1:57428 - "POST /node/69ad4088ed37758c525e222c HTTP/1.0" 202 Accepted 2026-03-08 09:27:40,464 - lava_callback - INFO - Starting async job submit for node 69ad4088ed37758c525e222c 2026-03-08 09:27:40,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:27:40,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4088ed37758c525e222c HTTP/1.1" 200 None 2026-03-08 09:27:40,502 - lava_callback - DEBUG - Processing node 69ad4088ed37758c525e222c: baseline-arm64 2026-03-08 09:27:40,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:27:41,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:27:41,058 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4088ed37758c525e222c/log.txt.gz 2026-03-08 09:27:41,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:27:41,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:27:41,623 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4088ed37758c525e222c/lava-logs.yaml 2026-03-08 09:27:41,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:27:41,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:27:41,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4088ed37758c525e222c/lava_callback.json.gz 2026-03-08 09:27:41,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:27:41,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4088ed37758c525e222c HTTP/1.1" 200 None 2026-03-08 09:27:41,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:27:41,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:27:41,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:27:41,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4088ed37758c525e222c HTTP/1.1" 200 None 2026-03-08 09:27:42,031 - lava_callback - INFO - Completed processing callback for node 69ad4088ed37758c525e222c INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:28:02,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:28:02,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:29:06,423 - lava_callback - INFO - Received callback for node 69ad415aed37758c525e227c INFO: 172.21.0.1:36302 - "POST /node/69ad415aed37758c525e227c HTTP/1.0" 202 Accepted 2026-03-08 09:29:06,429 - lava_callback - INFO - Starting async job submit for node 69ad415aed37758c525e227c 2026-03-08 09:29:06,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:06,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad415aed37758c525e227c HTTP/1.1" 200 None 2026-03-08 09:29:06,448 - lava_callback - DEBUG - Processing node 69ad415aed37758c525e227c: baseline-arm 2026-03-08 09:29:06,453 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:29:06,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:29:06,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:29:06,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad415aed37758c525e227c/lava-logs.yaml 2026-03-08 09:29:06,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:29:06,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:29:06,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad415aed37758c525e227c/lava_callback.json.gz 2026-03-08 09:29:06,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:06,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad415aed37758c525e227c HTTP/1.1" 200 None 2026-03-08 09:29:06,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:06,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:29:06,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:06,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad415aed37758c525e227c HTTP/1.1" 200 None 2026-03-08 09:29:06,849 - lava_callback - INFO - Completed processing callback for node 69ad415aed37758c525e227c 2026-03-08 09:29:12,316 - lava_callback - INFO - Received callback for node 69ad37e8ed37758c525e1b1d INFO: 172.21.0.1:46528 - "POST /node/69ad37e8ed37758c525e1b1d HTTP/1.0" 202 Accepted 2026-03-08 09:29:12,323 - lava_callback - INFO - Starting async job submit for node 69ad37e8ed37758c525e1b1d 2026-03-08 09:29:12,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:12,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e8ed37758c525e1b1d HTTP/1.1" 200 None 2026-03-08 09:29:12,383 - lava_callback - DEBUG - Processing node 69ad37e8ed37758c525e1b1d: ltp-pty 2026-03-08 09:29:12,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:29:12,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:29:12,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ad37e8ed37758c525e1b1d/log.txt.gz 2026-03-08 09:29:13,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:29:13,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:29:13,397 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ad37e8ed37758c525e1b1d/lava-logs.yaml 2026-03-08 09:29:13,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:29:13,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:29:13,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ad37e8ed37758c525e1b1d/lava_callback.json.gz 2026-03-08 09:29:13,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:13,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37e8ed37758c525e1b1d HTTP/1.1" 200 None 2026-03-08 09:29:13,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:13,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:29:13,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:13,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37e8ed37758c525e1b1d HTTP/1.1" 200 None 2026-03-08 09:29:13,687 - lava_callback - INFO - Completed processing callback for node 69ad37e8ed37758c525e1b1d INFO: 172.21.0.1:46534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:29:32,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:29:32,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:33:12,299 - lava_callback - INFO - Received callback for node 69ad37eaed37758c525e1b20 INFO: 172.21.0.1:38260 - "POST /node/69ad37eaed37758c525e1b20 HTTP/1.0" 202 Accepted 2026-03-08 09:33:12,305 - lava_callback - INFO - Starting async job submit for node 69ad37eaed37758c525e1b20 2026-03-08 09:33:12,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:12,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37eaed37758c525e1b20 HTTP/1.1" 200 None 2026-03-08 09:33:12,345 - lava_callback - DEBUG - Processing node 69ad37eaed37758c525e1b20: ltp-sched 2026-03-08 09:33:12,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:33:12,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:33:12,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ad37eaed37758c525e1b20/log.txt.gz 2026-03-08 09:33:13,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:33:13,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:33:13,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ad37eaed37758c525e1b20/lava-logs.yaml 2026-03-08 09:33:13,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:33:13,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:33:13,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ad37eaed37758c525e1b20/lava_callback.json.gz 2026-03-08 09:33:13,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:13,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37eaed37758c525e1b20 HTTP/1.1" 200 None 2026-03-08 09:33:13,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:13,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:33:13,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:13,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37eaed37758c525e1b20 HTTP/1.1" 200 None 2026-03-08 09:33:13,590 - lava_callback - INFO - Completed processing callback for node 69ad37eaed37758c525e1b20 INFO: 172.21.0.1:38274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:33:20,880 - lava_callback - INFO - Received callback for node 69ad3e7bed37758c525e2131 INFO: 172.21.0.1:58524 - "POST /node/69ad3e7bed37758c525e2131 HTTP/1.0" 202 Accepted 2026-03-08 09:33:20,887 - lava_callback - INFO - Starting async job submit for node 69ad3e7bed37758c525e2131 2026-03-08 09:33:20,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:20,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3e7bed37758c525e2131 HTTP/1.1" 200 None 2026-03-08 09:33:20,954 - lava_callback - DEBUG - Processing node 69ad3e7bed37758c525e2131: baseline-arm 2026-03-08 09:33:21,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:33:21,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:33:21,732 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad3e7bed37758c525e2131/log.txt.gz 2026-03-08 09:33:22,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:33:22,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:33:22,365 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad3e7bed37758c525e2131/lava-logs.yaml 2026-03-08 09:33:22,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:33:22,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:33:22,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad3e7bed37758c525e2131/lava_callback.json.gz DEBUG: Setup failed for 69ad3e7bed37758c525e2131. Transitting job node result: incomplete -> fail 2026-03-08 09:33:22,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:22,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3e7bed37758c525e2131 HTTP/1.1" 200 None 2026-03-08 09:33:22,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:22,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:33:22,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:22,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3e7bed37758c525e2131 HTTP/1.1" 200 None 2026-03-08 09:33:22,927 - lava_callback - INFO - Completed processing callback for node 69ad3e7bed37758c525e2131 INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:33:32,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:33:32,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:37:12,663 - lava_callback - INFO - Received callback for node 69ad37eced37758c525e1b23 INFO: 172.21.0.1:59180 - "POST /node/69ad37eced37758c525e1b23 HTTP/1.0" 202 Accepted 2026-03-08 09:37:12,670 - lava_callback - INFO - Starting async job submit for node 69ad37eced37758c525e1b23 2026-03-08 09:37:12,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:12,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37eced37758c525e1b23 HTTP/1.1" 200 None 2026-03-08 09:37:12,714 - lava_callback - DEBUG - Processing node 69ad37eced37758c525e1b23: ltp-smoke 2026-03-08 09:37:13,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:37:13,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:37:13,177 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad37eced37758c525e1b23/log.txt.gz 2026-03-08 09:37:13,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:37:13,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:37:13,589 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad37eced37758c525e1b23/lava-logs.yaml 2026-03-08 09:37:13,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:37:13,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:37:13,869 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad37eced37758c525e1b23/lava_callback.json.gz 2026-03-08 09:37:13,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:13,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37eced37758c525e1b23 HTTP/1.1" 200 None 2026-03-08 09:37:13,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:13,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:37:13,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:13,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37eced37758c525e1b23 HTTP/1.1" 200 None 2026-03-08 09:37:13,996 - lava_callback - INFO - Completed processing callback for node 69ad37eced37758c525e1b23 INFO: 172.21.0.1:59194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:37:21,002 - lava_callback - INFO - Received callback for node 69aaa03b76ddd5d9e606e274 INFO: 172.21.0.1:58994 - "POST /node/69aaa03b76ddd5d9e606e274 HTTP/1.0" 202 Accepted 2026-03-08 09:37:21,007 - lava_callback - INFO - Starting async job submit for node 69aaa03b76ddd5d9e606e274 2026-03-08 09:37:21,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:21,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa03b76ddd5d9e606e274 HTTP/1.1" 200 None 2026-03-08 09:37:21,023 - lava_callback - DEBUG - Processing node 69aaa03b76ddd5d9e606e274: baseline-arm-baylibre 2026-03-08 09:37:21,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa03b76ddd5d9e606e274 2026-03-08 09:37:21,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:21,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa03b76ddd5d9e606e274 HTTP/1.1" 200 None 2026-03-08 09:37:21,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:21,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4878020dd22eabedb46 HTTP/1.1" 200 None 2026-03-08 09:37:21,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:21,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa03b76ddd5d9e606e274 HTTP/1.1" 200 None 2026-03-08 09:37:21,082 - lava_callback - ERROR - Error processing callback for node 69aaa03b76ddd5d9e606e274: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:37:32,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:37:32,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:39:01,043 - lava_callback - INFO - Received callback for node 69aaa0a576ddd5d9e606e2a3 INFO: 172.21.0.1:37204 - "POST /node/69aaa0a576ddd5d9e606e2a3 HTTP/1.0" 202 Accepted 2026-03-08 09:39:01,049 - lava_callback - INFO - Starting async job submit for node 69aaa0a576ddd5d9e606e2a3 2026-03-08 09:39:01,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:39:01,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa0a576ddd5d9e606e2a3 HTTP/1.1" 200 None 2026-03-08 09:39:01,065 - lava_callback - DEBUG - Processing node 69aaa0a576ddd5d9e606e2a3: baseline-arm-baylibre 2026-03-08 09:39:01,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa0a576ddd5d9e606e2a3 2026-03-08 09:39:01,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:39:01,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa0a576ddd5d9e606e2a3 HTTP/1.1" 200 None 2026-03-08 09:39:01,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:39:01,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4878020dd22eabedb46 HTTP/1.1" 200 None 2026-03-08 09:39:01,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:39:01,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa0a576ddd5d9e606e2a3 HTTP/1.1" 200 None 2026-03-08 09:39:01,121 - lava_callback - ERROR - Error processing callback for node 69aaa0a576ddd5d9e606e2a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:39:21,024 - lava_callback - INFO - Received callback for node 69aaa0c576ddd5d9e606e2b7 INFO: 172.21.0.1:55780 - "POST /node/69aaa0c576ddd5d9e606e2b7 HTTP/1.0" 202 Accepted 2026-03-08 09:39:21,029 - lava_callback - INFO - Starting async job submit for node 69aaa0c576ddd5d9e606e2b7 2026-03-08 09:39:21,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:39:21,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa0c576ddd5d9e606e2b7 HTTP/1.1" 200 None 2026-03-08 09:39:21,045 - lava_callback - DEBUG - Processing node 69aaa0c576ddd5d9e606e2b7: baseline-arm-baylibre 2026-03-08 09:39:21,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa0c576ddd5d9e606e2b7 2026-03-08 09:39:21,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:39:21,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa0c576ddd5d9e606e2b7 HTTP/1.1" 200 None 2026-03-08 09:39:21,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:39:21,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4878020dd22eabedb46 HTTP/1.1" 200 None 2026-03-08 09:39:21,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:39:21,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa0c576ddd5d9e606e2b7 HTTP/1.1" 200 None 2026-03-08 09:39:21,105 - lava_callback - ERROR - Error processing callback for node 69aaa0c576ddd5d9e606e2b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:40:01,028 - lava_callback - INFO - Received callback for node 69aaa0e576ddd5d9e606e2ce INFO: 172.21.0.1:50612 - "POST /node/69aaa0e576ddd5d9e606e2ce HTTP/1.0" 202 Accepted 2026-03-08 09:40:01,034 - lava_callback - INFO - Starting async job submit for node 69aaa0e576ddd5d9e606e2ce 2026-03-08 09:40:01,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:01,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa0e576ddd5d9e606e2ce HTTP/1.1" 200 None 2026-03-08 09:40:01,050 - lava_callback - DEBUG - Processing node 69aaa0e576ddd5d9e606e2ce: baseline-arm-baylibre 2026-03-08 09:40:01,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa0e576ddd5d9e606e2ce 2026-03-08 09:40:01,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:01,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa0e576ddd5d9e606e2ce HTTP/1.1" 200 None 2026-03-08 09:40:01,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:01,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4878020dd22eabedb46 HTTP/1.1" 200 None 2026-03-08 09:40:01,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:01,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa0e576ddd5d9e606e2ce HTTP/1.1" 200 None 2026-03-08 09:40:01,116 - lava_callback - ERROR - Error processing callback for node 69aaa0e576ddd5d9e606e2ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 09:40:05,424 - lava_callback - INFO - Received callback for node 69ad43d2ed37758c525e23e9 INFO: 172.21.0.1:50622 - "POST /node/69ad43d2ed37758c525e23e9 HTTP/1.0" 202 Accepted 2026-03-08 09:40:05,430 - lava_callback - INFO - Starting async job submit for node 69ad43d2ed37758c525e23e9 2026-03-08 09:40:05,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:05,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad43d2ed37758c525e23e9 HTTP/1.1" 200 None 2026-03-08 09:40:05,448 - lava_callback - DEBUG - Processing node 69ad43d2ed37758c525e23e9: baseline-nfs-arm64 2026-03-08 09:40:05,449 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:40:05,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:40:05,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:40:05,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad43d2ed37758c525e23e9/lava-logs.yaml 2026-03-08 09:40:05,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:40:05,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:40:05,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad43d2ed37758c525e23e9/lava_callback.json.gz 2026-03-08 09:40:05,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:05,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad43d2ed37758c525e23e9 HTTP/1.1" 200 None 2026-03-08 09:40:05,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:05,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:40:05,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:05,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad43d2ed37758c525e23e9 HTTP/1.1" 200 None 2026-03-08 09:40:05,828 - lava_callback - INFO - Completed processing callback for node 69ad43d2ed37758c525e23e9 INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50596 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:40:32,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:40:32,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:41:12,607 - lava_callback - INFO - Received callback for node 69ad37efed37758c525e1b2c INFO: 172.21.0.1:41156 - "POST /node/69ad37efed37758c525e1b2c HTTP/1.0" 202 Accepted 2026-03-08 09:41:12,614 - lava_callback - INFO - Starting async job submit for node 69ad37efed37758c525e1b2c 2026-03-08 09:41:12,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:12,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37efed37758c525e1b2c HTTP/1.1" 200 None 2026-03-08 09:41:12,652 - lava_callback - DEBUG - Processing node 69ad37efed37758c525e1b2c: ltp-syscalls-ipc 2026-03-08 09:41:13,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:41:13,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:41:13,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ad37efed37758c525e1b2c/log.txt.gz 2026-03-08 09:41:13,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:41:13,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:41:13,624 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ad37efed37758c525e1b2c/lava-logs.yaml 2026-03-08 09:41:13,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:41:13,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:41:13,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ad37efed37758c525e1b2c/lava_callback.json.gz 2026-03-08 09:41:13,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:13,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37efed37758c525e1b2c HTTP/1.1" 200 None 2026-03-08 09:41:13,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:13,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:41:13,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:13,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37efed37758c525e1b2c HTTP/1.1" 200 None 2026-03-08 09:41:13,909 - lava_callback - INFO - Completed processing callback for node 69ad37efed37758c525e1b2c INFO: 172.21.0.1:41162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:41:25,101 - lava_callback - INFO - Received callback for node 69ad4415ed37758c525e23fd INFO: 172.21.0.1:39222 - "POST /node/69ad4415ed37758c525e23fd HTTP/1.0" 202 Accepted 2026-03-08 09:41:25,108 - lava_callback - INFO - Starting async job submit for node 69ad4415ed37758c525e23fd 2026-03-08 09:41:25,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:25,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4415ed37758c525e23fd HTTP/1.1" 200 None 2026-03-08 09:41:25,159 - lava_callback - DEBUG - Processing node 69ad4415ed37758c525e23fd: baseline-arm64 2026-03-08 09:41:25,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:41:25,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:41:25,429 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4415ed37758c525e23fd/log.txt.gz 2026-03-08 09:41:25,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:41:25,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:41:25,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4415ed37758c525e23fd/lava-logs.yaml 2026-03-08 09:41:25,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:41:25,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:41:25,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4415ed37758c525e23fd/lava_callback.json.gz 2026-03-08 09:41:25,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:25,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4415ed37758c525e23fd HTTP/1.1" 200 None 2026-03-08 09:41:25,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:25,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:41:25,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:25,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4415ed37758c525e23fd HTTP/1.1" 200 None 2026-03-08 09:41:25,970 - lava_callback - INFO - Completed processing callback for node 69ad4415ed37758c525e23fd INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:41:32,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:32,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:41:41,217 - lava_callback - INFO - Received callback for node 69aaa14776ddd5d9e606e2f9 INFO: 172.21.0.1:37874 - "POST /node/69aaa14776ddd5d9e606e2f9 HTTP/1.0" 202 Accepted 2026-03-08 09:41:41,223 - lava_callback - INFO - Starting async job submit for node 69aaa14776ddd5d9e606e2f9 2026-03-08 09:41:41,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:41,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa14776ddd5d9e606e2f9 HTTP/1.1" 200 None 2026-03-08 09:41:41,238 - lava_callback - DEBUG - Processing node 69aaa14776ddd5d9e606e2f9: baseline-arm-baylibre 2026-03-08 09:41:41,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa14776ddd5d9e606e2f9 2026-03-08 09:41:41,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:41,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa14776ddd5d9e606e2f9 HTTP/1.1" 200 None 2026-03-08 09:41:41,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:41,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4878020dd22eabedb46 HTTP/1.1" 200 None 2026-03-08 09:41:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:41:41,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa14776ddd5d9e606e2f9 HTTP/1.1" 200 None 2026-03-08 09:41:41,295 - lava_callback - ERROR - Error processing callback for node 69aaa14776ddd5d9e606e2f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:42:32,595 - lava_callback - INFO - Received callback for node 69ad3c16ed37758c525e1e9b INFO: 172.21.0.1:43596 - "POST /node/69ad3c16ed37758c525e1e9b HTTP/1.0" 202 Accepted 2026-03-08 09:42:32,603 - lava_callback - INFO - Starting async job submit for node 69ad3c16ed37758c525e1e9b 2026-03-08 09:42:32,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:42:32,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c16ed37758c525e1e9b HTTP/1.1" 200 None 2026-03-08 09:42:32,638 - lava_callback - DEBUG - Processing node 69ad3c16ed37758c525e1e9b: baseline-arm64-broonie 2026-03-08 09:42:32,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:42:33,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:42:33,022 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c16ed37758c525e1e9b/log.txt.gz 2026-03-08 09:42:33,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:42:33,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:42:33,437 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c16ed37758c525e1e9b/lava-logs.yaml 2026-03-08 09:42:33,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:42:33,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:42:33,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad3c16ed37758c525e1e9b/lava_callback.json.gz 2026-03-08 09:42:33,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:42:33,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3c16ed37758c525e1e9b HTTP/1.1" 200 None 2026-03-08 09:42:33,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:42:33,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:42:33,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:42:33,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3c16ed37758c525e1e9b HTTP/1.1" 200 None 2026-03-08 09:42:33,792 - lava_callback - INFO - Completed processing callback for node 69ad3c16ed37758c525e1e9b INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:42:44,744 - lava_callback - INFO - Received callback for node 69ad4460ed37758c525e2426 INFO: 172.21.0.1:50830 - "POST /node/69ad4460ed37758c525e2426 HTTP/1.0" 202 Accepted 2026-03-08 09:42:44,751 - lava_callback - INFO - Starting async job submit for node 69ad4460ed37758c525e2426 2026-03-08 09:42:44,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:42:44,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4460ed37758c525e2426 HTTP/1.1" 200 None 2026-03-08 09:42:44,794 - lava_callback - DEBUG - Processing node 69ad4460ed37758c525e2426: baseline-arm64 2026-03-08 09:42:44,933 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:42:45,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:42:45,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:42:45,160 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4460ed37758c525e2426/lava-logs.yaml 2026-03-08 09:42:45,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:42:45,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:42:45,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4460ed37758c525e2426/lava_callback.json.gz 2026-03-08 09:42:45,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:42:45,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4460ed37758c525e2426 HTTP/1.1" 200 None 2026-03-08 09:42:45,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:42:45,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:42:45,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:42:45,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4460ed37758c525e2426 HTTP/1.1" 200 None 2026-03-08 09:42:45,500 - lava_callback - INFO - Completed processing callback for node 69ad4460ed37758c525e2426 INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:43:02,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:43:02,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:44:37,421 - lava_callback - INFO - Received callback for node 69ad406aed37758c525e2221 INFO: 172.21.0.1:35576 - "POST /node/69ad406aed37758c525e2221 HTTP/1.0" 202 Accepted 2026-03-08 09:44:37,469 - lava_callback - INFO - Starting async job submit for node 69ad406aed37758c525e2221 2026-03-08 09:44:37,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:44:37,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad406aed37758c525e2221 HTTP/1.1" 200 None 2026-03-08 09:44:37,507 - lava_callback - DEBUG - Processing node 69ad406aed37758c525e2221: baseline-arm-pengutronix 2026-03-08 09:44:37,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:44:37,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:44:37,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad406aed37758c525e2221/log.txt.gz 2026-03-08 09:44:37,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:44:38,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:44:38,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad406aed37758c525e2221/lava-logs.yaml 2026-03-08 09:44:38,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:44:38,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:44:38,150 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad406aed37758c525e2221/lava_callback.json.gz DEBUG: Setup failed for 69ad406aed37758c525e2221. Transitting job node result: incomplete -> fail 2026-03-08 09:44:38,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:44:38,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad406aed37758c525e2221 HTTP/1.1" 200 None 2026-03-08 09:44:38,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:44:38,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:44:38,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:44:38,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad406aed37758c525e2221 HTTP/1.1" 200 None 2026-03-08 09:44:38,306 - lava_callback - INFO - Completed processing callback for node 69ad406aed37758c525e2221 2026-03-08 09:44:41,353 - lava_callback - INFO - Received callback for node 69aaa1f776ddd5d9e606e352 INFO: 172.21.0.1:47778 - "POST /node/69aaa1f776ddd5d9e606e352 HTTP/1.0" 202 Accepted 2026-03-08 09:44:41,359 - lava_callback - INFO - Starting async job submit for node 69aaa1f776ddd5d9e606e352 2026-03-08 09:44:41,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:44:41,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa1f776ddd5d9e606e352 HTTP/1.1" 200 None 2026-03-08 09:44:41,373 - lava_callback - DEBUG - Processing node 69aaa1f776ddd5d9e606e352: baseline-arm-baylibre 2026-03-08 09:44:41,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa1f776ddd5d9e606e352 2026-03-08 09:44:41,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:44:41,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa1f776ddd5d9e606e352 HTTP/1.1" 200 None 2026-03-08 09:44:41,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:44:41,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4878020dd22eabedb46 HTTP/1.1" 200 None 2026-03-08 09:44:41,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:44:41,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa1f776ddd5d9e606e352 HTTP/1.1" 200 None 2026-03-08 09:44:41,442 - lava_callback - ERROR - Error processing callback for node 69aaa1f776ddd5d9e606e352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52584 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:45:02,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:02,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:45:12,629 - lava_callback - INFO - Received callback for node 69ad37f1ed37758c525e1b33 INFO: 172.21.0.1:46994 - "POST /node/69ad37f1ed37758c525e1b33 HTTP/1.0" 202 Accepted 2026-03-08 09:45:12,635 - lava_callback - INFO - Starting async job submit for node 69ad37f1ed37758c525e1b33 2026-03-08 09:45:12,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:12,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37f1ed37758c525e1b33 HTTP/1.1" 200 None 2026-03-08 09:45:12,675 - lava_callback - DEBUG - Processing node 69ad37f1ed37758c525e1b33: ltp-timers 2026-03-08 09:45:13,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:45:13,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:45:13,174 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69ad37f1ed37758c525e1b33/log.txt.gz 2026-03-08 09:45:13,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:45:13,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:45:13,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69ad37f1ed37758c525e1b33/lava-logs.yaml 2026-03-08 09:45:13,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:45:13,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:45:13,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69ad37f1ed37758c525e1b33/lava_callback.json.gz 2026-03-08 09:45:13,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:13,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37f1ed37758c525e1b33 HTTP/1.1" 200 None 2026-03-08 09:45:13,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:13,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:45:13,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:13,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37f1ed37758c525e1b33 HTTP/1.1" 200 None 2026-03-08 09:45:13,922 - lava_callback - INFO - Completed processing callback for node 69ad37f1ed37758c525e1b33 INFO: 172.21.0.1:47000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:45:32,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:32,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41430 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:45:41,372 - lava_callback - INFO - Received callback for node 69aaa23d76ddd5d9e606e389 INFO: 172.21.0.1:49206 - "POST /node/69aaa23d76ddd5d9e606e389 HTTP/1.0" 202 Accepted 2026-03-08 09:45:41,377 - lava_callback - INFO - Starting async job submit for node 69aaa23d76ddd5d9e606e389 2026-03-08 09:45:41,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:41,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa23d76ddd5d9e606e389 HTTP/1.1" 200 None 2026-03-08 09:45:41,397 - lava_callback - DEBUG - Processing node 69aaa23d76ddd5d9e606e389: baseline-arm64-baylibre 2026-03-08 09:45:41,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa23d76ddd5d9e606e389 2026-03-08 09:45:41,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:41,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa23d76ddd5d9e606e389 HTTP/1.1" 200 None 2026-03-08 09:45:41,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:41,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 09:45:41,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:45:41,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa23d76ddd5d9e606e389 HTTP/1.1" 200 None 2026-03-08 09:45:41,463 - lava_callback - ERROR - Error processing callback for node 69aaa23d76ddd5d9e606e389: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:46:01,171 - lava_callback - INFO - Received callback for node 69ad44fced37758c525e2466 INFO: 172.21.0.1:44862 - "POST /node/69ad44fced37758c525e2466 HTTP/1.0" 202 Accepted 2026-03-08 09:46:01,181 - lava_callback - INFO - Starting async job submit for node 69ad44fced37758c525e2466 2026-03-08 09:46:01,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:46:01,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad44fced37758c525e2466 HTTP/1.1" 200 None 2026-03-08 09:46:01,221 - lava_callback - DEBUG - Processing node 69ad44fced37758c525e2466: baseline-nfs-arm64 2026-03-08 09:46:01,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:46:01,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:46:01,872 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad44fced37758c525e2466/log.txt.gz 2026-03-08 09:46:02,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:46:02,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:46:02,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad44fced37758c525e2466/lava-logs.yaml 2026-03-08 09:46:02,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:46:02,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:46:02,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad44fced37758c525e2466/lava_callback.json.gz 2026-03-08 09:46:02,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:46:02,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad44fced37758c525e2466 HTTP/1.1" 200 None 2026-03-08 09:46:02,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:46:02,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:46:02,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:46:02,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad44fced37758c525e2466 HTTP/1.1" 200 None 2026-03-08 09:46:02,612 - lava_callback - INFO - Completed processing callback for node 69ad44fced37758c525e2466 INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:46:32,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:46:32,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:47:35,035 - lava_callback - INFO - Received callback for node 69ad4540ed37758c525e248b INFO: 172.21.0.1:38102 - "POST /node/69ad4540ed37758c525e248b HTTP/1.0" 202 Accepted 2026-03-08 09:47:35,041 - lava_callback - INFO - Starting async job submit for node 69ad4540ed37758c525e248b 2026-03-08 09:47:35,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:47:35,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4540ed37758c525e248b HTTP/1.1" 200 None 2026-03-08 09:47:35,078 - lava_callback - DEBUG - Processing node 69ad4540ed37758c525e248b: baseline-arm64 2026-03-08 09:47:35,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:47:35,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:47:35,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4540ed37758c525e248b/log.txt.gz 2026-03-08 09:47:35,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:47:36,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:47:36,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4540ed37758c525e248b/lava-logs.yaml 2026-03-08 09:47:36,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:47:36,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:47:36,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4540ed37758c525e248b/lava_callback.json.gz 2026-03-08 09:47:36,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:47:36,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4540ed37758c525e248b HTTP/1.1" 200 None 2026-03-08 09:47:36,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:47:36,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:47:36,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:47:36,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4540ed37758c525e248b HTTP/1.1" 200 None 2026-03-08 09:47:36,417 - lava_callback - INFO - Completed processing callback for node 69ad4540ed37758c525e248b INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:48:01,567 - lava_callback - INFO - Received callback for node 69aaa2cd76ddd5d9e606e3be INFO: 172.21.0.1:50106 - "POST /node/69aaa2cd76ddd5d9e606e3be HTTP/1.0" 202 Accepted 2026-03-08 09:48:01,572 - lava_callback - INFO - Starting async job submit for node 69aaa2cd76ddd5d9e606e3be 2026-03-08 09:48:01,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:48:01,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa2cd76ddd5d9e606e3be HTTP/1.1" 200 None 2026-03-08 09:48:01,587 - lava_callback - DEBUG - Processing node 69aaa2cd76ddd5d9e606e3be: baseline-arm64-baylibre 2026-03-08 09:48:01,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa2cd76ddd5d9e606e3be 2026-03-08 09:48:01,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:48:01,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa2cd76ddd5d9e606e3be HTTP/1.1" 200 None 2026-03-08 09:48:01,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:48:01,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 09:48:01,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:48:01,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa2cd76ddd5d9e606e3be HTTP/1.1" 200 None 2026-03-08 09:48:01,638 - lava_callback - ERROR - Error processing callback for node 69aaa2cd76ddd5d9e606e3be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-08 09:48:02,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:48:02,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:49:12,816 - lava_callback - INFO - Received callback for node 69ad37f3ed37758c525e1b38 INFO: 172.21.0.1:37514 - "POST /node/69ad37f3ed37758c525e1b38 HTTP/1.0" 202 Accepted 2026-03-08 09:49:12,827 - lava_callback - INFO - Starting async job submit for node 69ad37f3ed37758c525e1b38 2026-03-08 09:49:12,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:12,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37f3ed37758c525e1b38 HTTP/1.1" 200 None 2026-03-08 09:49:12,903 - lava_callback - DEBUG - Processing node 69ad37f3ed37758c525e1b38: ltp-watchqueue 2026-03-08 09:49:13,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:49:13,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:49:13,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ad37f3ed37758c525e1b38/log.txt.gz 2026-03-08 09:49:13,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:49:14,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:49:14,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ad37f3ed37758c525e1b38/lava-logs.yaml 2026-03-08 09:49:14,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:49:14,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:49:14,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ad37f3ed37758c525e1b38/lava_callback.json.gz 2026-03-08 09:49:14,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:14,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad37f3ed37758c525e1b38 HTTP/1.1" 200 None 2026-03-08 09:49:14,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:14,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 09:49:14,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:14,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad37f3ed37758c525e1b38 HTTP/1.1" 200 None 2026-03-08 09:49:14,273 - lava_callback - INFO - Completed processing callback for node 69ad37f3ed37758c525e1b38 INFO: 172.21.0.1:37522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:49:21,735 - lava_callback - INFO - Received callback for node 69aaa31676ddd5d9e606e3e4 INFO: 172.21.0.1:42336 - "POST /node/69aaa31676ddd5d9e606e3e4 HTTP/1.0" 202 Accepted 2026-03-08 09:49:21,741 - lava_callback - INFO - Starting async job submit for node 69aaa31676ddd5d9e606e3e4 2026-03-08 09:49:21,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:21,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa31676ddd5d9e606e3e4 HTTP/1.1" 200 None 2026-03-08 09:49:21,757 - lava_callback - DEBUG - Processing node 69aaa31676ddd5d9e606e3e4: baseline-arm64-baylibre 2026-03-08 09:49:21,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa31676ddd5d9e606e3e4 2026-03-08 09:49:21,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:21,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa31676ddd5d9e606e3e4 HTTP/1.1" 200 None 2026-03-08 09:49:21,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:21,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 09:49:21,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:21,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa31676ddd5d9e606e3e4 HTTP/1.1" 200 None 2026-03-08 09:49:21,823 - lava_callback - ERROR - Error processing callback for node 69aaa31676ddd5d9e606e3e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:49:32,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:49:32,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:51:59,155 - lava_callback - INFO - Received callback for node 69ad46aded37758c525e2513 INFO: 172.21.0.1:37302 - "POST /node/69ad46aded37758c525e2513 HTTP/1.0" 202 Accepted 2026-03-08 09:51:59,161 - lava_callback - INFO - Starting async job submit for node 69ad46aded37758c525e2513 2026-03-08 09:51:59,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:51:59,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad46aded37758c525e2513 HTTP/1.1" 200 None 2026-03-08 09:51:59,205 - lava_callback - DEBUG - Processing node 69ad46aded37758c525e2513: baseline-nfs-arm64 2026-03-08 09:51:59,206 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:51:59,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:51:59,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:51:59,365 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad46aded37758c525e2513/lava-logs.yaml 2026-03-08 09:51:59,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:51:59,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:51:59,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad46aded37758c525e2513/lava_callback.json.gz 2026-03-08 09:51:59,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:51:59,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad46aded37758c525e2513 HTTP/1.1" 200 None 2026-03-08 09:51:59,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:51:59,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:51:59,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:51:59,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad46aded37758c525e2513 HTTP/1.1" 200 None 2026-03-08 09:51:59,584 - lava_callback - INFO - Completed processing callback for node 69ad46aded37758c525e2513 2026-03-08 09:52:02,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:52:02,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:53:21,844 - lava_callback - INFO - Received callback for node 69aaa40876ddd5d9e606e441 INFO: 172.21.0.1:52576 - "POST /node/69aaa40876ddd5d9e606e441 HTTP/1.0" 202 Accepted 2026-03-08 09:53:21,851 - lava_callback - INFO - Starting async job submit for node 69aaa40876ddd5d9e606e441 2026-03-08 09:53:21,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:53:21,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa40876ddd5d9e606e441 HTTP/1.1" 200 None 2026-03-08 09:53:21,870 - lava_callback - DEBUG - Processing node 69aaa40876ddd5d9e606e441: baseline-arm64-baylibre 2026-03-08 09:53:21,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa40876ddd5d9e606e441 2026-03-08 09:53:21,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:53:21,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa40876ddd5d9e606e441 HTTP/1.1" 200 None 2026-03-08 09:53:21,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:53:21,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 09:53:21,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:53:21,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa40876ddd5d9e606e441 HTTP/1.1" 200 None 2026-03-08 09:53:21,923 - lava_callback - ERROR - Error processing callback for node 69aaa40876ddd5d9e606e441: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:54:25,629 - lava_callback - INFO - Received callback for node 69ad46f0ed37758c525e2526 INFO: 172.21.0.1:37488 - "POST /node/69ad46f0ed37758c525e2526 HTTP/1.0" 202 Accepted 2026-03-08 09:54:25,635 - lava_callback - INFO - Starting async job submit for node 69ad46f0ed37758c525e2526 2026-03-08 09:54:25,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:54:25,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad46f0ed37758c525e2526 HTTP/1.1" 200 None 2026-03-08 09:54:25,682 - lava_callback - DEBUG - Processing node 69ad46f0ed37758c525e2526: baseline-arm64 2026-03-08 09:54:25,872 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:54:25,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:54:26,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:54:26,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad46f0ed37758c525e2526/lava-logs.yaml 2026-03-08 09:54:26,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:54:26,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:54:26,367 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad46f0ed37758c525e2526/lava_callback.json.gz 2026-03-08 09:54:26,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:54:26,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad46f0ed37758c525e2526 HTTP/1.1" 200 None 2026-03-08 09:54:26,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:54:26,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:54:26,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:54:26,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad46f0ed37758c525e2526 HTTP/1.1" 200 None INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:54:26,584 - lava_callback - INFO - Completed processing callback for node 69ad46f0ed37758c525e2526 INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:54:32,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:54:32,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:55:41,956 - lava_callback - INFO - Received callback for node 69aaa49876ddd5d9e606e488 INFO: 172.21.0.1:36770 - "POST /node/69aaa49876ddd5d9e606e488 HTTP/1.0" 202 Accepted 2026-03-08 09:55:41,962 - lava_callback - INFO - Starting async job submit for node 69aaa49876ddd5d9e606e488 2026-03-08 09:55:41,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:55:41,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa49876ddd5d9e606e488 HTTP/1.1" 200 None 2026-03-08 09:55:41,978 - lava_callback - DEBUG - Processing node 69aaa49876ddd5d9e606e488: baseline-arm64-baylibre 2026-03-08 09:55:41,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa49876ddd5d9e606e488 2026-03-08 09:55:41,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:55:41,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa49876ddd5d9e606e488 HTTP/1.1" 200 None 2026-03-08 09:55:41,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:55:42,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 09:55:42,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:55:42,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa49876ddd5d9e606e488 HTTP/1.1" 200 None 2026-03-08 09:55:42,036 - lava_callback - ERROR - Error processing callback for node 69aaa49876ddd5d9e606e488: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:56:05,797 - lava_callback - INFO - Received callback for node 69ad4785ed37758c525e2555 INFO: 172.21.0.1:35410 - "POST /node/69ad4785ed37758c525e2555 HTTP/1.0" 202 Accepted 2026-03-08 09:56:05,804 - lava_callback - INFO - Starting async job submit for node 69ad4785ed37758c525e2555 2026-03-08 09:56:05,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:56:05,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4785ed37758c525e2555 HTTP/1.1" 200 None 2026-03-08 09:56:05,847 - lava_callback - DEBUG - Processing node 69ad4785ed37758c525e2555: baseline-arm64 2026-03-08 09:56:05,986 - lava_callback - WARNING - Failed to upload log 2026-03-08 09:56:06,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:56:06,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:56:06,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4785ed37758c525e2555/lava-logs.yaml 2026-03-08 09:56:06,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:56:06,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:56:06,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad4785ed37758c525e2555/lava_callback.json.gz 2026-03-08 09:56:06,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:56:06,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4785ed37758c525e2555 HTTP/1.1" 200 None 2026-03-08 09:56:06,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:56:06,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 09:56:06,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:56:06,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4785ed37758c525e2555 HTTP/1.1" 200 None 2026-03-08 09:56:06,583 - lava_callback - INFO - Completed processing callback for node 69ad4785ed37758c525e2555 INFO: 172.21.0.1:44498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:56:32,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:56:32,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:57:02,014 - lava_callback - INFO - Received callback for node 69aaa4e176ddd5d9e606e4a8 INFO: 172.21.0.1:51306 - "POST /node/69aaa4e176ddd5d9e606e4a8 HTTP/1.0" 202 Accepted 2026-03-08 09:57:02,020 - lava_callback - INFO - Starting async job submit for node 69aaa4e176ddd5d9e606e4a8 2026-03-08 09:57:02,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:57:02,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa4e176ddd5d9e606e4a8 HTTP/1.1" 200 None 2026-03-08 09:57:02,035 - lava_callback - DEBUG - Processing node 69aaa4e176ddd5d9e606e4a8: baseline-arm64-baylibre 2026-03-08 09:57:02,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa4e176ddd5d9e606e4a8 2026-03-08 09:57:02,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:57:02,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa4e176ddd5d9e606e4a8 HTTP/1.1" 200 None 2026-03-08 09:57:02,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:57:02,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 09:57:02,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:57:02,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa4e176ddd5d9e606e4a8 HTTP/1.1" 200 None 2026-03-08 09:57:02,095 - lava_callback - ERROR - Error processing callback for node 69aaa4e176ddd5d9e606e4a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK 2026-03-08 09:59:33,631 - lava_callback - INFO - Received callback for node 69ad445eed37758c525e241d INFO: 172.21.0.1:35632 - "POST /node/69ad445eed37758c525e241d HTTP/1.0" 202 Accepted 2026-03-08 09:59:33,638 - lava_callback - INFO - Starting async job submit for node 69ad445eed37758c525e241d 2026-03-08 09:59:33,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:59:33,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad445eed37758c525e241d HTTP/1.1" 200 None 2026-03-08 09:59:33,745 - lava_callback - DEBUG - Processing node 69ad445eed37758c525e241d: ltp-smoke 2026-03-08 09:59:34,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:59:34,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:59:34,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad445eed37758c525e241d/log.txt.gz 2026-03-08 09:59:34,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:59:34,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:59:34,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad445eed37758c525e241d/lava-logs.yaml 2026-03-08 09:59:34,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 09:59:35,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 09:59:35,097 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad445eed37758c525e241d/lava_callback.json.gz 2026-03-08 09:59:35,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:59:35,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad445eed37758c525e241d HTTP/1.1" 200 None 2026-03-08 09:59:35,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:59:35,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c1ed37758c525e15d9 HTTP/1.1" 200 None 2026-03-08 09:59:35,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 09:59:35,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad445eed37758c525e241d HTTP/1.1" 200 None 2026-03-08 09:59:35,466 - lava_callback - INFO - Completed processing callback for node 69ad445eed37758c525e241d INFO: 172.21.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:00:02,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:00:02,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:03:13,383 - lava_callback - INFO - Received callback for node 69ad44b2ed37758c525e2443 INFO: 172.21.0.1:38420 - "POST /node/69ad44b2ed37758c525e2443 HTTP/1.0" 202 Accepted 2026-03-08 10:03:13,392 - lava_callback - INFO - Starting async job submit for node 69ad44b2ed37758c525e2443 2026-03-08 10:03:13,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:03:13,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad44b2ed37758c525e2443 HTTP/1.1" 200 None 2026-03-08 10:03:13,449 - lava_callback - DEBUG - Processing node 69ad44b2ed37758c525e2443: baseline-nfs-arm64 2026-03-08 10:03:14,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:03:14,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:03:14,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad44b2ed37758c525e2443/log.txt.gz INFO: 172.21.0.1:38436 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-08 10:03:15,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:03:15,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:03:15,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad44b2ed37758c525e2443/lava-logs.yaml 2026-03-08 10:03:15,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:03:15,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:03:15,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad44b2ed37758c525e2443/lava_callback.json.gz DEBUG: Setup failed for 69ad44b2ed37758c525e2443. Transitting job node result: incomplete -> fail 2026-03-08 10:03:15,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:03:15,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad44b2ed37758c525e2443 HTTP/1.1" 200 None 2026-03-08 10:03:15,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:03:15,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 10:03:15,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:03:15,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad44b2ed37758c525e2443 HTTP/1.1" 200 None 2026-03-08 10:03:15,944 - lava_callback - INFO - Completed processing callback for node 69ad44b2ed37758c525e2443 INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:03:32,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:03:32,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:04:14,635 - lava_callback - INFO - Received callback for node 69ad4587ed37758c525e24ae INFO: 172.21.0.1:36868 - "POST /node/69ad4587ed37758c525e24ae HTTP/1.0" 202 Accepted 2026-03-08 10:04:14,643 - lava_callback - INFO - Starting async job submit for node 69ad4587ed37758c525e24ae 2026-03-08 10:04:14,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:04:14,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4587ed37758c525e24ae HTTP/1.1" 200 None 2026-03-08 10:04:14,716 - lava_callback - DEBUG - Processing node 69ad4587ed37758c525e24ae: baseline-arm INFO: 172.21.0.1:36880 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-08 10:04:15,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:04:15,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:04:15,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad4587ed37758c525e24ae/log.txt.gz 2026-03-08 10:04:15,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:04:16,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:04:16,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad4587ed37758c525e24ae/lava-logs.yaml 2026-03-08 10:04:16,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:04:16,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:04:16,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad4587ed37758c525e24ae/lava_callback.json.gz DEBUG: Setup failed for 69ad4587ed37758c525e24ae. Transitting job node result: incomplete -> fail 2026-03-08 10:04:16,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:04:16,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4587ed37758c525e24ae HTTP/1.1" 200 None 2026-03-08 10:04:16,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:04:16,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 10:04:16,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:04:16,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4587ed37758c525e24ae HTTP/1.1" 200 None 2026-03-08 10:04:16,635 - lava_callback - INFO - Completed processing callback for node 69ad4587ed37758c525e24ae INFO: 172.21.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:04:32,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:04:32,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET /node/69a805de7c78d2166ff86433%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:13:02,925 - lava_callback - INFO - Received callback for node 69aaa8ab76ddd5d9e606e613 INFO: 172.21.0.1:37896 - "POST /node/69aaa8ab76ddd5d9e606e613 HTTP/1.0" 202 Accepted 2026-03-08 10:13:02,930 - lava_callback - INFO - Starting async job submit for node 69aaa8ab76ddd5d9e606e613 2026-03-08 10:13:02,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:13:02,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa8ab76ddd5d9e606e613 HTTP/1.1" 200 None 2026-03-08 10:13:02,946 - lava_callback - DEBUG - Processing node 69aaa8ab76ddd5d9e606e613: baseline-arm64-baylibre 2026-03-08 10:13:02,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa8ab76ddd5d9e606e613 2026-03-08 10:13:02,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:13:02,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa8ab76ddd5d9e606e613 HTTP/1.1" 200 None 2026-03-08 10:13:02,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:13:02,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4938020dd22eabedb55 HTTP/1.1" 200 None 2026-03-08 10:13:02,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:13:03,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa8ab76ddd5d9e606e613 HTTP/1.1" 200 None 2026-03-08 10:13:03,016 - lava_callback - ERROR - Error processing callback for node 69aaa8ab76ddd5d9e606e613: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:16:18,600 - lava_callback - INFO - Received callback for node 69ad47d7ed37758c525e256e INFO: 172.21.0.1:50076 - "POST /node/69ad47d7ed37758c525e256e HTTP/1.0" 202 Accepted 2026-03-08 10:16:18,649 - lava_callback - INFO - Starting async job submit for node 69ad47d7ed37758c525e256e 2026-03-08 10:16:18,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:18,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad47d7ed37758c525e256e HTTP/1.1" 200 None 2026-03-08 10:16:18,688 - lava_callback - DEBUG - Processing node 69ad47d7ed37758c525e256e: baseline-arm-pengutronix 2026-03-08 10:16:18,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:16:18,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:16:18,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad47d7ed37758c525e256e/log.txt.gz 2026-03-08 10:16:18,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:16:19,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:16:19,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad47d7ed37758c525e256e/lava-logs.yaml 2026-03-08 10:16:19,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:16:19,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:16:19,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad47d7ed37758c525e256e/lava_callback.json.gz DEBUG: Setup failed for 69ad47d7ed37758c525e256e. Transitting job node result: incomplete -> fail 2026-03-08 10:16:19,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:19,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad47d7ed37758c525e256e HTTP/1.1" 200 None 2026-03-08 10:16:19,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:19,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 10:16:19,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:19,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad47d7ed37758c525e256e HTTP/1.1" 200 None 2026-03-08 10:16:19,490 - lava_callback - INFO - Completed processing callback for node 69ad47d7ed37758c525e256e INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:16:32,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:16:43,040 - lava_callback - INFO - Received callback for node 69aaa98976ddd5d9e606e646 INFO: 172.21.0.1:55512 - "POST /node/69aaa98976ddd5d9e606e646 HTTP/1.0" 202 Accepted 2026-03-08 10:16:43,045 - lava_callback - INFO - Starting async job submit for node 69aaa98976ddd5d9e606e646 2026-03-08 10:16:43,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:43,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa98976ddd5d9e606e646 HTTP/1.1" 200 None 2026-03-08 10:16:43,061 - lava_callback - DEBUG - Processing node 69aaa98976ddd5d9e606e646: baseline-arm64-baylibre 2026-03-08 10:16:43,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaa98976ddd5d9e606e646 2026-03-08 10:16:43,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:43,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaa98976ddd5d9e606e646 HTTP/1.1" 200 None 2026-03-08 10:16:43,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:43,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4938020dd22eabedb55 HTTP/1.1" 200 None 2026-03-08 10:16:43,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:16:43,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaa98976ddd5d9e606e646 HTTP/1.1" 200 None 2026-03-08 10:16:43,122 - lava_callback - ERROR - Error processing callback for node 69aaa98976ddd5d9e606e646: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:18:35,362 - lava_callback - INFO - Received callback for node 69ad483ded37758c525e2597 INFO: 172.21.0.1:56780 - "POST /node/69ad483ded37758c525e2597 HTTP/1.0" 202 Accepted 2026-03-08 10:18:35,369 - lava_callback - INFO - Starting async job submit for node 69ad483ded37758c525e2597 2026-03-08 10:18:35,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:18:35,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad483ded37758c525e2597 HTTP/1.1" 200 None 2026-03-08 10:18:35,428 - lava_callback - DEBUG - Processing node 69ad483ded37758c525e2597: baseline-arm64 2026-03-08 10:18:35,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:18:35,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:18:35,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad483ded37758c525e2597/log.txt.gz 2026-03-08 10:18:36,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:18:36,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:18:36,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad483ded37758c525e2597/lava-logs.yaml 2026-03-08 10:18:36,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:18:36,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:18:36,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad483ded37758c525e2597/lava_callback.json.gz DEBUG: Setup failed for 69ad483ded37758c525e2597. Transitting job node result: incomplete -> fail 2026-03-08 10:18:36,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:18:36,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad483ded37758c525e2597 HTTP/1.1" 200 None 2026-03-08 10:18:36,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:18:36,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 10:18:36,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:18:36,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad483ded37758c525e2597 HTTP/1.1" 200 None 2026-03-08 10:18:36,805 - lava_callback - INFO - Completed processing callback for node 69ad483ded37758c525e2597 INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:19:02,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:19:02,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:21:10,740 - lava_callback - INFO - Received callback for node 69ad4a45ed37758c525e2651 INFO: 172.21.0.1:55136 - "POST /node/69ad4a45ed37758c525e2651 HTTP/1.0" 202 Accepted 2026-03-08 10:21:10,746 - lava_callback - INFO - Starting async job submit for node 69ad4a45ed37758c525e2651 2026-03-08 10:21:10,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:21:10,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4a45ed37758c525e2651 HTTP/1.1" 200 None 2026-03-08 10:21:10,821 - lava_callback - DEBUG - Processing node 69ad4a45ed37758c525e2651: baseline-arm 2026-03-08 10:21:11,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:21:11,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:21:11,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ad4a45ed37758c525e2651/log.txt.gz 2026-03-08 10:21:11,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:21:11,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:21:11,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ad4a45ed37758c525e2651/lava-logs.yaml 2026-03-08 10:21:11,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:21:12,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:21:12,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ad4a45ed37758c525e2651/lava_callback.json.gz DEBUG: Setup failed for 69ad4a45ed37758c525e2651. Transitting job node result: incomplete -> fail 2026-03-08 10:21:12,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:21:12,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4a45ed37758c525e2651 HTTP/1.1" 200 None 2026-03-08 10:21:12,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:21:12,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 10:21:12,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:21:12,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4a45ed37758c525e2651 HTTP/1.1" 200 None 2026-03-08 10:21:12,480 - lava_callback - INFO - Completed processing callback for node 69ad4a45ed37758c525e2651 INFO: 172.21.0.1:55148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:21:32,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:21:32,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:22:43,388 - lava_callback - INFO - Received callback for node 69aaaae776ddd5d9e606e697 INFO: 172.21.0.1:59240 - "POST /node/69aaaae776ddd5d9e606e697 HTTP/1.0" 202 Accepted 2026-03-08 10:22:43,393 - lava_callback - INFO - Starting async job submit for node 69aaaae776ddd5d9e606e697 2026-03-08 10:22:43,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:22:43,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaaae776ddd5d9e606e697 HTTP/1.1" 200 None 2026-03-08 10:22:43,416 - lava_callback - DEBUG - Processing node 69aaaae776ddd5d9e606e697: baseline-arm64-baylibre 2026-03-08 10:22:43,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaaae776ddd5d9e606e697 2026-03-08 10:22:43,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:22:43,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaaae776ddd5d9e606e697 HTTP/1.1" 200 None 2026-03-08 10:22:43,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:22:43,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4938020dd22eabedb55 HTTP/1.1" 200 None 2026-03-08 10:22:43,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:22:43,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaaae776ddd5d9e606e697 HTTP/1.1" 200 None 2026-03-08 10:22:43,477 - lava_callback - ERROR - Error processing callback for node 69aaaae776ddd5d9e606e697: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:23:14,081 - lava_callback - INFO - Received callback for node 69ad49f9ed37758c525e2637 INFO: 172.21.0.1:57300 - "POST /node/69ad49f9ed37758c525e2637 HTTP/1.0" 202 Accepted 2026-03-08 10:23:14,088 - lava_callback - INFO - Starting async job submit for node 69ad49f9ed37758c525e2637 2026-03-08 10:23:14,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:23:14,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad49f9ed37758c525e2637 HTTP/1.1" 200 None 2026-03-08 10:23:14,190 - lava_callback - DEBUG - Processing node 69ad49f9ed37758c525e2637: ltp-smoke 2026-03-08 10:23:14,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:23:14,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:23:14,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad49f9ed37758c525e2637/log.txt.gz INFO: 172.21.0.1:57308 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-08 10:23:15,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:23:15,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:23:15,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad49f9ed37758c525e2637/lava-logs.yaml 2026-03-08 10:23:15,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:23:15,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:23:15,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ad49f9ed37758c525e2637/lava_callback.json.gz 2026-03-08 10:23:15,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:23:15,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad49f9ed37758c525e2637 HTTP/1.1" 200 None 2026-03-08 10:23:15,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:23:15,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c1ed37758c525e15d9 HTTP/1.1" 200 None 2026-03-08 10:23:15,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:23:15,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad49f9ed37758c525e2637 HTTP/1.1" 200 None 2026-03-08 10:23:15,952 - lava_callback - INFO - Completed processing callback for node 69ad49f9ed37758c525e2637 INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:23:32,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:23:32,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:25:53,210 - lava_callback - INFO - Received callback for node 69ad4a01ed37758c525e263a INFO: 172.21.0.1:59042 - "POST /node/69ad4a01ed37758c525e263a HTTP/1.0" 202 Accepted 2026-03-08 10:25:53,217 - lava_callback - INFO - Starting async job submit for node 69ad4a01ed37758c525e263a 2026-03-08 10:25:53,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:25:53,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4a01ed37758c525e263a HTTP/1.1" 200 None 2026-03-08 10:25:53,296 - lava_callback - DEBUG - Processing node 69ad4a01ed37758c525e263a: baseline-nfs-arm64 2026-03-08 10:25:54,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:25:54,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:25:54,518 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad4a01ed37758c525e263a/log.txt.gz 2026-03-08 10:25:55,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:25:55,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:25:55,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad4a01ed37758c525e263a/lava-logs.yaml 2026-03-08 10:25:55,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:25:55,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:25:55,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad4a01ed37758c525e263a/lava_callback.json.gz DEBUG: Setup failed for 69ad4a01ed37758c525e263a. Transitting job node result: incomplete -> fail 2026-03-08 10:25:55,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:25:55,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4a01ed37758c525e263a HTTP/1.1" 200 None 2026-03-08 10:25:55,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:25:55,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 10:25:55,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:25:55,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4a01ed37758c525e263a HTTP/1.1" 200 None 2026-03-08 10:25:55,956 - lava_callback - INFO - Completed processing callback for node 69ad4a01ed37758c525e263a INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:26:02,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:02,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:26:34,296 - lava_callback - INFO - Received callback for node 69ad474aed37758c525e2541 INFO: 172.21.0.1:52974 - "POST /node/69ad474aed37758c525e2541 HTTP/1.0" 202 Accepted 2026-03-08 10:26:34,303 - lava_callback - INFO - Starting async job submit for node 69ad474aed37758c525e2541 2026-03-08 10:26:34,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:34,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad474aed37758c525e2541 HTTP/1.1" 200 None 2026-03-08 10:26:34,357 - lava_callback - DEBUG - Processing node 69ad474aed37758c525e2541: baseline-arm64-broonie 2026-03-08 10:26:34,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:26:34,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:26:34,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad474aed37758c525e2541/log.txt.gz 2026-03-08 10:26:34,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:26:35,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:26:35,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad474aed37758c525e2541/lava-logs.yaml 2026-03-08 10:26:35,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:26:35,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:26:35,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad474aed37758c525e2541/lava_callback.json.gz 2026-03-08 10:26:35,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:35,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad474aed37758c525e2541 HTTP/1.1" 200 None 2026-03-08 10:26:35,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:35,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 10:26:35,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:35,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad474aed37758c525e2541 HTTP/1.1" 200 None 2026-03-08 10:26:35,533 - lava_callback - INFO - Completed processing callback for node 69ad474aed37758c525e2541 INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:26:43,609 - lava_callback - INFO - Received callback for node 69aaabd176ddd5d9e606e718 INFO: 172.21.0.1:53730 - "POST /node/69aaabd176ddd5d9e606e718 HTTP/1.0" 202 Accepted 2026-03-08 10:26:43,615 - lava_callback - INFO - Starting async job submit for node 69aaabd176ddd5d9e606e718 2026-03-08 10:26:43,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:43,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaabd176ddd5d9e606e718 HTTP/1.1" 200 None 2026-03-08 10:26:43,633 - lava_callback - DEBUG - Processing node 69aaabd176ddd5d9e606e718: baseline-arm64-baylibre 2026-03-08 10:26:43,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaabd176ddd5d9e606e718 2026-03-08 10:26:43,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:43,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaabd176ddd5d9e606e718 HTTP/1.1" 200 None 2026-03-08 10:26:43,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:43,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4938020dd22eabedb55 HTTP/1.1" 200 None 2026-03-08 10:26:43,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:26:43,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaabd176ddd5d9e606e718 HTTP/1.1" 200 None 2026-03-08 10:26:43,694 - lava_callback - ERROR - Error processing callback for node 69aaabd176ddd5d9e606e718: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:27:02,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:27:02,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:28:03,744 - lava_callback - INFO - Received callback for node 69aaac2176ddd5d9e606e737 INFO: 172.21.0.1:55892 - "POST /node/69aaac2176ddd5d9e606e737 HTTP/1.0" 202 Accepted 2026-03-08 10:28:03,749 - lava_callback - INFO - Starting async job submit for node 69aaac2176ddd5d9e606e737 2026-03-08 10:28:03,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:28:03,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaac2176ddd5d9e606e737 HTTP/1.1" 200 None 2026-03-08 10:28:03,766 - lava_callback - DEBUG - Processing node 69aaac2176ddd5d9e606e737: baseline-arm64-baylibre 2026-03-08 10:28:03,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaac2176ddd5d9e606e737 2026-03-08 10:28:03,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:28:03,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaac2176ddd5d9e606e737 HTTP/1.1" 200 None 2026-03-08 10:28:03,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:28:03,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4938020dd22eabedb55 HTTP/1.1" 200 None 2026-03-08 10:28:03,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:28:03,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaac2176ddd5d9e606e737 HTTP/1.1" 200 None 2026-03-08 10:28:03,836 - lava_callback - ERROR - Error processing callback for node 69aaac2176ddd5d9e606e737: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:29:03,683 - lava_callback - INFO - Received callback for node 69aaac6a76ddd5d9e606e746 INFO: 172.21.0.1:36730 - "POST /node/69aaac6a76ddd5d9e606e746 HTTP/1.0" 202 Accepted 2026-03-08 10:29:03,689 - lava_callback - INFO - Starting async job submit for node 69aaac6a76ddd5d9e606e746 2026-03-08 10:29:03,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:29:03,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaac6a76ddd5d9e606e746 HTTP/1.1" 200 None 2026-03-08 10:29:03,704 - lava_callback - DEBUG - Processing node 69aaac6a76ddd5d9e606e746: baseline-arm64-baylibre 2026-03-08 10:29:03,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaac6a76ddd5d9e606e746 2026-03-08 10:29:03,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:29:03,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaac6a76ddd5d9e606e746 HTTP/1.1" 200 None 2026-03-08 10:29:03,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:29:03,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-08 10:29:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:29:03,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaac6a76ddd5d9e606e746 HTTP/1.1" 200 None 2026-03-08 10:29:03,757 - lava_callback - ERROR - Error processing callback for node 69aaac6a76ddd5d9e606e746: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:30:23,817 - lava_callback - INFO - Received callback for node 69aaacbb76ddd5d9e606e76f INFO: 172.21.0.1:59012 - "POST /node/69aaacbb76ddd5d9e606e76f HTTP/1.0" 202 Accepted 2026-03-08 10:30:23,822 - lava_callback - INFO - Starting async job submit for node 69aaacbb76ddd5d9e606e76f 2026-03-08 10:30:23,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:30:23,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaacbb76ddd5d9e606e76f HTTP/1.1" 200 None 2026-03-08 10:30:23,838 - lava_callback - DEBUG - Processing node 69aaacbb76ddd5d9e606e76f: baseline-arm64-baylibre 2026-03-08 10:30:23,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaacbb76ddd5d9e606e76f 2026-03-08 10:30:23,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:30:23,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaacbb76ddd5d9e606e76f HTTP/1.1" 200 None 2026-03-08 10:30:23,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:30:23,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-08 10:30:23,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:30:23,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaacbb76ddd5d9e606e76f HTTP/1.1" 200 None 2026-03-08 10:30:23,896 - lava_callback - ERROR - Error processing callback for node 69aaacbb76ddd5d9e606e76f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:31:43,935 - lava_callback - INFO - Received callback for node 69aaad0c76ddd5d9e606e789 INFO: 172.21.0.1:44970 - "POST /node/69aaad0c76ddd5d9e606e789 HTTP/1.0" 202 Accepted 2026-03-08 10:31:43,941 - lava_callback - INFO - Starting async job submit for node 69aaad0c76ddd5d9e606e789 2026-03-08 10:31:43,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:31:43,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaad0c76ddd5d9e606e789 HTTP/1.1" 200 None 2026-03-08 10:31:43,958 - lava_callback - DEBUG - Processing node 69aaad0c76ddd5d9e606e789: baseline-arm64-baylibre 2026-03-08 10:31:43,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaad0c76ddd5d9e606e789 2026-03-08 10:31:43,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:31:43,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaad0c76ddd5d9e606e789 HTTP/1.1" 200 None 2026-03-08 10:31:43,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:31:44,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4938020dd22eabedb55 HTTP/1.1" 200 None 2026-03-08 10:31:44,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:31:44,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaad0c76ddd5d9e606e789 HTTP/1.1" 200 None 2026-03-08 10:31:44,065 - lava_callback - ERROR - Error processing callback for node 69aaad0c76ddd5d9e606e789: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:33:03,967 - lava_callback - INFO - Received callback for node 69aaad5576ddd5d9e606e7a9 INFO: 172.21.0.1:58642 - "POST /node/69aaad5576ddd5d9e606e7a9 HTTP/1.0" 202 Accepted 2026-03-08 10:33:03,972 - lava_callback - INFO - Starting async job submit for node 69aaad5576ddd5d9e606e7a9 2026-03-08 10:33:03,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:33:03,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaad5576ddd5d9e606e7a9 HTTP/1.1" 200 None 2026-03-08 10:33:03,988 - lava_callback - DEBUG - Processing node 69aaad5576ddd5d9e606e7a9: baseline-arm64-baylibre 2026-03-08 10:33:03,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaad5576ddd5d9e606e7a9 2026-03-08 10:33:03,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:33:04,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaad5576ddd5d9e606e7a9 HTTP/1.1" 200 None 2026-03-08 10:33:04,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:33:04,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-08 10:33:04,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:33:04,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaad5576ddd5d9e606e7a9 HTTP/1.1" 200 None 2026-03-08 10:33:04,041 - lava_callback - ERROR - Error processing callback for node 69aaad5576ddd5d9e606e7a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:34:24,103 - lava_callback - INFO - Received callback for node 69aaada676ddd5d9e606e7c9 INFO: 172.21.0.1:39252 - "POST /node/69aaada676ddd5d9e606e7c9 HTTP/1.0" 202 Accepted 2026-03-08 10:34:24,109 - lava_callback - INFO - Starting async job submit for node 69aaada676ddd5d9e606e7c9 2026-03-08 10:34:24,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:34:24,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaada676ddd5d9e606e7c9 HTTP/1.1" 200 None 2026-03-08 10:34:24,128 - lava_callback - DEBUG - Processing node 69aaada676ddd5d9e606e7c9: baseline-arm64-baylibre 2026-03-08 10:34:24,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaada676ddd5d9e606e7c9 2026-03-08 10:34:24,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:34:24,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaada676ddd5d9e606e7c9 HTTP/1.1" 200 None 2026-03-08 10:34:24,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:34:24,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-08 10:34:24,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:34:24,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaada676ddd5d9e606e7c9 HTTP/1.1" 200 None 2026-03-08 10:34:24,185 - lava_callback - ERROR - Error processing callback for node 69aaada676ddd5d9e606e7c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:35:59,558 - lava_callback - INFO - Received callback for node 69ad4c80ed37758c525e26cf INFO: 172.21.0.1:54686 - "POST /node/69ad4c80ed37758c525e26cf HTTP/1.0" 202 Accepted 2026-03-08 10:35:59,605 - lava_callback - INFO - Starting async job submit for node 69ad4c80ed37758c525e26cf 2026-03-08 10:35:59,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:35:59,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4c80ed37758c525e26cf HTTP/1.1" 200 None 2026-03-08 10:35:59,649 - lava_callback - DEBUG - Processing node 69ad4c80ed37758c525e26cf: baseline-arm-pengutronix 2026-03-08 10:35:59,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:35:59,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:35:59,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad4c80ed37758c525e26cf/log.txt.gz 2026-03-08 10:36:00,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:36:00,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:36:00,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad4c80ed37758c525e26cf/lava-logs.yaml 2026-03-08 10:36:00,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:36:00,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:36:00,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ad4c80ed37758c525e26cf/lava_callback.json.gz DEBUG: Setup failed for 69ad4c80ed37758c525e26cf. Transitting job node result: incomplete -> fail 2026-03-08 10:36:00,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:36:00,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4c80ed37758c525e26cf HTTP/1.1" 200 None 2026-03-08 10:36:00,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:36:00,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30bced37758c525e15d2 HTTP/1.1" 200 None 2026-03-08 10:36:00,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:36:00,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4c80ed37758c525e26cf HTTP/1.1" 200 None 2026-03-08 10:36:00,557 - lava_callback - INFO - Completed processing callback for node 69ad4c80ed37758c525e26cf 2026-03-08 10:36:02,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:36:02,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:37:04,158 - lava_callback - INFO - Received callback for node 69aaae4276ddd5d9e606e7ed INFO: 172.21.0.1:40798 - "POST /node/69aaae4276ddd5d9e606e7ed HTTP/1.0" 202 Accepted 2026-03-08 10:37:04,163 - lava_callback - INFO - Starting async job submit for node 69aaae4276ddd5d9e606e7ed 2026-03-08 10:37:04,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:37:04,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaae4276ddd5d9e606e7ed HTTP/1.1" 200 None 2026-03-08 10:37:04,189 - lava_callback - DEBUG - Processing node 69aaae4276ddd5d9e606e7ed: baseline-arm64-baylibre 2026-03-08 10:37:04,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaae4276ddd5d9e606e7ed 2026-03-08 10:37:04,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:37:04,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaae4276ddd5d9e606e7ed HTTP/1.1" 200 None 2026-03-08 10:37:04,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:37:04,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-08 10:37:04,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:37:04,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaae4276ddd5d9e606e7ed HTTP/1.1" 200 None 2026-03-08 10:37:04,278 - lava_callback - ERROR - Error processing callback for node 69aaae4276ddd5d9e606e7ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET /node/698c598c755d7811a4141f6d%5Cn HTTP/1.0" 405 Method Not Allowed 2026-03-08 10:38:24,252 - lava_callback - INFO - Received callback for node 69aaae9076ddd5d9e606e809 INFO: 172.21.0.1:53830 - "POST /node/69aaae9076ddd5d9e606e809 HTTP/1.0" 202 Accepted 2026-03-08 10:38:24,257 - lava_callback - INFO - Starting async job submit for node 69aaae9076ddd5d9e606e809 2026-03-08 10:38:24,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:38:24,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaae9076ddd5d9e606e809 HTTP/1.1" 200 None 2026-03-08 10:38:24,281 - lava_callback - DEBUG - Processing node 69aaae9076ddd5d9e606e809: baseline-arm64-baylibre 2026-03-08 10:38:24,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaae9076ddd5d9e606e809 2026-03-08 10:38:24,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:38:24,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaae9076ddd5d9e606e809 HTTP/1.1" 200 None 2026-03-08 10:38:24,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:38:24,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-08 10:38:24,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:38:24,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaae9076ddd5d9e606e809 HTTP/1.1" 200 None 2026-03-08 10:38:24,370 - lava_callback - ERROR - Error processing callback for node 69aaae9076ddd5d9e606e809: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50022 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:45:47,808 - lava_callback - INFO - Received callback for node 69ad4ebced37758c525e2769 INFO: 172.21.0.1:50034 - "POST /node/69ad4ebced37758c525e2769 HTTP/1.0" 202 Accepted 2026-03-08 10:45:47,816 - lava_callback - INFO - Starting async job submit for node 69ad4ebced37758c525e2769 2026-03-08 10:45:47,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:45:47,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4ebced37758c525e2769 HTTP/1.1" 200 None 2026-03-08 10:45:47,875 - lava_callback - DEBUG - Processing node 69ad4ebced37758c525e2769: baseline-nfs-arm64 2026-03-08 10:45:48,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:45:49,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:45:49,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad4ebced37758c525e2769/log.txt.gz 2026-03-08 10:45:49,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:45:49,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:45:49,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad4ebced37758c525e2769/lava-logs.yaml 2026-03-08 10:45:49,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:45:50,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:45:50,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ad4ebced37758c525e2769/lava_callback.json.gz DEBUG: Setup failed for 69ad4ebced37758c525e2769. Transitting job node result: incomplete -> fail 2026-03-08 10:45:50,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:45:50,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4ebced37758c525e2769 HTTP/1.1" 200 None 2026-03-08 10:45:50,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:45:50,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 10:45:50,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:45:50,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4ebced37758c525e2769 HTTP/1.1" 200 None 2026-03-08 10:45:50,412 - lava_callback - INFO - Completed processing callback for node 69ad4ebced37758c525e2769 INFO: 172.21.0.1:58892 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:46:02,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:46:02,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33086 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:58:34,970 - lava_callback - INFO - Received callback for node 69ad4f11ed37758c525e2796 INFO: 172.21.0.1:53912 - "POST /node/69ad4f11ed37758c525e2796 HTTP/1.0" 202 Accepted 2026-03-08 10:58:34,976 - lava_callback - INFO - Starting async job submit for node 69ad4f11ed37758c525e2796 2026-03-08 10:58:34,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:58:35,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4f11ed37758c525e2796 HTTP/1.1" 200 None 2026-03-08 10:58:35,012 - lava_callback - DEBUG - Processing node 69ad4f11ed37758c525e2796: baseline-arm64-broonie 2026-03-08 10:58:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:58:35,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:58:35,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad4f11ed37758c525e2796/log.txt.gz 2026-03-08 10:58:35,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:58:35,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:58:35,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad4f11ed37758c525e2796/lava-logs.yaml 2026-03-08 10:58:35,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 10:58:35,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 10:58:35,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad4f11ed37758c525e2796/lava_callback.json.gz 2026-03-08 10:58:35,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:58:35,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad4f11ed37758c525e2796 HTTP/1.1" 200 None 2026-03-08 10:58:35,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:58:35,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 10:58:35,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:58:35,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad4f11ed37758c525e2796 HTTP/1.1" 200 None 2026-03-08 10:58:35,692 - lava_callback - INFO - Completed processing callback for node 69ad4f11ed37758c525e2796 INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK 2026-03-08 10:59:02,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 10:59:02,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:00:59,842 - lava_callback - INFO - Received callback for node 69aab3e576ddd5d9e606ea0d INFO: 172.21.0.1:59174 - "POST /node/69aab3e576ddd5d9e606ea0d HTTP/1.0" 202 Accepted 2026-03-08 11:00:59,848 - lava_callback - INFO - Starting async job submit for node 69aab3e576ddd5d9e606ea0d 2026-03-08 11:00:59,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:00:59,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab3e576ddd5d9e606ea0d HTTP/1.1" 200 None 2026-03-08 11:00:59,867 - lava_callback - DEBUG - Processing node 69aab3e576ddd5d9e606ea0d: baseline-arm-clabbe 2026-03-08 11:00:59,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aab3e576ddd5d9e606ea0d 2026-03-08 11:00:59,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:00:59,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab3e576ddd5d9e606ea0d HTTP/1.1" 200 None 2026-03-08 11:00:59,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:00:59,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-08 11:00:59,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:00:59,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aab3e576ddd5d9e606ea0d HTTP/1.1" 200 None 2026-03-08 11:00:59,939 - lava_callback - ERROR - Error processing callback for node 69aab3e576ddd5d9e606ea0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:01:39,829 - lava_callback - INFO - Received callback for node 69aab40776ddd5d9e606ea24 INFO: 172.21.0.1:36056 - "POST /node/69aab40776ddd5d9e606ea24 HTTP/1.0" 202 Accepted 2026-03-08 11:01:39,835 - lava_callback - INFO - Starting async job submit for node 69aab40776ddd5d9e606ea24 2026-03-08 11:01:39,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:01:39,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab40776ddd5d9e606ea24 HTTP/1.1" 200 None 2026-03-08 11:01:39,864 - lava_callback - DEBUG - Processing node 69aab40776ddd5d9e606ea24: baseline-arm-clabbe 2026-03-08 11:01:39,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aab40776ddd5d9e606ea24 2026-03-08 11:01:39,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:01:39,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab40776ddd5d9e606ea24 HTTP/1.1" 200 None 2026-03-08 11:01:39,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:01:39,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-08 11:01:39,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:01:39,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aab40776ddd5d9e606ea24 HTTP/1.1" 200 None 2026-03-08 11:01:39,924 - lava_callback - ERROR - Error processing callback for node 69aab40776ddd5d9e606ea24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:02:19,857 - lava_callback - INFO - Received callback for node 69aab42876ddd5d9e606ea3b INFO: 172.21.0.1:40074 - "POST /node/69aab42876ddd5d9e606ea3b HTTP/1.0" 202 Accepted 2026-03-08 11:02:19,862 - lava_callback - INFO - Starting async job submit for node 69aab42876ddd5d9e606ea3b 2026-03-08 11:02:19,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:02:19,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab42876ddd5d9e606ea3b HTTP/1.1" 200 None 2026-03-08 11:02:19,878 - lava_callback - DEBUG - Processing node 69aab42876ddd5d9e606ea3b: baseline-arm-clabbe 2026-03-08 11:02:19,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aab42876ddd5d9e606ea3b 2026-03-08 11:02:19,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:02:19,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab42876ddd5d9e606ea3b HTTP/1.1" 200 None 2026-03-08 11:02:19,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:02:19,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-08 11:02:19,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:02:19,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aab42876ddd5d9e606ea3b HTTP/1.1" 200 None 2026-03-08 11:02:19,942 - lava_callback - ERROR - Error processing callback for node 69aab42876ddd5d9e606ea3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47972 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39240 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:14:46,237 - lava_callback - INFO - Received callback for node 69aab72276ddd5d9e606eb10 INFO: 172.21.0.1:51362 - "POST /node/69aab72276ddd5d9e606eb10 HTTP/1.0" 202 Accepted 2026-03-08 11:14:46,242 - lava_callback - INFO - Starting async job submit for node 69aab72276ddd5d9e606eb10 2026-03-08 11:14:46,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:14:46,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab72276ddd5d9e606eb10 HTTP/1.1" 200 None 2026-03-08 11:14:46,258 - lava_callback - DEBUG - Processing node 69aab72276ddd5d9e606eb10: baseline-arm64-baylibre 2026-03-08 11:14:46,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aab72276ddd5d9e606eb10 2026-03-08 11:14:46,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:14:46,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab72276ddd5d9e606eb10 HTTP/1.1" 200 None 2026-03-08 11:14:46,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:14:46,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-08 11:14:46,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:14:46,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aab72276ddd5d9e606eb10 HTTP/1.1" 200 None 2026-03-08 11:14:46,324 - lava_callback - ERROR - Error processing callback for node 69aab72276ddd5d9e606eb10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:21:00,600 - lava_callback - INFO - Received callback for node 69aab89176ddd5d9e606eb5b INFO: 172.21.0.1:53466 - "POST /node/69aab89176ddd5d9e606eb5b HTTP/1.0" 202 Accepted 2026-03-08 11:21:00,606 - lava_callback - INFO - Starting async job submit for node 69aab89176ddd5d9e606eb5b 2026-03-08 11:21:00,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:21:00,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab89176ddd5d9e606eb5b HTTP/1.1" 200 None 2026-03-08 11:21:00,627 - lava_callback - DEBUG - Processing node 69aab89176ddd5d9e606eb5b: baseline-arm64-clabbe 2026-03-08 11:21:00,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aab89176ddd5d9e606eb5b 2026-03-08 11:21:00,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:21:00,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab89176ddd5d9e606eb5b HTTP/1.1" 200 None 2026-03-08 11:21:00,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:21:00,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-08 11:21:00,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:21:00,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aab89176ddd5d9e606eb5b HTTP/1.1" 200 None 2026-03-08 11:21:00,680 - lava_callback - ERROR - Error processing callback for node 69aab89176ddd5d9e606eb5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:22:06,669 - lava_callback - INFO - Received callback for node 69aab8d376ddd5d9e606eb6f INFO: 172.21.0.1:50568 - "POST /node/69aab8d376ddd5d9e606eb6f HTTP/1.0" 202 Accepted 2026-03-08 11:22:06,674 - lava_callback - INFO - Starting async job submit for node 69aab8d376ddd5d9e606eb6f 2026-03-08 11:22:06,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:22:06,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab8d376ddd5d9e606eb6f HTTP/1.1" 200 None 2026-03-08 11:22:06,708 - lava_callback - DEBUG - Processing node 69aab8d376ddd5d9e606eb6f: baseline-arm64-baylibre 2026-03-08 11:22:06,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aab8d376ddd5d9e606eb6f 2026-03-08 11:22:06,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:22:06,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab8d376ddd5d9e606eb6f HTTP/1.1" 200 None 2026-03-08 11:22:06,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:22:06,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-08 11:22:06,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:22:06,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aab8d376ddd5d9e606eb6f HTTP/1.1" 200 None 2026-03-08 11:22:06,783 - lava_callback - ERROR - Error processing callback for node 69aab8d376ddd5d9e606eb6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52528 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:26:46,987 - lava_callback - INFO - Received callback for node 69aab9e476ddd5d9e606ebb5 INFO: 172.21.0.1:52540 - "POST /node/69aab9e476ddd5d9e606ebb5 HTTP/1.0" 202 Accepted 2026-03-08 11:26:46,992 - lava_callback - INFO - Starting async job submit for node 69aab9e476ddd5d9e606ebb5 2026-03-08 11:26:46,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:26:47,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab9e476ddd5d9e606ebb5 HTTP/1.1" 200 None 2026-03-08 11:26:47,013 - lava_callback - DEBUG - Processing node 69aab9e476ddd5d9e606ebb5: baseline-arm64-baylibre 2026-03-08 11:26:47,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aab9e476ddd5d9e606ebb5 2026-03-08 11:26:47,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:26:47,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aab9e476ddd5d9e606ebb5 HTTP/1.1" 200 None 2026-03-08 11:26:47,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:26:47,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-08 11:26:47,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:26:47,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aab9e476ddd5d9e606ebb5 HTTP/1.1" 200 None 2026-03-08 11:26:47,078 - lava_callback - ERROR - Error processing callback for node 69aab9e476ddd5d9e606ebb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:29:07,163 - lava_callback - INFO - Received callback for node 69aaba7776ddd5d9e606ebe6 INFO: 172.21.0.1:50578 - "POST /node/69aaba7776ddd5d9e606ebe6 HTTP/1.0" 202 Accepted 2026-03-08 11:29:07,169 - lava_callback - INFO - Starting async job submit for node 69aaba7776ddd5d9e606ebe6 2026-03-08 11:29:07,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:29:07,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaba7776ddd5d9e606ebe6 HTTP/1.1" 200 None 2026-03-08 11:29:07,197 - lava_callback - DEBUG - Processing node 69aaba7776ddd5d9e606ebe6: baseline-arm64-baylibre 2026-03-08 11:29:07,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaba7776ddd5d9e606ebe6 2026-03-08 11:29:07,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:29:07,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaba7776ddd5d9e606ebe6 HTTP/1.1" 200 None 2026-03-08 11:29:07,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:29:07,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-08 11:29:07,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:29:07,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaba7776ddd5d9e606ebe6 HTTP/1.1" 200 None 2026-03-08 11:29:07,267 - lava_callback - ERROR - Error processing callback for node 69aaba7776ddd5d9e606ebe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:30:36,221 - lava_callback - INFO - Received callback for node 69ad569eed37758c525e298c INFO: 172.21.0.1:51014 - "POST /node/69ad569eed37758c525e298c HTTP/1.0" 202 Accepted 2026-03-08 11:30:36,226 - lava_callback - INFO - Starting async job submit for node 69ad569eed37758c525e298c 2026-03-08 11:30:36,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:30:36,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad569eed37758c525e298c HTTP/1.1" 200 None 2026-03-08 11:30:36,287 - lava_callback - DEBUG - Processing node 69ad569eed37758c525e298c: baseline-arm64-broonie 2026-03-08 11:30:36,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:30:36,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 11:30:36,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad569eed37758c525e298c/log.txt.gz 2026-03-08 11:30:36,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 11:30:36,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 11:30:36,728 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad569eed37758c525e298c/lava-logs.yaml 2026-03-08 11:30:36,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 11:30:36,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 11:30:36,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ad569eed37758c525e298c/lava_callback.json.gz 2026-03-08 11:30:36,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:30:36,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad569eed37758c525e298c HTTP/1.1" 200 None 2026-03-08 11:30:36,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:30:36,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 11:30:36,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:30:36,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad569eed37758c525e298c HTTP/1.1" 200 None 2026-03-08 11:30:36,992 - lava_callback - INFO - Completed processing callback for node 69ad569eed37758c525e298c INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK 2026-03-08 11:31:02,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 11:31:02,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK 2026-03-08 12:41:24,055 - lava_callback - INFO - Received callback for node 69aacb6976ddd5d9e606efd8 INFO: 172.21.0.1:42276 - "POST /node/69aacb6976ddd5d9e606efd8 HTTP/1.0" 202 Accepted 2026-03-08 12:41:24,061 - lava_callback - INFO - Starting async job submit for node 69aacb6976ddd5d9e606efd8 2026-03-08 12:41:24,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:41:24,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aacb6976ddd5d9e606efd8 HTTP/1.1" 200 None 2026-03-08 12:41:24,084 - lava_callback - DEBUG - Processing node 69aacb6976ddd5d9e606efd8: baseline-arm-clabbe 2026-03-08 12:41:24,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aacb6976ddd5d9e606efd8 2026-03-08 12:41:24,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:41:24,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aacb6976ddd5d9e606efd8 HTTP/1.1" 200 None 2026-03-08 12:41:24,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:41:24,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-08 12:41:24,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:41:24,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aacb6976ddd5d9e606efd8 HTTP/1.1" 200 None 2026-03-08 12:41:24,165 - lava_callback - ERROR - Error processing callback for node 69aacb6976ddd5d9e606efd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET / HTTP/1.0" 200 OK 2026-03-08 12:43:04,192 - lava_callback - INFO - Received callback for node 69aacbd276ddd5d9e606f008 INFO: 172.21.0.1:35542 - "POST /node/69aacbd276ddd5d9e606f008 HTTP/1.0" 202 Accepted 2026-03-08 12:43:04,197 - lava_callback - INFO - Starting async job submit for node 69aacbd276ddd5d9e606f008 2026-03-08 12:43:04,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:43:04,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aacbd276ddd5d9e606f008 HTTP/1.1" 200 None 2026-03-08 12:43:04,213 - lava_callback - DEBUG - Processing node 69aacbd276ddd5d9e606f008: baseline-arm-clabbe 2026-03-08 12:43:04,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aacbd276ddd5d9e606f008 2026-03-08 12:43:04,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:43:04,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aacbd276ddd5d9e606f008 HTTP/1.1" 200 None 2026-03-08 12:43:04,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:43:04,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-08 12:43:04,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:43:04,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aacbd276ddd5d9e606f008 HTTP/1.1" 200 None 2026-03-08 12:43:04,280 - lava_callback - ERROR - Error processing callback for node 69aacbd276ddd5d9e606f008: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59196 - "GET / HTTP/1.0" 200 OK 2026-03-08 12:43:44,139 - lava_callback - INFO - Received callback for node 69aacbf576ddd5d9e606f01e INFO: 172.21.0.1:44986 - "POST /node/69aacbf576ddd5d9e606f01e HTTP/1.0" 202 Accepted 2026-03-08 12:43:44,144 - lava_callback - INFO - Starting async job submit for node 69aacbf576ddd5d9e606f01e 2026-03-08 12:43:44,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:43:44,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aacbf576ddd5d9e606f01e HTTP/1.1" 200 None 2026-03-08 12:43:44,166 - lava_callback - DEBUG - Processing node 69aacbf576ddd5d9e606f01e: baseline-arm-clabbe 2026-03-08 12:43:44,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aacbf576ddd5d9e606f01e 2026-03-08 12:43:44,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:43:44,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aacbf576ddd5d9e606f01e HTTP/1.1" 200 None 2026-03-08 12:43:44,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:43:44,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-08 12:43:44,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:43:44,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aacbf576ddd5d9e606f01e HTTP/1.1" 200 None 2026-03-08 12:43:44,222 - lava_callback - ERROR - Error processing callback for node 69aacbf576ddd5d9e606f01e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK 2026-03-08 12:57:51,605 - lava_callback - INFO - Received callback for node 69ad3bf9ed37758c525e1e2d INFO: 172.21.0.1:45604 - "POST /node/69ad3bf9ed37758c525e1e2d HTTP/1.0" 202 Accepted 2026-03-08 12:57:51,612 - lava_callback - INFO - Starting async job submit for node 69ad3bf9ed37758c525e1e2d 2026-03-08 12:57:51,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:57:51,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf9ed37758c525e1e2d HTTP/1.1" 200 None 2026-03-08 12:57:51,661 - lava_callback - DEBUG - Processing node 69ad3bf9ed37758c525e1e2d: baseline-arm64 2026-03-08 12:57:52,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 12:57:52,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 12:57:52,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf9ed37758c525e1e2d/log.txt.gz 2026-03-08 12:57:52,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 12:57:52,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 12:57:52,710 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf9ed37758c525e1e2d/lava-logs.yaml 2026-03-08 12:57:52,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 12:57:52,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 12:57:52,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad3bf9ed37758c525e1e2d/lava_callback.json.gz DEBUG: Setup failed for 69ad3bf9ed37758c525e1e2d. Transitting job node result: incomplete -> fail 2026-03-08 12:57:53,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:57:53,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad3bf9ed37758c525e1e2d HTTP/1.1" 200 None 2026-03-08 12:57:53,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:57:53,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 12:57:53,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:57:53,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad3bf9ed37758c525e1e2d HTTP/1.1" 200 None 2026-03-08 12:57:53,190 - lava_callback - INFO - Completed processing callback for node 69ad3bf9ed37758c525e1e2d INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK 2026-03-08 12:58:02,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 12:58:02,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:05:25,134 - lava_callback - INFO - Received callback for node 69aad10976ddd5d9e606f2c6 INFO: 172.21.0.1:44844 - "POST /node/69aad10976ddd5d9e606f2c6 HTTP/1.0" 202 Accepted 2026-03-08 13:05:25,140 - lava_callback - INFO - Starting async job submit for node 69aad10976ddd5d9e606f2c6 2026-03-08 13:05:25,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:05:25,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad10976ddd5d9e606f2c6 HTTP/1.1" 200 None 2026-03-08 13:05:25,155 - lava_callback - DEBUG - Processing node 69aad10976ddd5d9e606f2c6: baseline-arm64-clabbe 2026-03-08 13:05:25,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad10976ddd5d9e606f2c6 2026-03-08 13:05:25,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:05:25,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad10976ddd5d9e606f2c6 HTTP/1.1" 200 None 2026-03-08 13:05:25,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:05:25,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-08 13:05:25,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:05:25,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad10976ddd5d9e606f2c6 HTTP/1.1" 200 None 2026-03-08 13:05:25,212 - lava_callback - ERROR - Error processing callback for node 69aad10976ddd5d9e606f2c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:06:45,193 - lava_callback - INFO - Received callback for node 69aad15a76ddd5d9e606f2ed INFO: 172.21.0.1:50928 - "POST /node/69aad15a76ddd5d9e606f2ed HTTP/1.0" 202 Accepted 2026-03-08 13:06:45,198 - lava_callback - INFO - Starting async job submit for node 69aad15a76ddd5d9e606f2ed 2026-03-08 13:06:45,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:06:45,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad15a76ddd5d9e606f2ed HTTP/1.1" 200 None 2026-03-08 13:06:45,214 - lava_callback - DEBUG - Processing node 69aad15a76ddd5d9e606f2ed: baseline-arm64-clabbe 2026-03-08 13:06:45,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad15a76ddd5d9e606f2ed 2026-03-08 13:06:45,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:06:45,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad15a76ddd5d9e606f2ed HTTP/1.1" 200 None 2026-03-08 13:06:45,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:06:45,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-08 13:06:45,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:06:45,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad15a76ddd5d9e606f2ed HTTP/1.1" 200 None 2026-03-08 13:06:45,277 - lava_callback - ERROR - Error processing callback for node 69aad15a76ddd5d9e606f2ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET /node/698d48c8820eff0a56c15b48%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:16:13,150 - lava_callback - INFO - Received callback for node 69aad39976ddd5d9e606f398 INFO: 172.21.0.1:43188 - "POST /node/69aad39976ddd5d9e606f398 HTTP/1.0" 202 Accepted 2026-03-08 13:16:13,156 - lava_callback - INFO - Starting async job submit for node 69aad39976ddd5d9e606f398 2026-03-08 13:16:13,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:16:13,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad39976ddd5d9e606f398 HTTP/1.1" 200 None 2026-03-08 13:16:13,172 - lava_callback - DEBUG - Processing node 69aad39976ddd5d9e606f398: baseline-arm64-baylibre 2026-03-08 13:16:13,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad39976ddd5d9e606f398 2026-03-08 13:16:13,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:16:13,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad39976ddd5d9e606f398 HTTP/1.1" 200 None 2026-03-08 13:16:13,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:16:13,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-08 13:16:13,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:16:13,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad39976ddd5d9e606f398 HTTP/1.1" 200 None 2026-03-08 13:16:13,234 - lava_callback - ERROR - Error processing callback for node 69aad39976ddd5d9e606f398: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:17:33,220 - lava_callback - INFO - Received callback for node 69aad3e976ddd5d9e606f3b8 INFO: 172.21.0.1:36360 - "POST /node/69aad3e976ddd5d9e606f3b8 HTTP/1.0" 202 Accepted 2026-03-08 13:17:33,226 - lava_callback - INFO - Starting async job submit for node 69aad3e976ddd5d9e606f3b8 2026-03-08 13:17:33,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:17:33,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad3e976ddd5d9e606f3b8 HTTP/1.1" 200 None 2026-03-08 13:17:33,264 - lava_callback - DEBUG - Processing node 69aad3e976ddd5d9e606f3b8: baseline-arm64-baylibre 2026-03-08 13:17:33,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad3e976ddd5d9e606f3b8 2026-03-08 13:17:33,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:17:33,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad3e976ddd5d9e606f3b8 HTTP/1.1" 200 None 2026-03-08 13:17:33,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:17:33,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-08 13:17:33,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:17:33,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad3e976ddd5d9e606f3b8 HTTP/1.1" 200 None 2026-03-08 13:17:33,330 - lava_callback - ERROR - Error processing callback for node 69aad3e976ddd5d9e606f3b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:18:53,279 - lava_callback - INFO - Received callback for node 69aad43a76ddd5d9e606f3e8 INFO: 172.21.0.1:51902 - "POST /node/69aad43a76ddd5d9e606f3e8 HTTP/1.0" 202 Accepted 2026-03-08 13:18:53,286 - lava_callback - INFO - Starting async job submit for node 69aad43a76ddd5d9e606f3e8 2026-03-08 13:18:53,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:18:53,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad43a76ddd5d9e606f3e8 HTTP/1.1" 200 None 2026-03-08 13:18:53,304 - lava_callback - DEBUG - Processing node 69aad43a76ddd5d9e606f3e8: baseline-arm64-baylibre 2026-03-08 13:18:53,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad43a76ddd5d9e606f3e8 2026-03-08 13:18:53,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:18:53,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad43a76ddd5d9e606f3e8 HTTP/1.1" 200 None 2026-03-08 13:18:53,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:18:53,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-08 13:18:53,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:18:53,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad43a76ddd5d9e606f3e8 HTTP/1.1" 200 None 2026-03-08 13:18:53,367 - lava_callback - ERROR - Error processing callback for node 69aad43a76ddd5d9e606f3e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:20:13,322 - lava_callback - INFO - Received callback for node 69aad48776ddd5d9e606f3f8 INFO: 172.21.0.1:58642 - "POST /node/69aad48776ddd5d9e606f3f8 HTTP/1.0" 202 Accepted 2026-03-08 13:20:13,328 - lava_callback - INFO - Starting async job submit for node 69aad48776ddd5d9e606f3f8 2026-03-08 13:20:13,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:20:13,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad48776ddd5d9e606f3f8 HTTP/1.1" 200 None 2026-03-08 13:20:13,350 - lava_callback - DEBUG - Processing node 69aad48776ddd5d9e606f3f8: baseline-arm64-baylibre 2026-03-08 13:20:13,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad48776ddd5d9e606f3f8 2026-03-08 13:20:13,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:20:13,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad48776ddd5d9e606f3f8 HTTP/1.1" 200 None 2026-03-08 13:20:13,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:20:13,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-08 13:20:13,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:20:13,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad48776ddd5d9e606f3f8 HTTP/1.1" 200 None 2026-03-08 13:20:13,403 - lava_callback - ERROR - Error processing callback for node 69aad48776ddd5d9e606f3f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48730 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:21:33,478 - lava_callback - INFO - Received callback for node 69aad4d876ddd5d9e606f420 INFO: 172.21.0.1:48742 - "POST /node/69aad4d876ddd5d9e606f420 HTTP/1.0" 202 Accepted 2026-03-08 13:21:33,484 - lava_callback - INFO - Starting async job submit for node 69aad4d876ddd5d9e606f420 2026-03-08 13:21:33,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:21:33,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad4d876ddd5d9e606f420 HTTP/1.1" 200 None 2026-03-08 13:21:33,501 - lava_callback - DEBUG - Processing node 69aad4d876ddd5d9e606f420: baseline-arm64-baylibre 2026-03-08 13:21:33,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad4d876ddd5d9e606f420 2026-03-08 13:21:33,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:21:33,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad4d876ddd5d9e606f420 HTTP/1.1" 200 None 2026-03-08 13:21:33,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:21:33,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-08 13:21:33,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:21:33,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad4d876ddd5d9e606f420 HTTP/1.1" 200 None 2026-03-08 13:21:33,552 - lava_callback - ERROR - Error processing callback for node 69aad4d876ddd5d9e606f420: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:24:13,559 - lava_callback - INFO - Received callback for node 69aad57476ddd5d9e606f46a INFO: 172.21.0.1:46692 - "POST /node/69aad57476ddd5d9e606f46a HTTP/1.0" 202 Accepted 2026-03-08 13:24:13,564 - lava_callback - INFO - Starting async job submit for node 69aad57476ddd5d9e606f46a 2026-03-08 13:24:13,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:24:13,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad57476ddd5d9e606f46a HTTP/1.1" 200 None 2026-03-08 13:24:13,581 - lava_callback - DEBUG - Processing node 69aad57476ddd5d9e606f46a: baseline-arm64-baylibre 2026-03-08 13:24:13,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad57476ddd5d9e606f46a 2026-03-08 13:24:13,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:24:13,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad57476ddd5d9e606f46a HTTP/1.1" 200 None 2026-03-08 13:24:13,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:24:13,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-08 13:24:13,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:24:13,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad57476ddd5d9e606f46a HTTP/1.1" 200 None 2026-03-08 13:24:13,636 - lava_callback - ERROR - Error processing callback for node 69aad57476ddd5d9e606f46a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:28:13,767 - lava_callback - INFO - Received callback for node 69aad66476ddd5d9e606f4d0 INFO: 172.21.0.1:49550 - "POST /node/69aad66476ddd5d9e606f4d0 HTTP/1.0" 202 Accepted 2026-03-08 13:28:13,773 - lava_callback - INFO - Starting async job submit for node 69aad66476ddd5d9e606f4d0 2026-03-08 13:28:13,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:28:13,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad66476ddd5d9e606f4d0 HTTP/1.1" 200 None 2026-03-08 13:28:13,789 - lava_callback - DEBUG - Processing node 69aad66476ddd5d9e606f4d0: baseline-arm64-baylibre 2026-03-08 13:28:13,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aad66476ddd5d9e606f4d0 2026-03-08 13:28:13,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:28:13,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aad66476ddd5d9e606f4d0 HTTP/1.1" 200 None 2026-03-08 13:28:13,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:28:13,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-08 13:28:13,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:28:13,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aad66476ddd5d9e606f4d0 HTTP/1.1" 200 None 2026-03-08 13:28:13,846 - lava_callback - ERROR - Error processing callback for node 69aad66476ddd5d9e606f4d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:45:52,844 - lava_callback - INFO - Received callback for node 69ad727ded37758c525e2faf INFO: 172.21.0.1:48870 - "POST /node/69ad727ded37758c525e2faf HTTP/1.0" 202 Accepted 2026-03-08 13:45:52,854 - lava_callback - INFO - Starting async job submit for node 69ad727ded37758c525e2faf 2026-03-08 13:45:52,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:45:52,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad727ded37758c525e2faf HTTP/1.1" 200 None 2026-03-08 13:45:52,923 - lava_callback - DEBUG - Processing node 69ad727ded37758c525e2faf: baseline-arm64 2026-03-08 13:45:53,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 13:45:53,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 13:45:53,438 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad727ded37758c525e2faf/log.txt.gz 2026-03-08 13:45:53,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 13:45:53,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 13:45:53,886 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad727ded37758c525e2faf/lava-logs.yaml 2026-03-08 13:45:53,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 13:45:54,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 13:45:54,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad727ded37758c525e2faf/lava_callback.json.gz DEBUG: Setup failed for 69ad727ded37758c525e2faf. Transitting job node result: incomplete -> fail 2026-03-08 13:45:54,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:45:54,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad727ded37758c525e2faf HTTP/1.1" 200 None 2026-03-08 13:45:54,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:45:54,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 13:45:54,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:45:54,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad727ded37758c525e2faf HTTP/1.1" 200 None 2026-03-08 13:45:54,281 - lava_callback - INFO - Completed processing callback for node 69ad727ded37758c525e2faf INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:46:02,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:46:02,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:55:13,271 - lava_callback - INFO - Received callback for node 69ad7d99ed37758c525e32c0 INFO: 172.21.0.1:33100 - "POST /node/69ad7d99ed37758c525e32c0 HTTP/1.0" 202 Accepted 2026-03-08 13:55:13,279 - lava_callback - INFO - Starting async job submit for node 69ad7d99ed37758c525e32c0 2026-03-08 13:55:13,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:55:13,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad7d99ed37758c525e32c0 HTTP/1.1" 200 None 2026-03-08 13:55:13,330 - lava_callback - DEBUG - Processing node 69ad7d99ed37758c525e32c0: baseline-arm64 2026-03-08 13:55:13,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 13:55:13,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 13:55:13,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad7d99ed37758c525e32c0/log.txt.gz 2026-03-08 13:55:14,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 13:55:14,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 13:55:14,286 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad7d99ed37758c525e32c0/lava-logs.yaml 2026-03-08 13:55:14,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 13:55:14,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 13:55:14,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad7d99ed37758c525e32c0/lava_callback.json.gz DEBUG: Setup failed for 69ad7d99ed37758c525e32c0. Transitting job node result: incomplete -> fail 2026-03-08 13:55:14,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:55:14,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad7d99ed37758c525e32c0 HTTP/1.1" 200 None 2026-03-08 13:55:14,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:55:14,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 13:55:14,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:55:14,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad7d99ed37758c525e32c0 HTTP/1.1" 200 None 2026-03-08 13:55:14,681 - lava_callback - INFO - Completed processing callback for node 69ad7d99ed37758c525e32c0 INFO: 172.21.0.1:33114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK 2026-03-08 13:55:32,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 13:55:32,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK 2026-03-08 14:02:53,633 - lava_callback - INFO - Received callback for node 69ad7fcaed37758c525e332d INFO: 172.21.0.1:40080 - "POST /node/69ad7fcaed37758c525e332d HTTP/1.0" 202 Accepted 2026-03-08 14:02:53,640 - lava_callback - INFO - Starting async job submit for node 69ad7fcaed37758c525e332d 2026-03-08 14:02:53,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:02:53,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad7fcaed37758c525e332d HTTP/1.1" 200 None 2026-03-08 14:02:53,718 - lava_callback - DEBUG - Processing node 69ad7fcaed37758c525e332d: baseline-arm64 2026-03-08 14:02:54,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 14:02:54,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 14:02:54,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad7fcaed37758c525e332d/log.txt.gz 2026-03-08 14:02:54,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 14:02:54,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 14:02:54,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad7fcaed37758c525e332d/lava-logs.yaml 2026-03-08 14:02:54,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-08 14:02:54,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-08 14:02:54,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ad7fcaed37758c525e332d/lava_callback.json.gz DEBUG: Setup failed for 69ad7fcaed37758c525e332d. Transitting job node result: incomplete -> fail 2026-03-08 14:02:54,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:02:54,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad7fcaed37758c525e332d HTTP/1.1" 200 None 2026-03-08 14:02:54,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:02:54,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ad30c9ed37758c525e15e4 HTTP/1.1" 200 None 2026-03-08 14:02:54,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:02:55,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ad7fcaed37758c525e332d HTTP/1.1" 200 None 2026-03-08 14:02:55,099 - lava_callback - INFO - Completed processing callback for node 69ad7fcaed37758c525e332d INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK 2026-03-08 14:03:02,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:03:02,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK 2026-03-08 14:45:09,481 - lava_callback - INFO - Received callback for node 69aae87176ddd5d9e606f9ca INFO: 172.21.0.1:43194 - "POST /node/69aae87176ddd5d9e606f9ca HTTP/1.0" 202 Accepted 2026-03-08 14:45:09,486 - lava_callback - INFO - Starting async job submit for node 69aae87176ddd5d9e606f9ca 2026-03-08 14:45:09,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:45:09,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aae87176ddd5d9e606f9ca HTTP/1.1" 200 None 2026-03-08 14:45:09,502 - lava_callback - DEBUG - Processing node 69aae87176ddd5d9e606f9ca: baseline-arm-clabbe 2026-03-08 14:45:09,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aae87176ddd5d9e606f9ca 2026-03-08 14:45:09,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:45:09,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aae87176ddd5d9e606f9ca HTTP/1.1" 200 None 2026-03-08 14:45:09,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:45:09,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 14:45:09,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:45:09,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aae87176ddd5d9e606f9ca HTTP/1.1" 200 None 2026-03-08 14:45:09,583 - lava_callback - ERROR - Error processing callback for node 69aae87176ddd5d9e606f9ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK 2026-03-08 14:45:49,504 - lava_callback - INFO - Received callback for node 69aae89576ddd5d9e606f9e3 INFO: 172.21.0.1:48238 - "POST /node/69aae89576ddd5d9e606f9e3 HTTP/1.0" 202 Accepted 2026-03-08 14:45:49,510 - lava_callback - INFO - Starting async job submit for node 69aae89576ddd5d9e606f9e3 2026-03-08 14:45:49,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:45:49,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aae89576ddd5d9e606f9e3 HTTP/1.1" 200 None 2026-03-08 14:45:49,537 - lava_callback - DEBUG - Processing node 69aae89576ddd5d9e606f9e3: baseline-arm-clabbe 2026-03-08 14:45:49,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aae89576ddd5d9e606f9e3 2026-03-08 14:45:49,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:45:49,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aae89576ddd5d9e606f9e3 HTTP/1.1" 200 None 2026-03-08 14:45:49,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:45:49,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 14:45:49,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:45:49,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aae89576ddd5d9e606f9e3 HTTP/1.1" 200 None 2026-03-08 14:45:49,593 - lava_callback - ERROR - Error processing callback for node 69aae89576ddd5d9e606f9e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK 2026-03-08 14:46:29,574 - lava_callback - INFO - Received callback for node 69aae8ba76ddd5d9e606fa00 INFO: 172.21.0.1:45528 - "POST /node/69aae8ba76ddd5d9e606fa00 HTTP/1.0" 202 Accepted 2026-03-08 14:46:29,579 - lava_callback - INFO - Starting async job submit for node 69aae8ba76ddd5d9e606fa00 2026-03-08 14:46:29,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:46:29,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aae8ba76ddd5d9e606fa00 HTTP/1.1" 200 None 2026-03-08 14:46:29,597 - lava_callback - DEBUG - Processing node 69aae8ba76ddd5d9e606fa00: baseline-arm-clabbe 2026-03-08 14:46:29,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aae8ba76ddd5d9e606fa00 2026-03-08 14:46:29,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:46:29,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aae8ba76ddd5d9e606fa00 HTTP/1.1" 200 None 2026-03-08 14:46:29,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:46:29,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8de776ddd5d9e606d488 HTTP/1.1" 200 None 2026-03-08 14:46:29,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:46:29,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aae8ba76ddd5d9e606fa00 HTTP/1.1" 200 None 2026-03-08 14:46:29,667 - lava_callback - ERROR - Error processing callback for node 69aae8ba76ddd5d9e606fa00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK 2026-03-08 14:58:58,773 - lava_callback - INFO - Received callback for node 69aaebad76ddd5d9e606fb3a INFO: 172.21.0.1:60030 - "POST /node/69aaebad76ddd5d9e606fb3a HTTP/1.0" 202 Accepted 2026-03-08 14:58:58,779 - lava_callback - INFO - Starting async job submit for node 69aaebad76ddd5d9e606fb3a 2026-03-08 14:58:58,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:58:58,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaebad76ddd5d9e606fb3a HTTP/1.1" 200 None 2026-03-08 14:58:58,799 - lava_callback - DEBUG - Processing node 69aaebad76ddd5d9e606fb3a: baseline-arm64-baylibre 2026-03-08 14:58:58,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaebad76ddd5d9e606fb3a 2026-03-08 14:58:58,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:58:58,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaebad76ddd5d9e606fb3a HTTP/1.1" 200 None 2026-03-08 14:58:58,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:58:58,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 14:58:58,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 14:58:58,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaebad76ddd5d9e606fb3a HTTP/1.1" 200 None 2026-03-08 14:58:58,853 - lava_callback - ERROR - Error processing callback for node 69aaebad76ddd5d9e606fb3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:00:30,355 - lava_callback - INFO - Received callback for node 69aaec0576ddd5d9e606fb61 INFO: 172.21.0.1:58470 - "POST /node/69aaec0576ddd5d9e606fb61 HTTP/1.0" 202 Accepted 2026-03-08 15:00:30,361 - lava_callback - INFO - Starting async job submit for node 69aaec0576ddd5d9e606fb61 2026-03-08 15:00:30,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:00:30,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaec0576ddd5d9e606fb61 HTTP/1.1" 200 None 2026-03-08 15:00:30,384 - lava_callback - DEBUG - Processing node 69aaec0576ddd5d9e606fb61: baseline-arm64-clabbe 2026-03-08 15:00:30,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaec0576ddd5d9e606fb61 2026-03-08 15:00:30,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:00:30,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaec0576ddd5d9e606fb61 HTTP/1.1" 200 None 2026-03-08 15:00:30,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:00:30,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 15:00:30,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:00:30,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaec0576ddd5d9e606fb61 HTTP/1.1" 200 None 2026-03-08 15:00:30,438 - lava_callback - ERROR - Error processing callback for node 69aaec0576ddd5d9e606fb61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:01:50,251 - lava_callback - INFO - Received callback for node 69aaec5a76ddd5d9e606fb81 INFO: 172.21.0.1:38738 - "POST /node/69aaec5a76ddd5d9e606fb81 HTTP/1.0" 202 Accepted 2026-03-08 15:01:50,256 - lava_callback - INFO - Starting async job submit for node 69aaec5a76ddd5d9e606fb81 2026-03-08 15:01:50,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:01:50,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaec5a76ddd5d9e606fb81 HTTP/1.1" 200 None 2026-03-08 15:01:50,272 - lava_callback - DEBUG - Processing node 69aaec5a76ddd5d9e606fb81: baseline-arm64-clabbe 2026-03-08 15:01:50,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaec5a76ddd5d9e606fb81 2026-03-08 15:01:50,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:01:50,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaec5a76ddd5d9e606fb81 HTTP/1.1" 200 None 2026-03-08 15:01:50,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:01:50,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8df576ddd5d9e606d49a HTTP/1.1" 200 None 2026-03-08 15:01:50,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:01:50,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaec5a76ddd5d9e606fb81 HTTP/1.1" 200 None 2026-03-08 15:01:50,334 - lava_callback - ERROR - Error processing callback for node 69aaec5a76ddd5d9e606fb81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:02:59,057 - lava_callback - INFO - Received callback for node 69aaec9a76ddd5d9e606fb96 INFO: 172.21.0.1:33076 - "POST /node/69aaec9a76ddd5d9e606fb96 HTTP/1.0" 202 Accepted 2026-03-08 15:02:59,063 - lava_callback - INFO - Starting async job submit for node 69aaec9a76ddd5d9e606fb96 2026-03-08 15:02:59,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:02:59,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaec9a76ddd5d9e606fb96 HTTP/1.1" 200 None 2026-03-08 15:02:59,078 - lava_callback - DEBUG - Processing node 69aaec9a76ddd5d9e606fb96: baseline-arm-baylibre 2026-03-08 15:02:59,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaec9a76ddd5d9e606fb96 2026-03-08 15:02:59,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:02:59,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaec9a76ddd5d9e606fb96 HTTP/1.1" 200 None 2026-03-08 15:02:59,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:02:59,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:02:59,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:02:59,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaec9a76ddd5d9e606fb96 HTTP/1.1" 200 None 2026-03-08 15:02:59,131 - lava_callback - ERROR - Error processing callback for node 69aaec9a76ddd5d9e606fb96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:09:19,346 - lava_callback - INFO - Received callback for node 69aaee1d76ddd5d9e606fc2c INFO: 172.21.0.1:36524 - "POST /node/69aaee1d76ddd5d9e606fc2c HTTP/1.0" 202 Accepted 2026-03-08 15:09:19,352 - lava_callback - INFO - Starting async job submit for node 69aaee1d76ddd5d9e606fc2c 2026-03-08 15:09:19,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:09:19,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaee1d76ddd5d9e606fc2c HTTP/1.1" 200 None 2026-03-08 15:09:19,370 - lava_callback - DEBUG - Processing node 69aaee1d76ddd5d9e606fc2c: baseline-arm64-baylibre 2026-03-08 15:09:19,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaee1d76ddd5d9e606fc2c 2026-03-08 15:09:19,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:09:19,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaee1d76ddd5d9e606fc2c HTTP/1.1" 200 None 2026-03-08 15:09:19,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:09:19,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-08 15:09:19,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:09:19,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaee1d76ddd5d9e606fc2c HTTP/1.1" 200 None 2026-03-08 15:09:19,435 - lava_callback - ERROR - Error processing callback for node 69aaee1d76ddd5d9e606fc2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50570 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:13:19,513 - lava_callback - INFO - Received callback for node 69aaeefb76ddd5d9e606fc89 INFO: 172.21.0.1:50576 - "POST /node/69aaeefb76ddd5d9e606fc89 HTTP/1.0" 202 Accepted 2026-03-08 15:13:19,519 - lava_callback - INFO - Starting async job submit for node 69aaeefb76ddd5d9e606fc89 2026-03-08 15:13:19,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:13:19,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaeefb76ddd5d9e606fc89 HTTP/1.1" 200 None 2026-03-08 15:13:19,535 - lava_callback - DEBUG - Processing node 69aaeefb76ddd5d9e606fc89: baseline-arm-baylibre 2026-03-08 15:13:19,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaeefb76ddd5d9e606fc89 2026-03-08 15:13:19,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:13:19,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaeefb76ddd5d9e606fc89 HTTP/1.1" 200 None 2026-03-08 15:13:19,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:13:19,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:13:19,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:13:19,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaeefb76ddd5d9e606fc89 HTTP/1.1" 200 None 2026-03-08 15:13:19,596 - lava_callback - ERROR - Error processing callback for node 69aaeefb76ddd5d9e606fc89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:16:19,757 - lava_callback - INFO - Received callback for node 69aaefb776ddd5d9e606fccf INFO: 172.21.0.1:34388 - "POST /node/69aaefb776ddd5d9e606fccf HTTP/1.0" 202 Accepted 2026-03-08 15:16:19,762 - lava_callback - INFO - Starting async job submit for node 69aaefb776ddd5d9e606fccf 2026-03-08 15:16:19,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:16:19,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaefb776ddd5d9e606fccf HTTP/1.1" 200 None 2026-03-08 15:16:19,806 - lava_callback - DEBUG - Processing node 69aaefb776ddd5d9e606fccf: baseline-arm-baylibre 2026-03-08 15:16:19,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaefb776ddd5d9e606fccf 2026-03-08 15:16:19,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:16:19,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaefb776ddd5d9e606fccf HTTP/1.1" 200 None 2026-03-08 15:16:19,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:16:19,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:16:19,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:16:19,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaefb776ddd5d9e606fccf HTTP/1.1" 200 None 2026-03-08 15:16:19,858 - lava_callback - ERROR - Error processing callback for node 69aaefb776ddd5d9e606fccf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:16:59,626 - lava_callback - INFO - Received callback for node 69aaefdb76ddd5d9e606fce4 INFO: 172.21.0.1:46006 - "POST /node/69aaefdb76ddd5d9e606fce4 HTTP/1.0" 202 Accepted 2026-03-08 15:16:59,632 - lava_callback - INFO - Starting async job submit for node 69aaefdb76ddd5d9e606fce4 2026-03-08 15:16:59,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:16:59,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaefdb76ddd5d9e606fce4 HTTP/1.1" 200 None 2026-03-08 15:16:59,649 - lava_callback - DEBUG - Processing node 69aaefdb76ddd5d9e606fce4: baseline-arm-baylibre 2026-03-08 15:16:59,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaefdb76ddd5d9e606fce4 2026-03-08 15:16:59,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:16:59,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaefdb76ddd5d9e606fce4 HTTP/1.1" 200 None 2026-03-08 15:16:59,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:16:59,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:16:59,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:16:59,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaefdb76ddd5d9e606fce4 HTTP/1.1" 200 None 2026-03-08 15:16:59,718 - lava_callback - ERROR - Error processing callback for node 69aaefdb76ddd5d9e606fce4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:17:39,658 - lava_callback - INFO - Received callback for node 69aaf00176ddd5d9e606fcf1 INFO: 172.21.0.1:50544 - "POST /node/69aaf00176ddd5d9e606fcf1 HTTP/1.0" 202 Accepted 2026-03-08 15:17:39,667 - lava_callback - INFO - Starting async job submit for node 69aaf00176ddd5d9e606fcf1 2026-03-08 15:17:39,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:17:39,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf00176ddd5d9e606fcf1 HTTP/1.1" 200 None 2026-03-08 15:17:39,694 - lava_callback - DEBUG - Processing node 69aaf00176ddd5d9e606fcf1: baseline-arm-baylibre 2026-03-08 15:17:39,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf00176ddd5d9e606fcf1 2026-03-08 15:17:39,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:17:39,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf00176ddd5d9e606fcf1 HTTP/1.1" 200 None 2026-03-08 15:17:39,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:17:39,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:17:39,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:17:39,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf00176ddd5d9e606fcf1 HTTP/1.1" 200 None 2026-03-08 15:17:39,780 - lava_callback - ERROR - Error processing callback for node 69aaf00176ddd5d9e606fcf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:17:59,664 - lava_callback - INFO - Received callback for node 69aaf02676ddd5d9e606fd06 INFO: 172.21.0.1:59546 - "POST /node/69aaf02676ddd5d9e606fd06 HTTP/1.0" 202 Accepted 2026-03-08 15:17:59,669 - lava_callback - INFO - Starting async job submit for node 69aaf02676ddd5d9e606fd06 2026-03-08 15:17:59,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:17:59,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf02676ddd5d9e606fd06 HTTP/1.1" 200 None 2026-03-08 15:17:59,685 - lava_callback - DEBUG - Processing node 69aaf02676ddd5d9e606fd06: baseline-arm-baylibre 2026-03-08 15:17:59,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf02676ddd5d9e606fd06 2026-03-08 15:17:59,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:17:59,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf02676ddd5d9e606fd06 HTTP/1.1" 200 None 2026-03-08 15:17:59,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:17:59,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:17:59,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:17:59,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf02676ddd5d9e606fd06 HTTP/1.1" 200 None 2026-03-08 15:17:59,766 - lava_callback - ERROR - Error processing callback for node 69aaf02676ddd5d9e606fd06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:18:39,702 - lava_callback - INFO - Received callback for node 69aaf04776ddd5d9e606fd1d INFO: 172.21.0.1:41286 - "POST /node/69aaf04776ddd5d9e606fd1d HTTP/1.0" 202 Accepted 2026-03-08 15:18:39,707 - lava_callback - INFO - Starting async job submit for node 69aaf04776ddd5d9e606fd1d 2026-03-08 15:18:39,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:18:39,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf04776ddd5d9e606fd1d HTTP/1.1" 200 None 2026-03-08 15:18:39,724 - lava_callback - DEBUG - Processing node 69aaf04776ddd5d9e606fd1d: baseline-arm-baylibre 2026-03-08 15:18:39,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf04776ddd5d9e606fd1d 2026-03-08 15:18:39,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:18:39,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf04776ddd5d9e606fd1d HTTP/1.1" 200 None 2026-03-08 15:18:39,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:18:39,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:18:39,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:18:39,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf04776ddd5d9e606fd1d HTTP/1.1" 200 None 2026-03-08 15:18:39,776 - lava_callback - ERROR - Error processing callback for node 69aaf04776ddd5d9e606fd1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:19:19,744 - lava_callback - INFO - Received callback for node 69aaf06c76ddd5d9e606fd29 INFO: 172.21.0.1:34312 - "POST /node/69aaf06c76ddd5d9e606fd29 HTTP/1.0" 202 Accepted 2026-03-08 15:19:19,749 - lava_callback - INFO - Starting async job submit for node 69aaf06c76ddd5d9e606fd29 2026-03-08 15:19:19,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:19:19,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf06c76ddd5d9e606fd29 HTTP/1.1" 200 None 2026-03-08 15:19:19,766 - lava_callback - DEBUG - Processing node 69aaf06c76ddd5d9e606fd29: baseline-arm-baylibre 2026-03-08 15:19:19,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf06c76ddd5d9e606fd29 2026-03-08 15:19:19,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:19:19,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf06c76ddd5d9e606fd29 HTTP/1.1" 200 None 2026-03-08 15:19:19,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:19:19,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:19:19,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:19:19,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf06c76ddd5d9e606fd29 HTTP/1.1" 200 None 2026-03-08 15:19:19,823 - lava_callback - ERROR - Error processing callback for node 69aaf06c76ddd5d9e606fd29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:19:59,798 - lava_callback - INFO - Received callback for node 69aaf09076ddd5d9e606fd31 INFO: 172.21.0.1:39694 - "POST /node/69aaf09076ddd5d9e606fd31 HTTP/1.0" 202 Accepted 2026-03-08 15:19:59,804 - lava_callback - INFO - Starting async job submit for node 69aaf09076ddd5d9e606fd31 2026-03-08 15:19:59,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:19:59,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf09076ddd5d9e606fd31 HTTP/1.1" 200 None 2026-03-08 15:19:59,822 - lava_callback - DEBUG - Processing node 69aaf09076ddd5d9e606fd31: baseline-arm-baylibre 2026-03-08 15:19:59,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf09076ddd5d9e606fd31 2026-03-08 15:19:59,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:19:59,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf09076ddd5d9e606fd31 HTTP/1.1" 200 None 2026-03-08 15:19:59,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:19:59,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:19:59,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:19:59,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf09076ddd5d9e606fd31 HTTP/1.1" 200 None 2026-03-08 15:19:59,883 - lava_callback - ERROR - Error processing callback for node 69aaf09076ddd5d9e606fd31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:20:39,911 - lava_callback - INFO - Received callback for node 69aaf0b376ddd5d9e606fd40 INFO: 172.21.0.1:38218 - "POST /node/69aaf0b376ddd5d9e606fd40 HTTP/1.0" 202 Accepted 2026-03-08 15:20:39,916 - lava_callback - INFO - Starting async job submit for node 69aaf0b376ddd5d9e606fd40 2026-03-08 15:20:39,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:20:39,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf0b376ddd5d9e606fd40 HTTP/1.1" 200 None 2026-03-08 15:20:39,932 - lava_callback - DEBUG - Processing node 69aaf0b376ddd5d9e606fd40: baseline-arm-baylibre 2026-03-08 15:20:39,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf0b376ddd5d9e606fd40 2026-03-08 15:20:39,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:20:39,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf0b376ddd5d9e606fd40 HTTP/1.1" 200 None 2026-03-08 15:20:39,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:20:39,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:20:39,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:20:39,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf0b376ddd5d9e606fd40 HTTP/1.1" 200 None 2026-03-08 15:20:39,991 - lava_callback - ERROR - Error processing callback for node 69aaf0b376ddd5d9e606fd40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:20:59,809 - lava_callback - INFO - Received callback for node 69aaf0d876ddd5d9e606fd5a INFO: 172.21.0.1:53520 - "POST /node/69aaf0d876ddd5d9e606fd5a HTTP/1.0" 202 Accepted 2026-03-08 15:20:59,818 - lava_callback - INFO - Starting async job submit for node 69aaf0d876ddd5d9e606fd5a 2026-03-08 15:20:59,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:20:59,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf0d876ddd5d9e606fd5a HTTP/1.1" 200 None 2026-03-08 15:20:59,835 - lava_callback - DEBUG - Processing node 69aaf0d876ddd5d9e606fd5a: baseline-arm-baylibre 2026-03-08 15:20:59,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf0d876ddd5d9e606fd5a 2026-03-08 15:20:59,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:20:59,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf0d876ddd5d9e606fd5a HTTP/1.1" 200 None 2026-03-08 15:20:59,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:20:59,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:20:59,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:20:59,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf0d876ddd5d9e606fd5a HTTP/1.1" 200 None 2026-03-08 15:20:59,904 - lava_callback - ERROR - Error processing callback for node 69aaf0d876ddd5d9e606fd5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:21:40,013 - lava_callback - INFO - Received callback for node 69aaf0fe76ddd5d9e606fd68 INFO: 172.21.0.1:44470 - "POST /node/69aaf0fe76ddd5d9e606fd68 HTTP/1.0" 202 Accepted 2026-03-08 15:21:40,018 - lava_callback - INFO - Starting async job submit for node 69aaf0fe76ddd5d9e606fd68 2026-03-08 15:21:40,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:21:40,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf0fe76ddd5d9e606fd68 HTTP/1.1" 200 None 2026-03-08 15:21:40,034 - lava_callback - DEBUG - Processing node 69aaf0fe76ddd5d9e606fd68: baseline-arm-baylibre 2026-03-08 15:21:40,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf0fe76ddd5d9e606fd68 2026-03-08 15:21:40,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:21:40,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf0fe76ddd5d9e606fd68 HTTP/1.1" 200 None 2026-03-08 15:21:40,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:21:40,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:21:40,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:21:40,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf0fe76ddd5d9e606fd68 HTTP/1.1" 200 None 2026-03-08 15:21:40,087 - lava_callback - ERROR - Error processing callback for node 69aaf0fe76ddd5d9e606fd68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:22:20,140 - lava_callback - INFO - Received callback for node 69aaf12076ddd5d9e606fd73 INFO: 172.21.0.1:33894 - "POST /node/69aaf12076ddd5d9e606fd73 HTTP/1.0" 202 Accepted 2026-03-08 15:22:20,145 - lava_callback - INFO - Starting async job submit for node 69aaf12076ddd5d9e606fd73 2026-03-08 15:22:20,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:22:20,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf12076ddd5d9e606fd73 HTTP/1.1" 200 None 2026-03-08 15:22:20,160 - lava_callback - DEBUG - Processing node 69aaf12076ddd5d9e606fd73: baseline-arm-baylibre 2026-03-08 15:22:20,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf12076ddd5d9e606fd73 2026-03-08 15:22:20,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:22:20,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf12076ddd5d9e606fd73 HTTP/1.1" 200 None 2026-03-08 15:22:20,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:22:20,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:22:20,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:22:20,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf12076ddd5d9e606fd73 HTTP/1.1" 200 None 2026-03-08 15:22:20,228 - lava_callback - ERROR - Error processing callback for node 69aaf12076ddd5d9e606fd73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:22:59,972 - lava_callback - INFO - Received callback for node 69aaf14676ddd5d9e606fd7e INFO: 172.21.0.1:53992 - "POST /node/69aaf14676ddd5d9e606fd7e HTTP/1.0" 202 Accepted 2026-03-08 15:22:59,981 - lava_callback - INFO - Starting async job submit for node 69aaf14676ddd5d9e606fd7e 2026-03-08 15:22:59,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:23:00,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf14676ddd5d9e606fd7e HTTP/1.1" 200 None 2026-03-08 15:23:00,007 - lava_callback - DEBUG - Processing node 69aaf14676ddd5d9e606fd7e: baseline-arm-baylibre 2026-03-08 15:23:00,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf14676ddd5d9e606fd7e 2026-03-08 15:23:00,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:23:00,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf14676ddd5d9e606fd7e HTTP/1.1" 200 None 2026-03-08 15:23:00,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:23:00,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:23:00,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:23:00,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf14676ddd5d9e606fd7e HTTP/1.1" 200 None 2026-03-08 15:23:00,094 - lava_callback - ERROR - Error processing callback for node 69aaf14676ddd5d9e606fd7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:23:40,036 - lava_callback - INFO - Received callback for node 69aaf17576ddd5d9e606fd99 INFO: 172.21.0.1:42500 - "POST /node/69aaf17576ddd5d9e606fd99 HTTP/1.0" 202 Accepted 2026-03-08 15:23:40,042 - lava_callback - INFO - Starting async job submit for node 69aaf17576ddd5d9e606fd99 2026-03-08 15:23:40,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:23:40,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf17576ddd5d9e606fd99 HTTP/1.1" 200 None 2026-03-08 15:23:40,058 - lava_callback - DEBUG - Processing node 69aaf17576ddd5d9e606fd99: baseline-arm64-baylibre 2026-03-08 15:23:40,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf17576ddd5d9e606fd99 2026-03-08 15:23:40,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:23:40,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf17576ddd5d9e606fd99 HTTP/1.1" 200 None 2026-03-08 15:23:40,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:23:40,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:23:40,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:23:40,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf17576ddd5d9e606fd99 HTTP/1.1" 200 None 2026-03-08 15:23:40,117 - lava_callback - ERROR - Error processing callback for node 69aaf17576ddd5d9e606fd99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43378 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:25:00,146 - lava_callback - INFO - Received callback for node 69aaf1bd76ddd5d9e606fdb4 INFO: 172.21.0.1:38336 - "POST /node/69aaf1bd76ddd5d9e606fdb4 HTTP/1.0" 202 Accepted 2026-03-08 15:25:00,151 - lava_callback - INFO - Starting async job submit for node 69aaf1bd76ddd5d9e606fdb4 2026-03-08 15:25:00,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:25:00,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf1bd76ddd5d9e606fdb4 HTTP/1.1" 200 None 2026-03-08 15:25:00,167 - lava_callback - DEBUG - Processing node 69aaf1bd76ddd5d9e606fdb4: baseline-arm-baylibre 2026-03-08 15:25:00,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf1bd76ddd5d9e606fdb4 2026-03-08 15:25:00,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:25:00,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf1bd76ddd5d9e606fdb4 HTTP/1.1" 200 None 2026-03-08 15:25:00,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:25:00,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:25:00,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:25:00,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf1bd76ddd5d9e606fdb4 HTTP/1.1" 200 None 2026-03-08 15:25:00,225 - lava_callback - ERROR - Error processing callback for node 69aaf1bd76ddd5d9e606fdb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:25:40,125 - lava_callback - INFO - Received callback for node 69aaf1e376ddd5d9e606fdce INFO: 172.21.0.1:38000 - "POST /node/69aaf1e376ddd5d9e606fdce HTTP/1.0" 202 Accepted 2026-03-08 15:25:40,131 - lava_callback - INFO - Starting async job submit for node 69aaf1e376ddd5d9e606fdce 2026-03-08 15:25:40,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:25:40,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf1e376ddd5d9e606fdce HTTP/1.1" 200 None 2026-03-08 15:25:40,147 - lava_callback - DEBUG - Processing node 69aaf1e376ddd5d9e606fdce: baseline-arm-baylibre 2026-03-08 15:25:40,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf1e376ddd5d9e606fdce 2026-03-08 15:25:40,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:25:40,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf1e376ddd5d9e606fdce HTTP/1.1" 200 None 2026-03-08 15:25:40,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:25:40,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:25:40,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:25:40,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf1e376ddd5d9e606fdce HTTP/1.1" 200 None 2026-03-08 15:25:40,203 - lava_callback - ERROR - Error processing callback for node 69aaf1e376ddd5d9e606fdce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:26:20,206 - lava_callback - INFO - Received callback for node 69aaf20a76ddd5d9e606fde0 INFO: 172.21.0.1:44786 - "POST /node/69aaf20a76ddd5d9e606fde0 HTTP/1.0" 202 Accepted 2026-03-08 15:26:20,211 - lava_callback - INFO - Starting async job submit for node 69aaf20a76ddd5d9e606fde0 2026-03-08 15:26:20,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:26:20,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf20a76ddd5d9e606fde0 HTTP/1.1" 200 None 2026-03-08 15:26:20,230 - lava_callback - DEBUG - Processing node 69aaf20a76ddd5d9e606fde0: baseline-arm-baylibre 2026-03-08 15:26:20,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf20a76ddd5d9e606fde0 2026-03-08 15:26:20,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:26:20,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf20a76ddd5d9e606fde0 HTTP/1.1" 200 None 2026-03-08 15:26:20,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:26:20,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:26:20,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:26:20,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf20a76ddd5d9e606fde0 HTTP/1.1" 200 None 2026-03-08 15:26:20,288 - lava_callback - ERROR - Error processing callback for node 69aaf20a76ddd5d9e606fde0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:27:00,204 - lava_callback - INFO - Received callback for node 69aaf23076ddd5d9e606fdf2 INFO: 172.21.0.1:39948 - "POST /node/69aaf23076ddd5d9e606fdf2 HTTP/1.0" 202 Accepted 2026-03-08 15:27:00,210 - lava_callback - INFO - Starting async job submit for node 69aaf23076ddd5d9e606fdf2 2026-03-08 15:27:00,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:27:00,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf23076ddd5d9e606fdf2 HTTP/1.1" 200 None 2026-03-08 15:27:00,227 - lava_callback - DEBUG - Processing node 69aaf23076ddd5d9e606fdf2: baseline-arm-baylibre 2026-03-08 15:27:00,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf23076ddd5d9e606fdf2 2026-03-08 15:27:00,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:27:00,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf23076ddd5d9e606fdf2 HTTP/1.1" 200 None 2026-03-08 15:27:00,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:27:00,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-08 15:27:00,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:27:00,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf23076ddd5d9e606fdf2 HTTP/1.1" 200 None 2026-03-08 15:27:00,280 - lava_callback - ERROR - Error processing callback for node 69aaf23076ddd5d9e606fdf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:27:40,271 - lava_callback - INFO - Received callback for node 69aaf25d76ddd5d9e606fe07 INFO: 172.21.0.1:50646 - "POST /node/69aaf25d76ddd5d9e606fe07 HTTP/1.0" 202 Accepted 2026-03-08 15:27:40,277 - lava_callback - INFO - Starting async job submit for node 69aaf25d76ddd5d9e606fe07 2026-03-08 15:27:40,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:27:40,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf25d76ddd5d9e606fe07 HTTP/1.1" 200 None 2026-03-08 15:27:40,293 - lava_callback - DEBUG - Processing node 69aaf25d76ddd5d9e606fe07: baseline-arm64-baylibre 2026-03-08 15:27:40,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf25d76ddd5d9e606fe07 2026-03-08 15:27:40,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:27:40,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf25d76ddd5d9e606fe07 HTTP/1.1" 200 None 2026-03-08 15:27:40,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:27:40,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:27:40,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:27:40,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf25d76ddd5d9e606fe07 HTTP/1.1" 200 None 2026-03-08 15:27:40,349 - lava_callback - ERROR - Error processing callback for node 69aaf25d76ddd5d9e606fe07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:29:00,338 - lava_callback - INFO - Received callback for node 69aaf2ad76ddd5d9e606fe1e INFO: 172.21.0.1:60792 - "POST /node/69aaf2ad76ddd5d9e606fe1e HTTP/1.0" 202 Accepted 2026-03-08 15:29:00,343 - lava_callback - INFO - Starting async job submit for node 69aaf2ad76ddd5d9e606fe1e 2026-03-08 15:29:00,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:29:00,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf2ad76ddd5d9e606fe1e HTTP/1.1" 200 None 2026-03-08 15:29:00,358 - lava_callback - DEBUG - Processing node 69aaf2ad76ddd5d9e606fe1e: baseline-arm64-baylibre 2026-03-08 15:29:00,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf2ad76ddd5d9e606fe1e 2026-03-08 15:29:00,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:29:00,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf2ad76ddd5d9e606fe1e HTTP/1.1" 200 None 2026-03-08 15:29:00,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:29:00,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:29:00,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:29:00,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf2ad76ddd5d9e606fe1e HTTP/1.1" 200 None 2026-03-08 15:29:00,417 - lava_callback - ERROR - Error processing callback for node 69aaf2ad76ddd5d9e606fe1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET /node/699397eacebe99dd8e074a7a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:30:20,386 - lava_callback - INFO - Received callback for node 69aaf30076ddd5d9e606fe3a INFO: 172.21.0.1:38124 - "POST /node/69aaf30076ddd5d9e606fe3a HTTP/1.0" 202 Accepted 2026-03-08 15:30:20,392 - lava_callback - INFO - Starting async job submit for node 69aaf30076ddd5d9e606fe3a 2026-03-08 15:30:20,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:30:20,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf30076ddd5d9e606fe3a HTTP/1.1" 200 None 2026-03-08 15:30:20,411 - lava_callback - DEBUG - Processing node 69aaf30076ddd5d9e606fe3a: baseline-arm64-baylibre 2026-03-08 15:30:20,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf30076ddd5d9e606fe3a 2026-03-08 15:30:20,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:30:20,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf30076ddd5d9e606fe3a HTTP/1.1" 200 None 2026-03-08 15:30:20,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:30:20,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:30:20,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:30:20,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf30076ddd5d9e606fe3a HTTP/1.1" 200 None 2026-03-08 15:30:20,510 - lava_callback - ERROR - Error processing callback for node 69aaf30076ddd5d9e606fe3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:31:40,419 - lava_callback - INFO - Received callback for node 69aaf35276ddd5d9e606fe5c INFO: 172.21.0.1:54998 - "POST /node/69aaf35276ddd5d9e606fe5c HTTP/1.0" 202 Accepted 2026-03-08 15:31:40,425 - lava_callback - INFO - Starting async job submit for node 69aaf35276ddd5d9e606fe5c 2026-03-08 15:31:40,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:31:40,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf35276ddd5d9e606fe5c HTTP/1.1" 200 None 2026-03-08 15:31:40,440 - lava_callback - DEBUG - Processing node 69aaf35276ddd5d9e606fe5c: baseline-arm64-baylibre 2026-03-08 15:31:40,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf35276ddd5d9e606fe5c 2026-03-08 15:31:40,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:31:40,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf35276ddd5d9e606fe5c HTTP/1.1" 200 None 2026-03-08 15:31:40,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:31:40,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:31:40,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:31:40,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf35276ddd5d9e606fe5c HTTP/1.1" 200 None 2026-03-08 15:31:40,498 - lava_callback - ERROR - Error processing callback for node 69aaf35276ddd5d9e606fe5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:33:00,544 - lava_callback - INFO - Received callback for node 69aaf3a376ddd5d9e606fe72 INFO: 172.21.0.1:43032 - "POST /node/69aaf3a376ddd5d9e606fe72 HTTP/1.0" 202 Accepted 2026-03-08 15:33:00,550 - lava_callback - INFO - Starting async job submit for node 69aaf3a376ddd5d9e606fe72 2026-03-08 15:33:00,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:33:00,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf3a376ddd5d9e606fe72 HTTP/1.1" 200 None 2026-03-08 15:33:00,586 - lava_callback - DEBUG - Processing node 69aaf3a376ddd5d9e606fe72: baseline-arm64-baylibre 2026-03-08 15:33:00,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf3a376ddd5d9e606fe72 2026-03-08 15:33:00,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:33:00,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf3a376ddd5d9e606fe72 HTTP/1.1" 200 None 2026-03-08 15:33:00,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:33:00,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:33:00,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:33:00,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf3a376ddd5d9e606fe72 HTTP/1.1" 200 None 2026-03-08 15:33:00,664 - lava_callback - ERROR - Error processing callback for node 69aaf3a376ddd5d9e606fe72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:46:21,294 - lava_callback - INFO - Received callback for node 69aaf6b976ddd5d9e606ff12 INFO: 172.21.0.1:34486 - "POST /node/69aaf6b976ddd5d9e606ff12 HTTP/1.0" 202 Accepted 2026-03-08 15:46:21,301 - lava_callback - INFO - Starting async job submit for node 69aaf6b976ddd5d9e606ff12 2026-03-08 15:46:21,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:46:21,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf6b976ddd5d9e606ff12 HTTP/1.1" 200 None 2026-03-08 15:46:21,317 - lava_callback - DEBUG - Processing node 69aaf6b976ddd5d9e606ff12: baseline-arm64-baylibre 2026-03-08 15:46:21,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf6b976ddd5d9e606ff12 2026-03-08 15:46:21,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:46:21,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf6b976ddd5d9e606ff12 HTTP/1.1" 200 None 2026-03-08 15:46:21,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:46:21,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:46:21,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:46:21,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf6b976ddd5d9e606ff12 HTTP/1.1" 200 None 2026-03-08 15:46:21,384 - lava_callback - ERROR - Error processing callback for node 69aaf6b976ddd5d9e606ff12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:49:21,522 - lava_callback - INFO - Received callback for node 69aaf76d76ddd5d9e606ff42 INFO: 172.21.0.1:45124 - "POST /node/69aaf76d76ddd5d9e606ff42 HTTP/1.0" 202 Accepted 2026-03-08 15:49:21,527 - lava_callback - INFO - Starting async job submit for node 69aaf76d76ddd5d9e606ff42 2026-03-08 15:49:21,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:49:21,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf76d76ddd5d9e606ff42 HTTP/1.1" 200 None 2026-03-08 15:49:21,549 - lava_callback - DEBUG - Processing node 69aaf76d76ddd5d9e606ff42: baseline-arm64-baylibre 2026-03-08 15:49:21,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf76d76ddd5d9e606ff42 2026-03-08 15:49:21,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:49:21,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf76d76ddd5d9e606ff42 HTTP/1.1" 200 None 2026-03-08 15:49:21,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:49:21,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:49:21,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:49:21,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf76d76ddd5d9e606ff42 HTTP/1.1" 200 None 2026-03-08 15:49:21,648 - lava_callback - ERROR - Error processing callback for node 69aaf76d76ddd5d9e606ff42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:50:41,556 - lava_callback - INFO - Received callback for node 69aaf7bc76ddd5d9e606ff5c INFO: 172.21.0.1:52828 - "POST /node/69aaf7bc76ddd5d9e606ff5c HTTP/1.0" 202 Accepted 2026-03-08 15:50:41,562 - lava_callback - INFO - Starting async job submit for node 69aaf7bc76ddd5d9e606ff5c 2026-03-08 15:50:41,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:50:41,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf7bc76ddd5d9e606ff5c HTTP/1.1" 200 None 2026-03-08 15:50:41,598 - lava_callback - DEBUG - Processing node 69aaf7bc76ddd5d9e606ff5c: baseline-arm64-baylibre 2026-03-08 15:50:41,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf7bc76ddd5d9e606ff5c 2026-03-08 15:50:41,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:50:41,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf7bc76ddd5d9e606ff5c HTTP/1.1" 200 None 2026-03-08 15:50:41,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:50:41,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:50:41,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:50:41,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf7bc76ddd5d9e606ff5c HTTP/1.1" 200 None 2026-03-08 15:50:41,671 - lava_callback - ERROR - Error processing callback for node 69aaf7bc76ddd5d9e606ff5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:53:01,659 - lava_callback - INFO - Received callback for node 69aaf84976ddd5d9e606ff7f INFO: 172.21.0.1:37454 - "POST /node/69aaf84976ddd5d9e606ff7f HTTP/1.0" 202 Accepted 2026-03-08 15:53:01,664 - lava_callback - INFO - Starting async job submit for node 69aaf84976ddd5d9e606ff7f 2026-03-08 15:53:01,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:53:01,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf84976ddd5d9e606ff7f HTTP/1.1" 200 None 2026-03-08 15:53:01,681 - lava_callback - DEBUG - Processing node 69aaf84976ddd5d9e606ff7f: baseline-arm64-baylibre 2026-03-08 15:53:01,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf84976ddd5d9e606ff7f 2026-03-08 15:53:01,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:53:01,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf84976ddd5d9e606ff7f HTTP/1.1" 200 None 2026-03-08 15:53:01,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:53:01,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:53:01,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:53:01,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf84976ddd5d9e606ff7f HTTP/1.1" 200 None 2026-03-08 15:53:01,783 - lava_callback - ERROR - Error processing callback for node 69aaf84976ddd5d9e606ff7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:54:21,720 - lava_callback - INFO - Received callback for node 69aaf89b76ddd5d9e606ffa4 INFO: 172.21.0.1:56086 - "POST /node/69aaf89b76ddd5d9e606ffa4 HTTP/1.0" 202 Accepted 2026-03-08 15:54:21,725 - lava_callback - INFO - Starting async job submit for node 69aaf89b76ddd5d9e606ffa4 2026-03-08 15:54:21,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:54:21,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf89b76ddd5d9e606ffa4 HTTP/1.1" 200 None 2026-03-08 15:54:21,762 - lava_callback - DEBUG - Processing node 69aaf89b76ddd5d9e606ffa4: baseline-arm64-baylibre 2026-03-08 15:54:21,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf89b76ddd5d9e606ffa4 2026-03-08 15:54:21,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:54:21,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf89b76ddd5d9e606ffa4 HTTP/1.1" 200 None 2026-03-08 15:54:21,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:54:21,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:54:21,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:54:21,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf89b76ddd5d9e606ffa4 HTTP/1.1" 200 None 2026-03-08 15:54:21,877 - lava_callback - ERROR - Error processing callback for node 69aaf89b76ddd5d9e606ffa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:56:21,953 - lava_callback - INFO - Received callback for node 69aaf91476ddd5d9e606ffd2 INFO: 172.21.0.1:40726 - "POST /node/69aaf91476ddd5d9e606ffd2 HTTP/1.0" 202 Accepted 2026-03-08 15:56:21,958 - lava_callback - INFO - Starting async job submit for node 69aaf91476ddd5d9e606ffd2 2026-03-08 15:56:21,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:56:22,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf91476ddd5d9e606ffd2 HTTP/1.1" 200 None 2026-03-08 15:56:22,123 - lava_callback - DEBUG - Processing node 69aaf91476ddd5d9e606ffd2: baseline-arm64-baylibre 2026-03-08 15:56:22,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf91476ddd5d9e606ffd2 2026-03-08 15:56:22,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:56:22,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf91476ddd5d9e606ffd2 HTTP/1.1" 200 None 2026-03-08 15:56:22,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:56:22,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:56:22,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:56:22,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf91476ddd5d9e606ffd2 HTTP/1.1" 200 None 2026-03-08 15:56:22,190 - lava_callback - ERROR - Error processing callback for node 69aaf91476ddd5d9e606ffd2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK 2026-03-08 15:58:21,998 - lava_callback - INFO - Received callback for node 69aaf98c76ddd5d9e606fff3 INFO: 172.21.0.1:33846 - "POST /node/69aaf98c76ddd5d9e606fff3 HTTP/1.0" 202 Accepted 2026-03-08 15:58:22,003 - lava_callback - INFO - Starting async job submit for node 69aaf98c76ddd5d9e606fff3 2026-03-08 15:58:22,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:58:22,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf98c76ddd5d9e606fff3 HTTP/1.1" 200 None 2026-03-08 15:58:22,019 - lava_callback - DEBUG - Processing node 69aaf98c76ddd5d9e606fff3: baseline-arm64-baylibre 2026-03-08 15:58:22,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aaf98c76ddd5d9e606fff3 2026-03-08 15:58:22,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:58:22,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaf98c76ddd5d9e606fff3 HTTP/1.1" 200 None 2026-03-08 15:58:22,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:58:22,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-08 15:58:22,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-08 15:58:22,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaf98c76ddd5d9e606fff3 HTTP/1.1" 200 None 2026-03-08 15:58:22,083 - lava_callback - ERROR - Error processing callback for node 69aaf98c76ddd5d9e606fff3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]