INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:54740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:16:26,258 - lava_callback - INFO - Received callback for node 69b1339ba870a1dc3343c387 2026-03-12 00:16:26,268 - lava_callback - INFO - Starting async job submit for node 69b1339ba870a1dc3343c387 INFO: 172.21.0.1:57672 - "POST /node/69b1339ba870a1dc3343c387 HTTP/1.0" 202 Accepted 2026-03-12 00:16:26,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:26,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1339ba870a1dc3343c387 HTTP/1.1" 200 None 2026-03-12 00:16:26,342 - lava_callback - DEBUG - Processing node 69b1339ba870a1dc3343c387: baseline-x86 INFO: 172.21.0.1:57684 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:16:26,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:16:26,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:16:26,842 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1339ba870a1dc3343c387/log.txt.gz 2026-03-12 00:16:27,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:16:27,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:16:27,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1339ba870a1dc3343c387/lava-logs.yaml 2026-03-12 00:16:27,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:16:27,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:16:27,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1339ba870a1dc3343c387/lava_callback.json.gz 2026-03-12 00:16:27,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:27,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1339ba870a1dc3343c387 HTTP/1.1" 200 None 2026-03-12 00:16:27,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:27,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-12 00:16:27,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:27,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1339ba870a1dc3343c387 HTTP/1.1" 200 None 2026-03-12 00:16:27,531 - lava_callback - INFO - Completed processing callback for node 69b1339ba870a1dc3343c387 INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:16:57,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:57,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:20:28,483 - lava_callback - INFO - Received callback for node 69b1c019a26b422765ba3f9e INFO: 172.21.0.1:34404 - "POST /node/69b1c019a26b422765ba3f9e HTTP/1.0" 202 Accepted 2026-03-12 00:20:28,489 - lava_callback - INFO - Starting async job submit for node 69b1c019a26b422765ba3f9e 2026-03-12 00:20:28,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:28,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c019a26b422765ba3f9e HTTP/1.1" 200 None 2026-03-12 00:20:28,551 - lava_callback - DEBUG - Processing node 69b1c019a26b422765ba3f9e: baseline-arm64-broonie 2026-03-12 00:20:28,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:20:29,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:20:29,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c019a26b422765ba3f9e/log.txt.gz 2026-03-12 00:20:29,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:20:29,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:20:29,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c019a26b422765ba3f9e/lava-logs.yaml 2026-03-12 00:20:29,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:20:29,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:20:29,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c019a26b422765ba3f9e/lava_callback.json.gz 2026-03-12 00:20:29,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:29,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c019a26b422765ba3f9e HTTP/1.1" 200 None 2026-03-12 00:20:29,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:29,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 00:20:29,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:29,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c019a26b422765ba3f9e HTTP/1.1" 200 None 2026-03-12 00:20:29,690 - lava_callback - INFO - Completed processing callback for node 69b1c019a26b422765ba3f9e INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:20:57,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:57,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:21:39,080 - lava_callback - INFO - Received callback for node 69b18c24a870a1dc3343d182 INFO: 172.21.0.1:55130 - "POST /node/69b18c24a870a1dc3343d182 HTTP/1.0" 202 Accepted 2026-03-12 00:21:39,086 - lava_callback - INFO - Starting async job submit for node 69b18c24a870a1dc3343d182 2026-03-12 00:21:39,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:39,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18c24a870a1dc3343d182 HTTP/1.1" 200 None 2026-03-12 00:21:39,137 - lava_callback - DEBUG - Processing node 69b18c24a870a1dc3343d182: baseline-x86 2026-03-12 00:21:39,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:21:39,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:21:39,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b18c24a870a1dc3343d182/log.txt.gz 2026-03-12 00:21:39,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:21:40,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:21:40,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b18c24a870a1dc3343d182/lava-logs.yaml 2026-03-12 00:21:40,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:21:40,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:21:40,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b18c24a870a1dc3343d182/lava_callback.json.gz 2026-03-12 00:21:40,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:40,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18c24a870a1dc3343d182 HTTP/1.1" 200 None 2026-03-12 00:21:40,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:40,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-12 00:21:40,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:40,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18c24a870a1dc3343d182 HTTP/1.1" 200 None 2026-03-12 00:21:40,488 - lava_callback - INFO - Completed processing callback for node 69b18c24a870a1dc3343d182 INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:21:57,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:57,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:25:05,484 - lava_callback - INFO - Received callback for node 69b1bec6a26b422765ba3e9a INFO: 172.21.0.1:59832 - "POST /node/69b1bec6a26b422765ba3e9a HTTP/1.0" 202 Accepted 2026-03-12 00:25:05,490 - lava_callback - INFO - Starting async job submit for node 69b1bec6a26b422765ba3e9a 2026-03-12 00:25:05,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:25:05,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec6a26b422765ba3e9a HTTP/1.1" 200 None 2026-03-12 00:25:05,526 - lava_callback - DEBUG - Processing node 69b1bec6a26b422765ba3e9a: baseline-x86 2026-03-12 00:25:05,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:25:05,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:25:05,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec6a26b422765ba3e9a/log.txt.gz 2026-03-12 00:25:06,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:25:06,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:25:06,357 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec6a26b422765ba3e9a/lava-logs.yaml 2026-03-12 00:25:06,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:25:06,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:25:06,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec6a26b422765ba3e9a/lava_callback.json.gz 2026-03-12 00:25:06,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:25:06,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec6a26b422765ba3e9a HTTP/1.1" 200 None 2026-03-12 00:25:06,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:25:06,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19625a26b422765ba3731 HTTP/1.1" 200 None 2026-03-12 00:25:06,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:25:06,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bec6a26b422765ba3e9a HTTP/1.1" 200 None 2026-03-12 00:25:06,579 - lava_callback - INFO - Completed processing callback for node 69b1bec6a26b422765ba3e9a INFO: 172.21.0.1:44902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:25:27,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:25:27,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:26:35,238 - lava_callback - INFO - Received callback for node 69b1e0e0a26b422765ba4841 INFO: 172.21.0.1:55818 - "POST /node/69b1e0e0a26b422765ba4841 HTTP/1.0" 202 Accepted 2026-03-12 00:26:35,244 - lava_callback - INFO - Starting async job submit for node 69b1e0e0a26b422765ba4841 2026-03-12 00:26:35,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:35,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e0e0a26b422765ba4841 HTTP/1.1" 200 None 2026-03-12 00:26:35,306 - lava_callback - DEBUG - Processing node 69b1e0e0a26b422765ba4841: baseline-x86 2026-03-12 00:26:35,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:26:35,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:26:35,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1e0e0a26b422765ba4841/log.txt.gz 2026-03-12 00:26:35,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:26:36,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:26:36,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1e0e0a26b422765ba4841/lava-logs.yaml 2026-03-12 00:26:36,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:26:36,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:26:36,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1e0e0a26b422765ba4841/lava_callback.json.gz 2026-03-12 00:26:36,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e0e0a26b422765ba4841 HTTP/1.1" 200 None 2026-03-12 00:26:36,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:36,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-12 00:26:36,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:36,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e0e0a26b422765ba4841 HTTP/1.1" 200 None 2026-03-12 00:26:36,484 - lava_callback - INFO - Completed processing callback for node 69b1e0e0a26b422765ba4841 INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:26:57,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:57,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:32:48,884 - lava_callback - INFO - Received callback for node 69b20930b0f5558b5d7cc9dd INFO: 172.21.0.1:49746 - "POST /node/69b20930b0f5558b5d7cc9dd HTTP/1.0" 202 Accepted 2026-03-12 00:32:48,890 - lava_callback - INFO - Starting async job submit for node 69b20930b0f5558b5d7cc9dd 2026-03-12 00:32:48,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:48,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20930b0f5558b5d7cc9dd HTTP/1.1" 200 None 2026-03-12 00:32:48,959 - lava_callback - DEBUG - Processing node 69b20930b0f5558b5d7cc9dd: baseline-arm 2026-03-12 00:32:49,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:32:49,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:32:49,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20930b0f5558b5d7cc9dd/log.txt.gz 2026-03-12 00:32:49,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:32:49,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:32:49,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20930b0f5558b5d7cc9dd/lava-logs.yaml 2026-03-12 00:32:49,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:32:49,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:32:49,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20930b0f5558b5d7cc9dd/lava_callback.json.gz 2026-03-12 00:32:49,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:49,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20930b0f5558b5d7cc9dd HTTP/1.1" 200 None 2026-03-12 00:32:49,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:49,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 00:32:49,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:49,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20930b0f5558b5d7cc9dd HTTP/1.1" 200 None 2026-03-12 00:32:49,902 - lava_callback - INFO - Completed processing callback for node 69b20930b0f5558b5d7cc9dd INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:32:57,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:57,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:36:46,848 - lava_callback - INFO - Received callback for node 69af678e275c8d3b79399e26 INFO: 172.21.0.1:52836 - "POST /node/69af678e275c8d3b79399e26 HTTP/1.0" 202 Accepted 2026-03-12 00:36:46,855 - lava_callback - INFO - Starting async job submit for node 69af678e275c8d3b79399e26 2026-03-12 00:36:46,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:46,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af678e275c8d3b79399e26 HTTP/1.1" 200 None 2026-03-12 00:36:46,929 - lava_callback - DEBUG - Processing node 69af678e275c8d3b79399e26: baseline-arm-baylibre 2026-03-12 00:36:46,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af678e275c8d3b79399e26 2026-03-12 00:36:46,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:46,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af678e275c8d3b79399e26 HTTP/1.1" 200 None 2026-03-12 00:36:46,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:46,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:46,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:46,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af678e275c8d3b79399e26 HTTP/1.1" 200 None 2026-03-12 00:36:47,001 - lava_callback - ERROR - Error processing callback for node 69af678e275c8d3b79399e26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:47,523 - lava_callback - INFO - Received callback for node 69af678f275c8d3b79399e29 INFO: 172.21.0.1:52838 - "POST /node/69af678f275c8d3b79399e29 HTTP/1.0" 202 Accepted 2026-03-12 00:36:47,529 - lava_callback - INFO - Starting async job submit for node 69af678f275c8d3b79399e29 2026-03-12 00:36:47,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:47,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af678f275c8d3b79399e29 HTTP/1.1" 200 None 2026-03-12 00:36:47,545 - lava_callback - DEBUG - Processing node 69af678f275c8d3b79399e29: baseline-arm-baylibre 2026-03-12 00:36:47,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af678f275c8d3b79399e29 2026-03-12 00:36:47,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:47,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af678f275c8d3b79399e29 HTTP/1.1" 200 None 2026-03-12 00:36:47,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:47,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:47,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:47,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af678f275c8d3b79399e29 HTTP/1.1" 200 None 2026-03-12 00:36:47,604 - lava_callback - ERROR - Error processing callback for node 69af678f275c8d3b79399e29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:48,194 - lava_callback - INFO - Received callback for node 69af6790275c8d3b79399e2c INFO: 172.21.0.1:52852 - "POST /node/69af6790275c8d3b79399e2c HTTP/1.0" 202 Accepted 2026-03-12 00:36:48,199 - lava_callback - INFO - Starting async job submit for node 69af6790275c8d3b79399e2c 2026-03-12 00:36:48,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6790275c8d3b79399e2c HTTP/1.1" 200 None 2026-03-12 00:36:48,215 - lava_callback - DEBUG - Processing node 69af6790275c8d3b79399e2c: baseline-arm-baylibre 2026-03-12 00:36:48,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6790275c8d3b79399e2c 2026-03-12 00:36:48,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6790275c8d3b79399e2c HTTP/1.1" 200 None 2026-03-12 00:36:48,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:48,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6790275c8d3b79399e2c HTTP/1.1" 200 None 2026-03-12 00:36:48,272 - lava_callback - ERROR - Error processing callback for node 69af6790275c8d3b79399e2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:48,860 - lava_callback - INFO - Received callback for node 69af6792275c8d3b79399e2f INFO: 172.21.0.1:52868 - "POST /node/69af6792275c8d3b79399e2f HTTP/1.0" 202 Accepted 2026-03-12 00:36:48,866 - lava_callback - INFO - Starting async job submit for node 69af6792275c8d3b79399e2f 2026-03-12 00:36:48,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6792275c8d3b79399e2f HTTP/1.1" 200 None 2026-03-12 00:36:48,882 - lava_callback - DEBUG - Processing node 69af6792275c8d3b79399e2f: baseline-arm-baylibre 2026-03-12 00:36:48,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6792275c8d3b79399e2f 2026-03-12 00:36:48,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6792275c8d3b79399e2f HTTP/1.1" 200 None 2026-03-12 00:36:48,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:48,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6792275c8d3b79399e2f HTTP/1.1" 200 None 2026-03-12 00:36:48,945 - lava_callback - ERROR - Error processing callback for node 69af6792275c8d3b79399e2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:49,548 - lava_callback - INFO - Received callback for node 69af6794275c8d3b79399e3f INFO: 172.21.0.1:52870 - "POST /node/69af6794275c8d3b79399e3f HTTP/1.0" 202 Accepted 2026-03-12 00:36:49,554 - lava_callback - INFO - Starting async job submit for node 69af6794275c8d3b79399e3f 2026-03-12 00:36:49,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:49,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6794275c8d3b79399e3f HTTP/1.1" 200 None 2026-03-12 00:36:49,570 - lava_callback - DEBUG - Processing node 69af6794275c8d3b79399e3f: baseline-arm-baylibre 2026-03-12 00:36:49,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6794275c8d3b79399e3f 2026-03-12 00:36:49,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:49,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6794275c8d3b79399e3f HTTP/1.1" 200 None 2026-03-12 00:36:49,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:49,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:49,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:49,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6794275c8d3b79399e3f HTTP/1.1" 200 None 2026-03-12 00:36:49,631 - lava_callback - ERROR - Error processing callback for node 69af6794275c8d3b79399e3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:50,210 - lava_callback - INFO - Received callback for node 69af6796275c8d3b79399e42 INFO: 172.21.0.1:52222 - "POST /node/69af6796275c8d3b79399e42 HTTP/1.0" 202 Accepted 2026-03-12 00:36:50,215 - lava_callback - INFO - Starting async job submit for node 69af6796275c8d3b79399e42 2026-03-12 00:36:50,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:50,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6796275c8d3b79399e42 HTTP/1.1" 200 None 2026-03-12 00:36:50,231 - lava_callback - DEBUG - Processing node 69af6796275c8d3b79399e42: baseline-arm-baylibre 2026-03-12 00:36:50,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6796275c8d3b79399e42 2026-03-12 00:36:50,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:50,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6796275c8d3b79399e42 HTTP/1.1" 200 None 2026-03-12 00:36:50,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:50,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:50,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:50,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6796275c8d3b79399e42 HTTP/1.1" 200 None 2026-03-12 00:36:50,307 - lava_callback - ERROR - Error processing callback for node 69af6796275c8d3b79399e42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:37:01,990 - lava_callback - INFO - Received callback for node 69af679f275c8d3b79399e72 INFO: 172.21.0.1:47322 - "POST /node/69af679f275c8d3b79399e72 HTTP/1.0" 202 Accepted 2026-03-12 00:37:01,995 - lava_callback - INFO - Starting async job submit for node 69af679f275c8d3b79399e72 2026-03-12 00:37:01,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af679f275c8d3b79399e72 HTTP/1.1" 200 None 2026-03-12 00:37:02,012 - lava_callback - DEBUG - Processing node 69af679f275c8d3b79399e72: baseline-arm-clabbe 2026-03-12 00:37:02,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af679f275c8d3b79399e72 2026-03-12 00:37:02,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af679f275c8d3b79399e72 HTTP/1.1" 200 None 2026-03-12 00:37:02,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:02,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af679f275c8d3b79399e72 HTTP/1.1" 200 None 2026-03-12 00:37:02,063 - lava_callback - ERROR - Error processing callback for node 69af679f275c8d3b79399e72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:37:02,651 - lava_callback - INFO - Received callback for node 69af67a3275c8d3b79399e80 INFO: 172.21.0.1:47332 - "POST /node/69af67a3275c8d3b79399e80 HTTP/1.0" 202 Accepted 2026-03-12 00:37:02,656 - lava_callback - INFO - Starting async job submit for node 69af67a3275c8d3b79399e80 2026-03-12 00:37:02,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a3275c8d3b79399e80 HTTP/1.1" 200 None 2026-03-12 00:37:02,672 - lava_callback - DEBUG - Processing node 69af67a3275c8d3b79399e80: baseline-arm-clabbe 2026-03-12 00:37:02,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af67a3275c8d3b79399e80 2026-03-12 00:37:02,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a3275c8d3b79399e80 HTTP/1.1" 200 None 2026-03-12 00:37:02,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:02,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af67a3275c8d3b79399e80 HTTP/1.1" 200 None 2026-03-12 00:37:02,723 - lava_callback - ERROR - Error processing callback for node 69af67a3275c8d3b79399e80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:37:03,310 - lava_callback - INFO - Received callback for node 69af67a4275c8d3b79399e83 INFO: 172.21.0.1:47342 - "POST /node/69af67a4275c8d3b79399e83 HTTP/1.0" 202 Accepted 2026-03-12 00:37:03,316 - lava_callback - INFO - Starting async job submit for node 69af67a4275c8d3b79399e83 2026-03-12 00:37:03,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a4275c8d3b79399e83 HTTP/1.1" 200 None 2026-03-12 00:37:03,333 - lava_callback - DEBUG - Processing node 69af67a4275c8d3b79399e83: baseline-arm-clabbe 2026-03-12 00:37:03,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af67a4275c8d3b79399e83 2026-03-12 00:37:03,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a4275c8d3b79399e83 HTTP/1.1" 200 None 2026-03-12 00:37:03,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:03,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af67a4275c8d3b79399e83 HTTP/1.1" 200 None 2026-03-12 00:37:03,394 - lava_callback - ERROR - Error processing callback for node 69af67a4275c8d3b79399e83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:37:03,968 - lava_callback - INFO - Received callback for node 69af67a5275c8d3b79399e86 INFO: 172.21.0.1:47352 - "POST /node/69af67a5275c8d3b79399e86 HTTP/1.0" 202 Accepted 2026-03-12 00:37:03,973 - lava_callback - INFO - Starting async job submit for node 69af67a5275c8d3b79399e86 2026-03-12 00:37:03,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a5275c8d3b79399e86 HTTP/1.1" 200 None 2026-03-12 00:37:03,989 - lava_callback - DEBUG - Processing node 69af67a5275c8d3b79399e86: baseline-arm-clabbe 2026-03-12 00:37:03,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af67a5275c8d3b79399e86 2026-03-12 00:37:03,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a5275c8d3b79399e86 HTTP/1.1" 200 None 2026-03-12 00:37:04,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:04,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af67a5275c8d3b79399e86 HTTP/1.1" 200 None 2026-03-12 00:37:04,045 - lava_callback - ERROR - Error processing callback for node 69af67a5275c8d3b79399e86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:37:04,636 - lava_callback - INFO - Received callback for node 69af67a8275c8d3b79399e8f INFO: 172.21.0.1:47362 - "POST /node/69af67a8275c8d3b79399e8f HTTP/1.0" 202 Accepted 2026-03-12 00:37:04,641 - lava_callback - INFO - Starting async job submit for node 69af67a8275c8d3b79399e8f 2026-03-12 00:37:04,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a8275c8d3b79399e8f HTTP/1.1" 200 None 2026-03-12 00:37:04,661 - lava_callback - DEBUG - Processing node 69af67a8275c8d3b79399e8f: baseline-arm-clabbe 2026-03-12 00:37:04,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af67a8275c8d3b79399e8f 2026-03-12 00:37:04,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a8275c8d3b79399e8f HTTP/1.1" 200 None 2026-03-12 00:37:04,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:04,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af67a8275c8d3b79399e8f HTTP/1.1" 200 None 2026-03-12 00:37:04,714 - lava_callback - ERROR - Error processing callback for node 69af67a8275c8d3b79399e8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46408 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:43:42,187 - lava_callback - INFO - Received callback for node 69af6930275c8d3b79399fe7 INFO: 172.21.0.1:44188 - "POST /node/69af6930275c8d3b79399fe7 HTTP/1.0" 202 Accepted 2026-03-12 00:43:42,193 - lava_callback - INFO - Starting async job submit for node 69af6930275c8d3b79399fe7 2026-03-12 00:43:42,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:43:42,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6930275c8d3b79399fe7 HTTP/1.1" 200 None 2026-03-12 00:43:42,217 - lava_callback - DEBUG - Processing node 69af6930275c8d3b79399fe7: baseline-arm-clabbe 2026-03-12 00:43:42,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6930275c8d3b79399fe7 2026-03-12 00:43:42,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:43:42,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6930275c8d3b79399fe7 HTTP/1.1" 200 None 2026-03-12 00:43:42,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:43:42,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 00:43:42,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:43:42,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6930275c8d3b79399fe7 HTTP/1.1" 200 None 2026-03-12 00:43:42,276 - lava_callback - ERROR - Error processing callback for node 69af6930275c8d3b79399fe7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:45:02,176 - lava_callback - INFO - Received callback for node 69af6983275c8d3b7939a003 INFO: 172.21.0.1:60764 - "POST /node/69af6983275c8d3b7939a003 HTTP/1.0" 202 Accepted 2026-03-12 00:45:02,182 - lava_callback - INFO - Starting async job submit for node 69af6983275c8d3b7939a003 2026-03-12 00:45:02,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:45:02,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6983275c8d3b7939a003 HTTP/1.1" 200 None 2026-03-12 00:45:02,207 - lava_callback - DEBUG - Processing node 69af6983275c8d3b7939a003: baseline-arm-clabbe 2026-03-12 00:45:02,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6983275c8d3b7939a003 2026-03-12 00:45:02,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:45:02,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6983275c8d3b7939a003 HTTP/1.1" 200 None 2026-03-12 00:45:02,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:45:02,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 00:45:02,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:45:02,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6983275c8d3b7939a003 HTTP/1.1" 200 None 2026-03-12 00:45:02,297 - lava_callback - ERROR - Error processing callback for node 69af6983275c8d3b7939a003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:46:22,324 - lava_callback - INFO - Received callback for node 69af69d5275c8d3b7939a3bd INFO: 172.21.0.1:44390 - "POST /node/69af69d5275c8d3b7939a3bd HTTP/1.0" 202 Accepted 2026-03-12 00:46:22,330 - lava_callback - INFO - Starting async job submit for node 69af69d5275c8d3b7939a3bd 2026-03-12 00:46:22,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:46:22,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af69d5275c8d3b7939a3bd HTTP/1.1" 200 None 2026-03-12 00:46:22,347 - lava_callback - DEBUG - Processing node 69af69d5275c8d3b7939a3bd: baseline-arm-clabbe 2026-03-12 00:46:22,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af69d5275c8d3b7939a3bd 2026-03-12 00:46:22,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:46:22,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af69d5275c8d3b7939a3bd HTTP/1.1" 200 None 2026-03-12 00:46:22,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:46:22,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 00:46:22,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:46:22,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af69d5275c8d3b7939a3bd HTTP/1.1" 200 None 2026-03-12 00:46:22,399 - lava_callback - ERROR - Error processing callback for node 69af69d5275c8d3b7939a3bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:50:37,273 - lava_callback - INFO - Received callback for node 69b20dc9b0f5558b5d7ccab5 INFO: 172.21.0.1:60460 - "POST /node/69b20dc9b0f5558b5d7ccab5 HTTP/1.0" 202 Accepted 2026-03-12 00:50:37,279 - lava_callback - INFO - Starting async job submit for node 69b20dc9b0f5558b5d7ccab5 2026-03-12 00:50:37,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:37,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc9b0f5558b5d7ccab5 HTTP/1.1" 200 None 2026-03-12 00:50:37,297 - lava_callback - DEBUG - Processing node 69b20dc9b0f5558b5d7ccab5: baseline-arm 2026-03-12 00:50:37,302 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:50:37,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:37,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:37,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc9b0f5558b5d7ccab5/lava-logs.yaml 2026-03-12 00:50:37,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:37,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:37,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc9b0f5558b5d7ccab5/lava_callback.json.gz 2026-03-12 00:50:37,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:37,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc9b0f5558b5d7ccab5 HTTP/1.1" 200 None 2026-03-12 00:50:37,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:37,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:50:37,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:37,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dc9b0f5558b5d7ccab5 HTTP/1.1" 200 None 2026-03-12 00:50:37,621 - lava_callback - INFO - Completed processing callback for node 69b20dc9b0f5558b5d7ccab5 INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38542 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:50:47,082 - lava_callback - INFO - Received callback for node 69b20dc8b0f5558b5d7ccab2 INFO: 172.21.0.1:38554 - "POST /node/69b20dc8b0f5558b5d7ccab2 HTTP/1.0" 202 Accepted 2026-03-12 00:50:47,088 - lava_callback - INFO - Starting async job submit for node 69b20dc8b0f5558b5d7ccab2 2026-03-12 00:50:47,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:47,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc8b0f5558b5d7ccab2 HTTP/1.1" 200 None 2026-03-12 00:50:47,110 - lava_callback - DEBUG - Processing node 69b20dc8b0f5558b5d7ccab2: baseline-arm 2026-03-12 00:50:47,115 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:50:47,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:47,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:47,240 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc8b0f5558b5d7ccab2/lava-logs.yaml 2026-03-12 00:50:47,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:47,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:47,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc8b0f5558b5d7ccab2/lava_callback.json.gz 2026-03-12 00:50:47,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:47,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc8b0f5558b5d7ccab2 HTTP/1.1" 200 None 2026-03-12 00:50:47,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:47,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:50:47,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:47,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dc8b0f5558b5d7ccab2 HTTP/1.1" 200 None 2026-03-12 00:50:47,468 - lava_callback - INFO - Completed processing callback for node 69b20dc8b0f5558b5d7ccab2 2026-03-12 00:50:50,518 - lava_callback - INFO - Received callback for node 69b20932b0f5558b5d7cc9e0 INFO: 172.21.0.1:43212 - "POST /node/69b20932b0f5558b5d7cc9e0 HTTP/1.0" 202 Accepted 2026-03-12 00:50:50,525 - lava_callback - INFO - Starting async job submit for node 69b20932b0f5558b5d7cc9e0 2026-03-12 00:50:50,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:50,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20932b0f5558b5d7cc9e0 HTTP/1.1" 200 None 2026-03-12 00:50:50,647 - lava_callback - DEBUG - Processing node 69b20932b0f5558b5d7cc9e0: ltp-smoke 2026-03-12 00:50:51,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:51,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:51,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20932b0f5558b5d7cc9e0/log.txt.gz 2026-03-12 00:50:51,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:51,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:51,873 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20932b0f5558b5d7cc9e0/lava-logs.yaml 2026-03-12 00:50:51,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:52,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:52,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20932b0f5558b5d7cc9e0/lava_callback.json.gz 2026-03-12 00:50:52,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:52,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20932b0f5558b5d7cc9e0 HTTP/1.1" 200 None 2026-03-12 00:50:52,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:52,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 00:50:52,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:52,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20932b0f5558b5d7cc9e0 HTTP/1.1" 200 None 2026-03-12 00:50:52,499 - lava_callback - INFO - Completed processing callback for node 69b20932b0f5558b5d7cc9e0 INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:50:57,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:57,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:07,954 - lava_callback - INFO - Received callback for node 69af6af2275c8d3b7939a412 INFO: 172.21.0.1:58704 - "POST /node/69af6af2275c8d3b7939a412 HTTP/1.0" 202 Accepted 2026-03-12 00:51:07,959 - lava_callback - INFO - Starting async job submit for node 69af6af2275c8d3b7939a412 2026-03-12 00:51:07,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:07,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6af2275c8d3b7939a412 HTTP/1.1" 200 None 2026-03-12 00:51:07,976 - lava_callback - DEBUG - Processing node 69af6af2275c8d3b7939a412: baseline-arm-baylibre 2026-03-12 00:51:07,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6af2275c8d3b7939a412 2026-03-12 00:51:07,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6af2275c8d3b7939a412 HTTP/1.1" 200 None 2026-03-12 00:51:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:08,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:51:08,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:08,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6af2275c8d3b7939a412 HTTP/1.1" 200 None 2026-03-12 00:51:08,034 - lava_callback - ERROR - Error processing callback for node 69af6af2275c8d3b7939a412: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:51:10,277 - lava_callback - INFO - Received callback for node 69b20dccb0f5558b5d7ccabe INFO: 172.21.0.1:60340 - "POST /node/69b20dccb0f5558b5d7ccabe HTTP/1.0" 202 Accepted 2026-03-12 00:51:10,326 - lava_callback - INFO - Starting async job submit for node 69b20dccb0f5558b5d7ccabe 2026-03-12 00:51:10,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:10,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dccb0f5558b5d7ccabe HTTP/1.1" 200 None 2026-03-12 00:51:10,359 - lava_callback - DEBUG - Processing node 69b20dccb0f5558b5d7ccabe: baseline-arm 2026-03-12 00:51:10,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:10,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:10,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dccb0f5558b5d7ccabe/log.txt.gz 2026-03-12 00:51:10,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:10,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:10,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dccb0f5558b5d7ccabe/lava-logs.yaml 2026-03-12 00:51:10,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:10,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:10,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dccb0f5558b5d7ccabe/lava_callback.json.gz 2026-03-12 00:51:11,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:11,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dccb0f5558b5d7ccabe HTTP/1.1" 200 None 2026-03-12 00:51:11,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:11,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:51:11,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:11,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dccb0f5558b5d7ccabe HTTP/1.1" 200 None 2026-03-12 00:51:11,122 - lava_callback - INFO - Completed processing callback for node 69b20dccb0f5558b5d7ccabe INFO: 172.21.0.1:60352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:27,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:40,866 - lava_callback - INFO - Received callback for node 69b20dcbb0f5558b5d7ccabb INFO: 172.21.0.1:56466 - "POST /node/69b20dcbb0f5558b5d7ccabb HTTP/1.0" 202 Accepted 2026-03-12 00:51:40,872 - lava_callback - INFO - Starting async job submit for node 69b20dcbb0f5558b5d7ccabb 2026-03-12 00:51:40,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:40,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcbb0f5558b5d7ccabb HTTP/1.1" 200 None 2026-03-12 00:51:40,908 - lava_callback - DEBUG - Processing node 69b20dcbb0f5558b5d7ccabb: baseline-arm 2026-03-12 00:51:41,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:41,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:41,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcbb0f5558b5d7ccabb/log.txt.gz 2026-03-12 00:51:41,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:41,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:41,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcbb0f5558b5d7ccabb/lava-logs.yaml 2026-03-12 00:51:41,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:41,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:41,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcbb0f5558b5d7ccabb/lava_callback.json.gz 2026-03-12 00:51:41,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:41,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcbb0f5558b5d7ccabb HTTP/1.1" 200 None 2026-03-12 00:51:41,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:41,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:51:41,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:41,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dcbb0f5558b5d7ccabb HTTP/1.1" 200 None 2026-03-12 00:51:41,911 - lava_callback - INFO - Completed processing callback for node 69b20dcbb0f5558b5d7ccabb INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:50,339 - lava_callback - INFO - Received callback for node 69b20dc7b0f5558b5d7ccaaf INFO: 172.21.0.1:42662 - "POST /node/69b20dc7b0f5558b5d7ccaaf HTTP/1.0" 202 Accepted 2026-03-12 00:51:50,346 - lava_callback - INFO - Starting async job submit for node 69b20dc7b0f5558b5d7ccaaf 2026-03-12 00:51:50,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:50,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc7b0f5558b5d7ccaaf HTTP/1.1" 200 None 2026-03-12 00:51:50,443 - lava_callback - DEBUG - Processing node 69b20dc7b0f5558b5d7ccaaf: baseline-arm 2026-03-12 00:51:50,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:50,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:50,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc7b0f5558b5d7ccaaf/log.txt.gz 2026-03-12 00:51:50,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:51,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:51,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc7b0f5558b5d7ccaaf/lava-logs.yaml 2026-03-12 00:51:51,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:51,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:51,321 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc7b0f5558b5d7ccaaf/lava_callback.json.gz 2026-03-12 00:51:51,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:51,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc7b0f5558b5d7ccaaf HTTP/1.1" 200 None 2026-03-12 00:51:51,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:51,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:51:51,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:51,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dc7b0f5558b5d7ccaaf HTTP/1.1" 200 None 2026-03-12 00:51:51,463 - lava_callback - INFO - Completed processing callback for node 69b20dc7b0f5558b5d7ccaaf INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:57,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:57,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:52:03,683 - lava_callback - INFO - Received callback for node 69b20df0b0f5558b5d7ccb4e INFO: 172.21.0.1:38972 - "POST /node/69b20df0b0f5558b5d7ccb4e HTTP/1.0" 202 Accepted 2026-03-12 00:52:03,729 - lava_callback - INFO - Starting async job submit for node 69b20df0b0f5558b5d7ccb4e 2026-03-12 00:52:03,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:03,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20df0b0f5558b5d7ccb4e HTTP/1.1" 200 None 2026-03-12 00:52:03,768 - lava_callback - DEBUG - Processing node 69b20df0b0f5558b5d7ccb4e: baseline-arm-pengutronix 2026-03-12 00:52:03,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:04,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:04,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20df0b0f5558b5d7ccb4e/log.txt.gz 2026-03-12 00:52:04,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:04,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:04,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20df0b0f5558b5d7ccb4e/lava-logs.yaml 2026-03-12 00:52:04,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:04,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:04,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20df0b0f5558b5d7ccb4e/lava_callback.json.gz 2026-03-12 00:52:04,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:04,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20df0b0f5558b5d7ccb4e HTTP/1.1" 200 None 2026-03-12 00:52:04,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:04,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:04,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:04,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20df0b0f5558b5d7ccb4e HTTP/1.1" 200 None 2026-03-12 00:52:04,562 - lava_callback - INFO - Completed processing callback for node 69b20df0b0f5558b5d7ccb4e INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:08,773 - lava_callback - INFO - Received callback for node 69b20dedb0f5558b5d7ccb48 INFO: 172.21.0.1:38996 - "POST /node/69b20dedb0f5558b5d7ccb48 HTTP/1.0" 202 Accepted 2026-03-12 00:52:08,780 - lava_callback - INFO - Starting async job submit for node 69b20dedb0f5558b5d7ccb48 2026-03-12 00:52:08,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:08,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dedb0f5558b5d7ccb48 HTTP/1.1" 200 None 2026-03-12 00:52:08,822 - lava_callback - DEBUG - Processing node 69b20dedb0f5558b5d7ccb48: baseline-arm-pengutronix 2026-03-12 00:52:08,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:09,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:09,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20dedb0f5558b5d7ccb48/log.txt.gz 2026-03-12 00:52:09,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:09,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:09,536 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20dedb0f5558b5d7ccb48/lava-logs.yaml 2026-03-12 00:52:09,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:09,680 - lava_callback - INFO - Received callback for node 69b20ddcb0f5558b5d7ccae7 2026-03-12 00:52:09,691 - lava_callback - INFO - Starting async job submit for node 69b20ddcb0f5558b5d7ccae7 INFO: 172.21.0.1:39006 - "POST /node/69b20ddcb0f5558b5d7ccae7 HTTP/1.0" 202 Accepted 2026-03-12 00:52:09,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:09,757 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20dedb0f5558b5d7ccb48/lava_callback.json.gz 2026-03-12 00:52:09,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:09,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:09,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddcb0f5558b5d7ccae7 HTTP/1.1" 200 None 2026-03-12 00:52:09,884 - lava_callback - DEBUG - Processing node 69b20ddcb0f5558b5d7ccae7: baseline-arm-broonie 2026-03-12 00:52:09,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dedb0f5558b5d7ccb48 HTTP/1.1" 200 None 2026-03-12 00:52:09,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:10,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:10,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dedb0f5558b5d7ccb48 HTTP/1.1" 200 None 2026-03-12 00:52:10,210 - lava_callback - INFO - Completed processing callback for node 69b20dedb0f5558b5d7ccb48 2026-03-12 00:52:10,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:10,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:10,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddcb0f5558b5d7ccae7/log.txt.gz 2026-03-12 00:52:10,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:11,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:11,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddcb0f5558b5d7ccae7/lava-logs.yaml 2026-03-12 00:52:11,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:11,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:11,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddcb0f5558b5d7ccae7/lava_callback.json.gz 2026-03-12 00:52:11,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:11,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddcb0f5558b5d7ccae7 HTTP/1.1" 200 None 2026-03-12 00:52:11,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:11,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:11,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:11,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ddcb0f5558b5d7ccae7 HTTP/1.1" 200 None 2026-03-12 00:52:11,409 - lava_callback - INFO - Completed processing callback for node 69b20ddcb0f5558b5d7ccae7 2026-03-12 00:52:14,830 - lava_callback - INFO - Received callback for node 69b20ddeb0f5558b5d7ccaec INFO: 172.21.0.1:39146 - "POST /node/69b20ddeb0f5558b5d7ccaec HTTP/1.0" 202 Accepted 2026-03-12 00:52:14,838 - lava_callback - INFO - Starting async job submit for node 69b20ddeb0f5558b5d7ccaec 2026-03-12 00:52:14,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:14,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddeb0f5558b5d7ccaec HTTP/1.1" 200 None 2026-03-12 00:52:14,889 - lava_callback - DEBUG - Processing node 69b20ddeb0f5558b5d7ccaec: baseline-arm-broonie INFO: 172.21.0.1:39160 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 00:52:15,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:15,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:15,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddeb0f5558b5d7ccaec/log.txt.gz 2026-03-12 00:52:15,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:15,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:15,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddeb0f5558b5d7ccaec/lava-logs.yaml 2026-03-12 00:52:15,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:16,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:16,025 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddeb0f5558b5d7ccaec/lava_callback.json.gz 2026-03-12 00:52:16,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:16,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddeb0f5558b5d7ccaec HTTP/1.1" 200 None 2026-03-12 00:52:16,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:16,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:16,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:16,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ddeb0f5558b5d7ccaec HTTP/1.1" 200 None 2026-03-12 00:52:16,143 - lava_callback - INFO - Completed processing callback for node 69b20ddeb0f5558b5d7ccaec INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:25,149 - lava_callback - INFO - Received callback for node 69b20e37b0f5558b5d7ccc44 INFO: 172.21.0.1:58530 - "POST /node/69b20e37b0f5558b5d7ccc44 HTTP/1.0" 202 Accepted 2026-03-12 00:52:25,155 - lava_callback - INFO - Starting async job submit for node 69b20e37b0f5558b5d7ccc44 2026-03-12 00:52:25,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:25,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e37b0f5558b5d7ccc44 HTTP/1.1" 200 None 2026-03-12 00:52:25,172 - lava_callback - DEBUG - Processing node 69b20e37b0f5558b5d7ccc44: baseline-nfs-arm64 2026-03-12 00:52:25,174 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:52:25,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:25,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:25,393 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e37b0f5558b5d7ccc44/lava-logs.yaml 2026-03-12 00:52:25,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:25,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:25,526 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e37b0f5558b5d7ccc44/lava_callback.json.gz 2026-03-12 00:52:25,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:25,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e37b0f5558b5d7ccc44 HTTP/1.1" 200 None 2026-03-12 00:52:25,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:25,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:25,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:25,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e37b0f5558b5d7ccc44 HTTP/1.1" 200 None 2026-03-12 00:52:25,604 - lava_callback - INFO - Completed processing callback for node 69b20e37b0f5558b5d7ccc44 INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:27,621 - lava_callback - INFO - Received callback for node 69af6b42275c8d3b7939a42d INFO: 172.21.0.1:58550 - "POST /node/69af6b42275c8d3b7939a42d HTTP/1.0" 202 Accepted 2026-03-12 00:52:27,630 - lava_callback - INFO - Starting async job submit for node 69af6b42275c8d3b7939a42d 2026-03-12 00:52:27,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6b42275c8d3b7939a42d HTTP/1.1" 200 None 2026-03-12 00:52:27,657 - lava_callback - DEBUG - Processing node 69af6b42275c8d3b7939a42d: baseline-arm-baylibre 2026-03-12 00:52:27,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6b42275c8d3b7939a42d 2026-03-12 00:52:27,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6b42275c8d3b7939a42d HTTP/1.1" 200 None 2026-03-12 00:52:27,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:52:27,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6b42275c8d3b7939a42d HTTP/1.1" 200 None 2026-03-12 00:52:27,724 - lava_callback - ERROR - Error processing callback for node 69af6b42275c8d3b7939a42d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:52:27,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:52:30,043 - lava_callback - INFO - Received callback for node 69b20ddbb0f5558b5d7ccae4 INFO: 172.21.0.1:55676 - "POST /node/69b20ddbb0f5558b5d7ccae4 HTTP/1.0" 202 Accepted 2026-03-12 00:52:30,049 - lava_callback - INFO - Starting async job submit for node 69b20ddbb0f5558b5d7ccae4 2026-03-12 00:52:30,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:30,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddbb0f5558b5d7ccae4 HTTP/1.1" 200 None 2026-03-12 00:52:30,098 - lava_callback - DEBUG - Processing node 69b20ddbb0f5558b5d7ccae4: baseline-arm-broonie 2026-03-12 00:52:30,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:30,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:30,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddbb0f5558b5d7ccae4/log.txt.gz 2026-03-12 00:52:30,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:30,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:30,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddbb0f5558b5d7ccae4/lava-logs.yaml 2026-03-12 00:52:30,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:31,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:31,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddbb0f5558b5d7ccae4/lava_callback.json.gz 2026-03-12 00:52:31,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:31,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddbb0f5558b5d7ccae4 HTTP/1.1" 200 None 2026-03-12 00:52:31,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:31,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:31,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:31,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ddbb0f5558b5d7ccae4 HTTP/1.1" 200 None 2026-03-12 00:52:31,157 - lava_callback - INFO - Completed processing callback for node 69b20ddbb0f5558b5d7ccae4 2026-03-12 00:52:32,691 - lava_callback - INFO - Received callback for node 69b20de2b0f5558b5d7ccb1d INFO: 172.21.0.1:55678 - "POST /node/69b20de2b0f5558b5d7ccb1d HTTP/1.0" 202 Accepted 2026-03-12 00:52:32,697 - lava_callback - INFO - Starting async job submit for node 69b20de2b0f5558b5d7ccb1d 2026-03-12 00:52:32,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:32,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de2b0f5558b5d7ccb1d HTTP/1.1" 200 None 2026-03-12 00:52:32,743 - lava_callback - DEBUG - Processing node 69b20de2b0f5558b5d7ccb1d: baseline-arm-clabbe 2026-03-12 00:52:33,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:33,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:33,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de2b0f5558b5d7ccb1d/log.txt.gz 2026-03-12 00:52:33,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:33,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:33,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de2b0f5558b5d7ccb1d/lava-logs.yaml 2026-03-12 00:52:33,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:33,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:33,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de2b0f5558b5d7ccb1d/lava_callback.json.gz 2026-03-12 00:52:33,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:33,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de2b0f5558b5d7ccb1d HTTP/1.1" 200 None 2026-03-12 00:52:33,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:33,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:33,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:33,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de2b0f5558b5d7ccb1d HTTP/1.1" 200 None 2026-03-12 00:52:33,899 - lava_callback - INFO - Completed processing callback for node 69b20de2b0f5558b5d7ccb1d 2026-03-12 00:52:35,064 - lava_callback - INFO - Received callback for node 69b20ddab0f5558b5d7ccadd INFO: 172.21.0.1:55684 - "POST /node/69b20ddab0f5558b5d7ccadd HTTP/1.0" 202 Accepted 2026-03-12 00:52:35,070 - lava_callback - INFO - Starting async job submit for node 69b20ddab0f5558b5d7ccadd 2026-03-12 00:52:35,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:35,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddab0f5558b5d7ccadd HTTP/1.1" 200 None 2026-03-12 00:52:35,110 - lava_callback - DEBUG - Processing node 69b20ddab0f5558b5d7ccadd: baseline-arm-broonie 2026-03-12 00:52:35,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:35,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:35,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddab0f5558b5d7ccadd/log.txt.gz 2026-03-12 00:52:35,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:35,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:35,827 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddab0f5558b5d7ccadd/lava-logs.yaml 2026-03-12 00:52:35,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:36,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:36,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddab0f5558b5d7ccadd/lava_callback.json.gz 2026-03-12 00:52:36,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:36,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddab0f5558b5d7ccadd HTTP/1.1" 200 None 2026-03-12 00:52:36,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:36,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:36,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:36,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ddab0f5558b5d7ccadd HTTP/1.1" 200 None 2026-03-12 00:52:36,119 - lava_callback - INFO - Completed processing callback for node 69b20ddab0f5558b5d7ccadd INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:38,454 - lava_callback - INFO - Received callback for node 69b20deab0f5558b5d7ccb38 INFO: 172.21.0.1:55716 - "POST /node/69b20deab0f5558b5d7ccb38 HTTP/1.0" 202 Accepted 2026-03-12 00:52:38,461 - lava_callback - INFO - Starting async job submit for node 69b20deab0f5558b5d7ccb38 2026-03-12 00:52:38,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:38,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20deab0f5558b5d7ccb38 HTTP/1.1" 200 None 2026-03-12 00:52:38,504 - lava_callback - DEBUG - Processing node 69b20deab0f5558b5d7ccb38: baseline-arm-kontron 2026-03-12 00:52:38,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:38,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:38,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b20deab0f5558b5d7ccb38/log.txt.gz 2026-03-12 00:52:38,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:39,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:39,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b20deab0f5558b5d7ccb38/lava-logs.yaml 2026-03-12 00:52:39,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:39,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:39,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b20deab0f5558b5d7ccb38/lava_callback.json.gz 2026-03-12 00:52:39,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:39,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20deab0f5558b5d7ccb38 HTTP/1.1" 200 None 2026-03-12 00:52:39,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:39,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:39,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:39,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20deab0f5558b5d7ccb38 HTTP/1.1" 200 None 2026-03-12 00:52:39,988 - lava_callback - INFO - Completed processing callback for node 69b20deab0f5558b5d7ccb38 2026-03-12 00:52:40,022 - lava_callback - INFO - Received callback for node 69b20e1ab0f5558b5d7ccbc8 INFO: 172.21.0.1:50776 - "POST /node/69b20e1ab0f5558b5d7ccbc8 HTTP/1.0" 202 Accepted 2026-03-12 00:52:40,034 - lava_callback - INFO - Starting async job submit for node 69b20e1ab0f5558b5d7ccbc8 2026-03-12 00:52:40,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:40,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1ab0f5558b5d7ccbc8 HTTP/1.1" 200 None 2026-03-12 00:52:40,110 - lava_callback - DEBUG - Processing node 69b20e1ab0f5558b5d7ccbc8: baseline-arm64 2026-03-12 00:52:40,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:40,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:40,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1ab0f5558b5d7ccbc8/log.txt.gz 2026-03-12 00:52:40,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:41,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:41,017 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1ab0f5558b5d7ccbc8/lava-logs.yaml 2026-03-12 00:52:41,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:41,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:41,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1ab0f5558b5d7ccbc8/lava_callback.json.gz 2026-03-12 00:52:41,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:41,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1ab0f5558b5d7ccbc8 HTTP/1.1" 200 None 2026-03-12 00:52:41,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:41,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:41,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:41,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1ab0f5558b5d7ccbc8 HTTP/1.1" 200 None 2026-03-12 00:52:41,339 - lava_callback - INFO - Completed processing callback for node 69b20e1ab0f5558b5d7ccbc8 2026-03-12 00:52:42,608 - lava_callback - INFO - Received callback for node 69b20e26b0f5558b5d7ccc0f INFO: 172.21.0.1:50782 - "POST /node/69b20e26b0f5558b5d7ccc0f HTTP/1.0" 202 Accepted 2026-03-12 00:52:42,615 - lava_callback - INFO - Starting async job submit for node 69b20e26b0f5558b5d7ccc0f 2026-03-12 00:52:42,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:42,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e26b0f5558b5d7ccc0f HTTP/1.1" 200 None 2026-03-12 00:52:42,648 - lava_callback - DEBUG - Processing node 69b20e26b0f5558b5d7ccc0f: baseline-arm64 2026-03-12 00:52:42,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:42,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:42,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e26b0f5558b5d7ccc0f/log.txt.gz 2026-03-12 00:52:43,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:43,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:43,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e26b0f5558b5d7ccc0f/lava-logs.yaml 2026-03-12 00:52:43,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:43,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:43,343 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e26b0f5558b5d7ccc0f/lava_callback.json.gz 2026-03-12 00:52:43,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:43,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e26b0f5558b5d7ccc0f HTTP/1.1" 200 None 2026-03-12 00:52:43,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:43,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:43,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:43,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e26b0f5558b5d7ccc0f HTTP/1.1" 200 None 2026-03-12 00:52:43,481 - lava_callback - INFO - Completed processing callback for node 69b20e26b0f5558b5d7ccc0f INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:50,393 - lava_callback - INFO - Received callback for node 69b20e23b0f5558b5d7ccc02 INFO: 172.21.0.1:59208 - "POST /node/69b20e23b0f5558b5d7ccc02 HTTP/1.0" 202 Accepted 2026-03-12 00:52:50,405 - lava_callback - INFO - Starting async job submit for node 69b20e23b0f5558b5d7ccc02 2026-03-12 00:52:50,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:50,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e23b0f5558b5d7ccc02 HTTP/1.1" 200 None 2026-03-12 00:52:50,470 - lava_callback - DEBUG - Processing node 69b20e23b0f5558b5d7ccc02: baseline-arm64 2026-03-12 00:52:50,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:51,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:51,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e23b0f5558b5d7ccc02/log.txt.gz 2026-03-12 00:52:51,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:51,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:51,602 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e23b0f5558b5d7ccc02/lava-logs.yaml 2026-03-12 00:52:51,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:51,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:51,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e23b0f5558b5d7ccc02/lava_callback.json.gz 2026-03-12 00:52:51,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:51,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e23b0f5558b5d7ccc02 HTTP/1.1" 200 None 2026-03-12 00:52:51,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:51,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:51,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:51,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e23b0f5558b5d7ccc02 HTTP/1.1" 200 None 2026-03-12 00:52:51,843 - lava_callback - INFO - Completed processing callback for node 69b20e23b0f5558b5d7ccc02 2026-03-12 00:52:56,482 - lava_callback - INFO - Received callback for node 69b20e1fb0f5558b5d7ccbf9 INFO: 172.21.0.1:59214 - "POST /node/69b20e1fb0f5558b5d7ccbf9 HTTP/1.0" 202 Accepted 2026-03-12 00:52:56,490 - lava_callback - INFO - Starting async job submit for node 69b20e1fb0f5558b5d7ccbf9 2026-03-12 00:52:56,511 - lava_callback - INFO - Received callback for node 69b20e1cb0f5558b5d7ccbce INFO: 172.21.0.1:59230 - "POST /node/69b20e1cb0f5558b5d7ccbce HTTP/1.0" 202 Accepted INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:56,533 - lava_callback - INFO - Starting async job submit for node 69b20e1cb0f5558b5d7ccbce 2026-03-12 00:52:56,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:56,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:56,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1fb0f5558b5d7ccbf9 HTTP/1.1" 200 None 2026-03-12 00:52:56,586 - lava_callback - DEBUG - Processing node 69b20e1fb0f5558b5d7ccbf9: baseline-arm64 2026-03-12 00:52:56,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1cb0f5558b5d7ccbce HTTP/1.1" 200 None 2026-03-12 00:52:56,608 - lava_callback - DEBUG - Processing node 69b20e1cb0f5558b5d7ccbce: baseline-arm64 2026-03-12 00:52:56,946 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:52:57,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:57,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1fb0f5558b5d7ccbf9/lava-logs.yaml 2026-03-12 00:52:57,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:57,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbce/log.txt.gz 2026-03-12 00:52:57,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:57,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1fb0f5558b5d7ccbf9/lava_callback.json.gz 2026-03-12 00:52:57,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:57,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1fb0f5558b5d7ccbf9 HTTP/1.1" 200 None 2026-03-12 00:52:57,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:57,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:57,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:57,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1fb0f5558b5d7ccbf9 HTTP/1.1" 200 None 2026-03-12 00:52:57,763 - lava_callback - INFO - Completed processing callback for node 69b20e1fb0f5558b5d7ccbf9 2026-03-12 00:52:57,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:57,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbce/lava-logs.yaml 2026-03-12 00:52:57,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:57,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:52:58,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:58,079 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbce/lava_callback.json.gz 2026-03-12 00:52:58,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:58,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1cb0f5558b5d7ccbce HTTP/1.1" 200 None 2026-03-12 00:52:58,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:58,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:58,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:58,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1cb0f5558b5d7ccbce HTTP/1.1" 200 None 2026-03-12 00:52:58,196 - lava_callback - INFO - Completed processing callback for node 69b20e1cb0f5558b5d7ccbce 2026-03-12 00:52:58,577 - lava_callback - INFO - Received callback for node 69b20e24b0f5558b5d7ccc05 INFO: 172.21.0.1:59250 - "POST /node/69b20e24b0f5558b5d7ccc05 HTTP/1.0" 202 Accepted 2026-03-12 00:52:58,589 - lava_callback - INFO - Starting async job submit for node 69b20e24b0f5558b5d7ccc05 2026-03-12 00:52:58,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:58,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e24b0f5558b5d7ccc05 HTTP/1.1" 200 None 2026-03-12 00:52:58,653 - lava_callback - DEBUG - Processing node 69b20e24b0f5558b5d7ccc05: baseline-arm64 2026-03-12 00:52:59,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:59,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:59,162 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e24b0f5558b5d7ccc05/log.txt.gz 2026-03-12 00:52:59,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:59,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:59,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e24b0f5558b5d7ccc05/lava-logs.yaml 2026-03-12 00:52:59,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:59,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:59,732 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e24b0f5558b5d7ccc05/lava_callback.json.gz 2026-03-12 00:52:59,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:59,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e24b0f5558b5d7ccc05 HTTP/1.1" 200 None 2026-03-12 00:52:59,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:59,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:59,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:59,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e24b0f5558b5d7ccc05 HTTP/1.1" 200 None 2026-03-12 00:52:59,837 - lava_callback - INFO - Completed processing callback for node 69b20e24b0f5558b5d7ccc05 2026-03-12 00:53:00,424 - lava_callback - INFO - Received callback for node 69b20e46b0f5558b5d7ccc96 INFO: 172.21.0.1:40378 - "POST /node/69b20e46b0f5558b5d7ccc96 HTTP/1.0" 202 Accepted 2026-03-12 00:53:00,477 - lava_callback - INFO - Starting async job submit for node 69b20e46b0f5558b5d7ccc96 2026-03-12 00:53:00,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:00,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e46b0f5558b5d7ccc96 HTTP/1.1" 200 None 2026-03-12 00:53:00,524 - lava_callback - DEBUG - Processing node 69b20e46b0f5558b5d7ccc96: baseline-arm 2026-03-12 00:53:00,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:00,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:00,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e46b0f5558b5d7ccc96/log.txt.gz 2026-03-12 00:53:00,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:01,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:01,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e46b0f5558b5d7ccc96/lava-logs.yaml 2026-03-12 00:53:01,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:01,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:01,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e46b0f5558b5d7ccc96/lava_callback.json.gz 2026-03-12 00:53:01,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:01,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e46b0f5558b5d7ccc96 HTTP/1.1" 200 None 2026-03-12 00:53:01,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:01,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:53:01,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:01,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e46b0f5558b5d7ccc96 HTTP/1.1" 200 None 2026-03-12 00:53:01,285 - lava_callback - INFO - Completed processing callback for node 69b20e46b0f5558b5d7ccc96 2026-03-12 00:53:03,404 - lava_callback - INFO - Received callback for node 69b20e21b0f5558b5d7ccbff INFO: 172.21.0.1:40382 - "POST /node/69b20e21b0f5558b5d7ccbff HTTP/1.0" 202 Accepted 2026-03-12 00:53:03,410 - lava_callback - INFO - Starting async job submit for node 69b20e21b0f5558b5d7ccbff 2026-03-12 00:53:03,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:03,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e21b0f5558b5d7ccbff HTTP/1.1" 200 None 2026-03-12 00:53:03,450 - lava_callback - DEBUG - Processing node 69b20e21b0f5558b5d7ccbff: baseline-arm64 2026-03-12 00:53:03,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:03,760 - lava_callback - INFO - Received callback for node 69b20e25b0f5558b5d7ccc08 INFO: 172.21.0.1:40398 - "POST /node/69b20e25b0f5558b5d7ccc08 HTTP/1.0" 202 Accepted 2026-03-12 00:53:03,770 - lava_callback - INFO - Starting async job submit for node 69b20e25b0f5558b5d7ccc08 2026-03-12 00:53:03,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:03,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e25b0f5558b5d7ccc08 HTTP/1.1" 200 None 2026-03-12 00:53:03,809 - lava_callback - DEBUG - Processing node 69b20e25b0f5558b5d7ccc08: baseline-arm64 2026-03-12 00:53:03,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:03,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e21b0f5558b5d7ccbff/log.txt.gz 2026-03-12 00:53:04,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:04,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:04,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:04,729 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e21b0f5558b5d7ccbff/lava-logs.yaml 2026-03-12 00:53:04,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:04,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:04,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e25b0f5558b5d7ccc08/log.txt.gz 2026-03-12 00:53:04,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:04,929 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e21b0f5558b5d7ccbff/lava_callback.json.gz 2026-03-12 00:53:05,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e21b0f5558b5d7ccbff HTTP/1.1" 200 None 2026-03-12 00:53:05,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:05,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:05,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e21b0f5558b5d7ccbff HTTP/1.1" 200 None 2026-03-12 00:53:05,266 - lava_callback - INFO - Completed processing callback for node 69b20e21b0f5558b5d7ccbff 2026-03-12 00:53:05,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:05,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e25b0f5558b5d7ccc08/lava-logs.yaml 2026-03-12 00:53:05,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:05,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:05,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e25b0f5558b5d7ccc08/lava_callback.json.gz 2026-03-12 00:53:05,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e25b0f5558b5d7ccc08 HTTP/1.1" 200 None 2026-03-12 00:53:05,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:05,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e25b0f5558b5d7ccc08 HTTP/1.1" 200 None 2026-03-12 00:53:05,863 - lava_callback - INFO - Completed processing callback for node 69b20e25b0f5558b5d7ccc08 INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:07,387 - lava_callback - INFO - Received callback for node 69b20e1eb0f5558b5d7ccbf6 INFO: 172.21.0.1:40410 - "POST /node/69b20e1eb0f5558b5d7ccbf6 HTTP/1.0" 202 Accepted 2026-03-12 00:53:07,394 - lava_callback - INFO - Starting async job submit for node 69b20e1eb0f5558b5d7ccbf6 2026-03-12 00:53:07,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:07,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1eb0f5558b5d7ccbf6 HTTP/1.1" 200 None 2026-03-12 00:53:07,446 - lava_callback - DEBUG - Processing node 69b20e1eb0f5558b5d7ccbf6: baseline-arm64 2026-03-12 00:53:07,587 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:53:07,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:07,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:07,814 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1eb0f5558b5d7ccbf6/lava-logs.yaml 2026-03-12 00:53:07,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:07,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:07,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1eb0f5558b5d7ccbf6/lava_callback.json.gz 2026-03-12 00:53:07,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:07,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1eb0f5558b5d7ccbf6 HTTP/1.1" 200 None 2026-03-12 00:53:07,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:08,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:08,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:08,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1eb0f5558b5d7ccbf6 HTTP/1.1" 200 None 2026-03-12 00:53:08,096 - lava_callback - INFO - Completed processing callback for node 69b20e1eb0f5558b5d7ccbf6 2026-03-12 00:53:09,811 - lava_callback - INFO - Received callback for node 69b20e48b0f5558b5d7ccc9c INFO: 172.21.0.1:46296 - "POST /node/69b20e48b0f5558b5d7ccc9c HTTP/1.0" 202 Accepted 2026-03-12 00:53:09,858 - lava_callback - INFO - Starting async job submit for node 69b20e48b0f5558b5d7ccc9c 2026-03-12 00:53:09,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:09,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e48b0f5558b5d7ccc9c HTTP/1.1" 200 None 2026-03-12 00:53:09,906 - lava_callback - DEBUG - Processing node 69b20e48b0f5558b5d7ccc9c: baseline-arm 2026-03-12 00:53:10,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:10,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:10,204 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e48b0f5558b5d7ccc9c/log.txt.gz 2026-03-12 00:53:10,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:10,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:10,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e48b0f5558b5d7ccc9c/lava-logs.yaml 2026-03-12 00:53:10,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:10,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:10,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e48b0f5558b5d7ccc9c/lava_callback.json.gz 2026-03-12 00:53:10,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:10,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e48b0f5558b5d7ccc9c HTTP/1.1" 200 None 2026-03-12 00:53:10,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:10,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:53:10,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:10,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e48b0f5558b5d7ccc9c HTTP/1.1" 200 None 2026-03-12 00:53:10,675 - lava_callback - INFO - Completed processing callback for node 69b20e48b0f5558b5d7ccc9c 2026-03-12 00:53:12,468 - lava_callback - INFO - Received callback for node 69b20e06b0f5558b5d7ccb8e INFO: 172.21.0.1:46312 - "POST /node/69b20e06b0f5558b5d7ccb8e HTTP/1.0" 202 Accepted 2026-03-12 00:53:12,475 - lava_callback - INFO - Starting async job submit for node 69b20e06b0f5558b5d7ccb8e 2026-03-12 00:53:12,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:12,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e06b0f5558b5d7ccb8e HTTP/1.1" 200 None 2026-03-12 00:53:12,521 - lava_callback - DEBUG - Processing node 69b20e06b0f5558b5d7ccb8e: ltp-dio 2026-03-12 00:53:12,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:13,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:13,148 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b20e06b0f5558b5d7ccb8e/log.txt.gz 2026-03-12 00:53:13,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:13,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:13,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b20e06b0f5558b5d7ccb8e/lava-logs.yaml 2026-03-12 00:53:13,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:13,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:13,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b20e06b0f5558b5d7ccb8e/lava_callback.json.gz 2026-03-12 00:53:13,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:13,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e06b0f5558b5d7ccb8e HTTP/1.1" 200 None 2026-03-12 00:53:13,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:13,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:53:13,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:13,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e06b0f5558b5d7ccb8e HTTP/1.1" 200 None 2026-03-12 00:53:13,924 - lava_callback - INFO - Completed processing callback for node 69b20e06b0f5558b5d7ccb8e INFO: 172.21.0.1:46320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:18,337 - lava_callback - INFO - Received callback for node 69b20e34b0f5558b5d7ccc3e INFO: 172.21.0.1:46338 - "POST /node/69b20e34b0f5558b5d7ccc3e HTTP/1.0" 202 Accepted 2026-03-12 00:53:18,348 - lava_callback - INFO - Starting async job submit for node 69b20e34b0f5558b5d7ccc3e 2026-03-12 00:53:18,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:18,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e34b0f5558b5d7ccc3e HTTP/1.1" 200 None 2026-03-12 00:53:18,419 - lava_callback - DEBUG - Processing node 69b20e34b0f5558b5d7ccc3e: baseline-nfs-arm64 2026-03-12 00:53:19,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:19,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:19,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e34b0f5558b5d7ccc3e/log.txt.gz 2026-03-12 00:53:19,710 - lava_callback - INFO - Received callback for node 69b20e2bb0f5558b5d7ccc1f INFO: 172.21.0.1:53160 - "POST /node/69b20e2bb0f5558b5d7ccc1f HTTP/1.0" 202 Accepted 2026-03-12 00:53:19,742 - lava_callback - INFO - Starting async job submit for node 69b20e2bb0f5558b5d7ccc1f 2026-03-12 00:53:19,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:19,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2bb0f5558b5d7ccc1f HTTP/1.1" 200 None 2026-03-12 00:53:19,914 - lava_callback - DEBUG - Processing node 69b20e2bb0f5558b5d7ccc1f: baseline-arm64 2026-03-12 00:53:20,375 - lava_callback - INFO - Received callback for node 69b20e36b0f5558b5d7ccc41 2026-03-12 00:53:20,435 - lava_callback - INFO - Starting async job submit for node 69b20e36b0f5558b5d7ccc41 INFO: 172.21.0.1:53164 - "POST /node/69b20e36b0f5558b5d7ccc41 HTTP/1.0" 202 Accepted 2026-03-12 00:53:20,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:20,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e36b0f5558b5d7ccc41 HTTP/1.1" 200 None 2026-03-12 00:53:20,673 - lava_callback - DEBUG - Processing node 69b20e36b0f5558b5d7ccc41: baseline-nfs-arm64 2026-03-12 00:53:20,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:20,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:21,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:21,261 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2bb0f5558b5d7ccc1f/log.txt.gz 2026-03-12 00:53:21,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:21,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e34b0f5558b5d7ccc3e/lava-logs.yaml 2026-03-12 00:53:21,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:21,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:22,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:22,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e34b0f5558b5d7ccc3e/lava_callback.json.gz 2026-03-12 00:53:22,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:22,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:22,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e34b0f5558b5d7ccc3e HTTP/1.1" 200 None 2026-03-12 00:53:22,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:22,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:22,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:22,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e34b0f5558b5d7ccc3e HTTP/1.1" 200 None 2026-03-12 00:53:22,359 - lava_callback - INFO - Completed processing callback for node 69b20e34b0f5558b5d7ccc3e 2026-03-12 00:53:22,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:22,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2bb0f5558b5d7ccc1f/lava-logs.yaml 2026-03-12 00:53:22,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:22,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:22,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e36b0f5558b5d7ccc41/log.txt.gz 2026-03-12 00:53:22,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:22,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2bb0f5558b5d7ccc1f/lava_callback.json.gz 2026-03-12 00:53:23,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:23,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2bb0f5558b5d7ccc1f HTTP/1.1" 200 None 2026-03-12 00:53:23,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:23,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:23,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:23,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2bb0f5558b5d7ccc1f HTTP/1.1" 200 None 2026-03-12 00:53:23,293 - lava_callback - INFO - Completed processing callback for node 69b20e2bb0f5558b5d7ccc1f 2026-03-12 00:53:23,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:24,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:24,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e36b0f5558b5d7ccc41/lava-logs.yaml 2026-03-12 00:53:24,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:24,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:24,980 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e36b0f5558b5d7ccc41/lava_callback.json.gz 2026-03-12 00:53:25,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:25,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e36b0f5558b5d7ccc41 HTTP/1.1" 200 None 2026-03-12 00:53:25,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:25,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:25,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:25,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e36b0f5558b5d7ccc41 HTTP/1.1" 200 None 2026-03-12 00:53:25,139 - lava_callback - INFO - Completed processing callback for node 69b20e36b0f5558b5d7ccc41 2026-03-12 00:53:25,772 - lava_callback - INFO - Received callback for node 69b20e1bb0f5558b5d7ccbcb INFO: 172.21.0.1:53176 - "POST /node/69b20e1bb0f5558b5d7ccbcb HTTP/1.0" 202 Accepted 2026-03-12 00:53:25,781 - lava_callback - INFO - Starting async job submit for node 69b20e1bb0f5558b5d7ccbcb 2026-03-12 00:53:25,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:25,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1bb0f5558b5d7ccbcb HTTP/1.1" 200 None 2026-03-12 00:53:25,851 - lava_callback - DEBUG - Processing node 69b20e1bb0f5558b5d7ccbcb: baseline-arm64 2026-03-12 00:53:26,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:26,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:26,540 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1bb0f5558b5d7ccbcb/log.txt.gz INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:26,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:27,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:27,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1bb0f5558b5d7ccbcb/lava-logs.yaml 2026-03-12 00:53:27,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:27,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:27,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1bb0f5558b5d7ccbcb/lava_callback.json.gz 2026-03-12 00:53:27,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:27,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:27,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1bb0f5558b5d7ccbcb HTTP/1.1" 200 None 2026-03-12 00:53:27,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:27,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:53:27,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:27,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:28,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1bb0f5558b5d7ccbcb HTTP/1.1" 200 None 2026-03-12 00:53:28,026 - lava_callback - INFO - Completed processing callback for node 69b20e1bb0f5558b5d7ccbcb 2026-03-12 00:53:33,119 - lava_callback - INFO - Received callback for node 69b20e27b0f5558b5d7ccc16 INFO: 172.21.0.1:33622 - "POST /node/69b20e27b0f5558b5d7ccc16 HTTP/1.0" 202 Accepted 2026-03-12 00:53:33,131 - lava_callback - INFO - Starting async job submit for node 69b20e27b0f5558b5d7ccc16 2026-03-12 00:53:33,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:33,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e27b0f5558b5d7ccc16 HTTP/1.1" 200 None 2026-03-12 00:53:33,206 - lava_callback - DEBUG - Processing node 69b20e27b0f5558b5d7ccc16: baseline-arm64 2026-03-12 00:53:33,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:33,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:33,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e27b0f5558b5d7ccc16/log.txt.gz 2026-03-12 00:53:34,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:34,305 - lava_callback - INFO - Received callback for node 69b20e3cb0f5558b5d7ccc7b INFO: 172.21.0.1:33634 - "POST /node/69b20e3cb0f5558b5d7ccc7b HTTP/1.0" 202 Accepted 2026-03-12 00:53:34,315 - lava_callback - INFO - Starting async job submit for node 69b20e3cb0f5558b5d7ccc7b 2026-03-12 00:53:34,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:34,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3cb0f5558b5d7ccc7b HTTP/1.1" 200 None 2026-03-12 00:53:34,428 - lava_callback - DEBUG - Processing node 69b20e3cb0f5558b5d7ccc7b: baseline-nfs-arm64 2026-03-12 00:53:34,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:34,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e27b0f5558b5d7ccc16/lava-logs.yaml 2026-03-12 00:53:34,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:35,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:35,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:35,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e27b0f5558b5d7ccc16/lava_callback.json.gz 2026-03-12 00:53:35,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:35,483 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3cb0f5558b5d7ccc7b/log.txt.gz 2026-03-12 00:53:35,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:35,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e27b0f5558b5d7ccc16 HTTP/1.1" 200 None 2026-03-12 00:53:35,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:35,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:35,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:35,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e27b0f5558b5d7ccc16 HTTP/1.1" 200 None 2026-03-12 00:53:35,744 - lava_callback - INFO - Completed processing callback for node 69b20e27b0f5558b5d7ccc16 2026-03-12 00:53:35,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:36,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:36,819 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3cb0f5558b5d7ccc7b/lava-logs.yaml 2026-03-12 00:53:36,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:37,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:37,293 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3cb0f5558b5d7ccc7b/lava_callback.json.gz 2026-03-12 00:53:37,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:37,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3cb0f5558b5d7ccc7b HTTP/1.1" 200 None 2026-03-12 00:53:37,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:37,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:37,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:37,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e3cb0f5558b5d7ccc7b HTTP/1.1" 200 None 2026-03-12 00:53:37,455 - lava_callback - INFO - Completed processing callback for node 69b20e3cb0f5558b5d7ccc7b 2026-03-12 00:53:45,512 - lava_callback - INFO - Received callback for node 69b20e2ab0f5558b5d7ccc1c INFO: 172.21.0.1:43210 - "POST /node/69b20e2ab0f5558b5d7ccc1c HTTP/1.0" 202 Accepted 2026-03-12 00:53:45,524 - lava_callback - INFO - Starting async job submit for node 69b20e2ab0f5558b5d7ccc1c 2026-03-12 00:53:45,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:45,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2ab0f5558b5d7ccc1c HTTP/1.1" 200 None 2026-03-12 00:53:45,593 - lava_callback - DEBUG - Processing node 69b20e2ab0f5558b5d7ccc1c: baseline-arm64 2026-03-12 00:53:45,811 - lava_callback - INFO - Received callback for node 69b20e61b0f5558b5d7ccd1c INFO: 172.21.0.1:43214 - "POST /node/69b20e61b0f5558b5d7ccd1c HTTP/1.0" 202 Accepted 2026-03-12 00:53:45,837 - lava_callback - INFO - Starting async job submit for node 69b20e61b0f5558b5d7ccd1c 2026-03-12 00:53:45,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:45,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e61b0f5558b5d7ccd1c HTTP/1.1" 200 None 2026-03-12 00:53:45,968 - lava_callback - DEBUG - Processing node 69b20e61b0f5558b5d7ccd1c: baseline-arm64-pengutronix 2026-03-12 00:53:46,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:46,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:46,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:46,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2ab0f5558b5d7ccc1c/log.txt.gz 2026-03-12 00:53:46,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:46,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e61b0f5558b5d7ccd1c/log.txt.gz 2026-03-12 00:53:47,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:47,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:47,682 - lava_callback - INFO - Received callback for node 69af6b98275c8d3b7939a440 INFO: 172.21.0.1:43240 - "POST /node/69af6b98275c8d3b7939a440 HTTP/1.0" 202 Accepted 2026-03-12 00:53:47,692 - lava_callback - INFO - Starting async job submit for node 69af6b98275c8d3b7939a440 2026-03-12 00:53:47,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:47,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6b98275c8d3b7939a440 HTTP/1.1" 200 None 2026-03-12 00:53:47,729 - lava_callback - DEBUG - Processing node 69af6b98275c8d3b7939a440: baseline-arm-baylibre 2026-03-12 00:53:47,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6b98275c8d3b7939a440 2026-03-12 00:53:47,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:47,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6b98275c8d3b7939a440 HTTP/1.1" 200 None 2026-03-12 00:53:47,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:47,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:53:47,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:47,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6b98275c8d3b7939a440 HTTP/1.1" 200 None 2026-03-12 00:53:47,853 - lava_callback - ERROR - Error processing callback for node 69af6b98275c8d3b7939a440: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:53:48,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:48,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e61b0f5558b5d7ccd1c/lava-logs.yaml 2026-03-12 00:53:48,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:48,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:48,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2ab0f5558b5d7ccc1c/lava-logs.yaml 2026-03-12 00:53:48,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:48,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:48,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e61b0f5558b5d7ccd1c/lava_callback.json.gz 2026-03-12 00:53:48,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:48,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2ab0f5558b5d7ccc1c/lava_callback.json.gz 2026-03-12 00:53:48,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e61b0f5558b5d7ccd1c HTTP/1.1" 200 None 2026-03-12 00:53:48,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2ab0f5558b5d7ccc1c HTTP/1.1" 200 None 2026-03-12 00:53:48,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:48,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:48,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e61b0f5558b5d7ccd1c HTTP/1.1" 200 None 2026-03-12 00:53:48,896 - lava_callback - INFO - Completed processing callback for node 69b20e61b0f5558b5d7ccd1c 2026-03-12 00:53:48,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2ab0f5558b5d7ccc1c HTTP/1.1" 200 None 2026-03-12 00:53:48,992 - lava_callback - INFO - Completed processing callback for node 69b20e2ab0f5558b5d7ccc1c 2026-03-12 00:53:50,756 - lava_callback - INFO - Received callback for node 69b20e4ab0f5558b5d7ccca5 INFO: 172.21.0.1:35306 - "POST /node/69b20e4ab0f5558b5d7ccca5 HTTP/1.0" 202 Accepted 2026-03-12 00:53:50,768 - lava_callback - INFO - Starting async job submit for node 69b20e4ab0f5558b5d7ccca5 2026-03-12 00:53:50,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:50,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4ab0f5558b5d7ccca5 HTTP/1.1" 200 None 2026-03-12 00:53:50,842 - lava_callback - DEBUG - Processing node 69b20e4ab0f5558b5d7ccca5: baseline-arm64-broonie 2026-03-12 00:53:51,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:51,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:51,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4ab0f5558b5d7ccca5/log.txt.gz 2026-03-12 00:53:51,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:52,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:52,631 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4ab0f5558b5d7ccca5/lava-logs.yaml 2026-03-12 00:53:52,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:53,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:53,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4ab0f5558b5d7ccca5/lava_callback.json.gz 2026-03-12 00:53:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:53,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4ab0f5558b5d7ccca5 HTTP/1.1" 200 None 2026-03-12 00:53:53,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:53,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:53,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:53,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e4ab0f5558b5d7ccca5 HTTP/1.1" 200 None 2026-03-12 00:53:53,247 - lava_callback - INFO - Completed processing callback for node 69b20e4ab0f5558b5d7ccca5 INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:57,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:58,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:53:58,830 - lava_callback - INFO - Received callback for node 69b20e65b0f5558b5d7ccd29 INFO: 172.21.0.1:35326 - "POST /node/69b20e65b0f5558b5d7ccd29 HTTP/1.0" 202 Accepted 2026-03-12 00:53:58,839 - lava_callback - INFO - Starting async job submit for node 69b20e65b0f5558b5d7ccd29 2026-03-12 00:53:58,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:58,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e65b0f5558b5d7ccd29 HTTP/1.1" 200 None 2026-03-12 00:53:58,912 - lava_callback - DEBUG - Processing node 69b20e65b0f5558b5d7ccd29: baseline-arm64-foundriesio 2026-03-12 00:53:58,961 - lava_callback - INFO - Received callback for node 69b20e92b0f5558b5d7ccdbf INFO: 172.21.0.1:35342 - "POST /node/69b20e92b0f5558b5d7ccdbf HTTP/1.0" 202 Accepted 2026-03-12 00:53:58,990 - lava_callback - INFO - Starting async job submit for node 69b20e92b0f5558b5d7ccdbf 2026-03-12 00:53:58,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:59,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e92b0f5558b5d7ccdbf HTTP/1.1" 200 None 2026-03-12 00:53:59,062 - lava_callback - DEBUG - Processing node 69b20e92b0f5558b5d7ccdbf: baseline-arm 2026-03-12 00:53:59,070 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:53:59,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:59,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:59,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:59,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e92b0f5558b5d7ccdbf/lava-logs.yaml 2026-03-12 00:53:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:59,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:59,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e65b0f5558b5d7ccd29/log.txt.gz 2026-03-12 00:53:59,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:59,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:59,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e92b0f5558b5d7ccdbf/lava_callback.json.gz 2026-03-12 00:53:59,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:59,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e92b0f5558b5d7ccdbf HTTP/1.1" 200 None 2026-03-12 00:53:59,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:00,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:54:00,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:00,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e92b0f5558b5d7ccdbf HTTP/1.1" 200 None 2026-03-12 00:54:00,075 - lava_callback - INFO - Completed processing callback for node 69b20e92b0f5558b5d7ccdbf 2026-03-12 00:54:00,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:00,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e65b0f5558b5d7ccd29/lava-logs.yaml 2026-03-12 00:54:00,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:00,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:00,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e65b0f5558b5d7ccd29/lava_callback.json.gz 2026-03-12 00:54:00,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:00,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e65b0f5558b5d7ccd29 HTTP/1.1" 200 None 2026-03-12 00:54:00,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:01,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:01,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:01,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e65b0f5558b5d7ccd29 HTTP/1.1" 200 None 2026-03-12 00:54:01,085 - lava_callback - INFO - Completed processing callback for node 69b20e65b0f5558b5d7ccd29 2026-03-12 00:54:03,240 - lava_callback - INFO - Received callback for node 69b20e2cb0f5558b5d7ccc22 INFO: 172.21.0.1:34164 - "POST /node/69b20e2cb0f5558b5d7ccc22 HTTP/1.0" 202 Accepted 2026-03-12 00:54:03,251 - lava_callback - INFO - Starting async job submit for node 69b20e2cb0f5558b5d7ccc22 2026-03-12 00:54:03,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:03,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2cb0f5558b5d7ccc22 HTTP/1.1" 200 None 2026-03-12 00:54:03,320 - lava_callback - DEBUG - Processing node 69b20e2cb0f5558b5d7ccc22: baseline-arm64 2026-03-12 00:54:03,854 - lava_callback - INFO - Received callback for node 69b20e63b0f5558b5d7ccd1f INFO: 172.21.0.1:34174 - "POST /node/69b20e63b0f5558b5d7ccd1f HTTP/1.0" 202 Accepted 2026-03-12 00:54:03,868 - lava_callback - INFO - Starting async job submit for node 69b20e63b0f5558b5d7ccd1f 2026-03-12 00:54:03,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:03,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:03,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e63b0f5558b5d7ccd1f HTTP/1.1" 200 None 2026-03-12 00:54:03,939 - lava_callback - DEBUG - Processing node 69b20e63b0f5558b5d7ccd1f: baseline-arm64-pengutronix 2026-03-12 00:54:04,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:04,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:04,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2cb0f5558b5d7ccc22/log.txt.gz 2026-03-12 00:54:04,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:04,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e63b0f5558b5d7ccd1f/log.txt.gz 2026-03-12 00:54:04,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:04,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:05,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:05,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2cb0f5558b5d7ccc22/lava-logs.yaml 2026-03-12 00:54:05,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:05,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:05,456 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e63b0f5558b5d7ccd1f/lava-logs.yaml 2026-03-12 00:54:05,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:05,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:05,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2cb0f5558b5d7ccc22/lava_callback.json.gz 2026-03-12 00:54:05,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:05,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e63b0f5558b5d7ccd1f/lava_callback.json.gz 2026-03-12 00:54:05,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:05,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2cb0f5558b5d7ccc22 HTTP/1.1" 200 None 2026-03-12 00:54:06,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e63b0f5558b5d7ccd1f HTTP/1.1" 200 None 2026-03-12 00:54:06,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:06,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:06,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e63b0f5558b5d7ccd1f HTTP/1.1" 200 None 2026-03-12 00:54:06,141 - lava_callback - INFO - Completed processing callback for node 69b20e63b0f5558b5d7ccd1f 2026-03-12 00:54:06,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2cb0f5558b5d7ccc22 HTTP/1.1" 200 None 2026-03-12 00:54:06,146 - lava_callback - INFO - Completed processing callback for node 69b20e2cb0f5558b5d7ccc22 INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:08,498 - lava_callback - INFO - Received callback for node 69b20e32b0f5558b5d7ccc34 INFO: 172.21.0.1:34188 - "POST /node/69b20e32b0f5558b5d7ccc34 HTTP/1.0" 202 Accepted 2026-03-12 00:54:08,509 - lava_callback - INFO - Starting async job submit for node 69b20e32b0f5558b5d7ccc34 2026-03-12 00:54:08,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:08,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e32b0f5558b5d7ccc34 HTTP/1.1" 200 None 2026-03-12 00:54:08,603 - lava_callback - DEBUG - Processing node 69b20e32b0f5558b5d7ccc34: baseline-nfs-arm64 2026-03-12 00:54:09,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:09,375 - lava_callback - INFO - Received callback for node 69b20e3eb0f5558b5d7ccc7e INFO: 172.21.0.1:34196 - "POST /node/69b20e3eb0f5558b5d7ccc7e HTTP/1.0" 202 Accepted 2026-03-12 00:54:09,393 - lava_callback - INFO - Starting async job submit for node 69b20e3eb0f5558b5d7ccc7e 2026-03-12 00:54:09,394 - lava_callback - INFO - Received callback for node 69b20e1cb0f5558b5d7ccbef INFO: 172.21.0.1:34208 - "POST /node/69b20e1cb0f5558b5d7ccbef HTTP/1.0" 202 Accepted 2026-03-12 00:54:09,410 - lava_callback - INFO - Starting async job submit for node 69b20e1cb0f5558b5d7ccbef 2026-03-12 00:54:09,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:09,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:09,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3eb0f5558b5d7ccc7e HTTP/1.1" 200 None 2026-03-12 00:54:09,543 - lava_callback - DEBUG - Processing node 69b20e3eb0f5558b5d7ccc7e: baseline-nfs-arm64 2026-03-12 00:54:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1cb0f5558b5d7ccbef HTTP/1.1" 200 None 2026-03-12 00:54:09,558 - lava_callback - DEBUG - Processing node 69b20e1cb0f5558b5d7ccbef: baseline-arm64 2026-03-12 00:54:09,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:09,705 - lava_callback - INFO - Received callback for node 69b20e53b0f5558b5d7ccccd 2026-03-12 00:54:09,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e32b0f5558b5d7ccc34/log.txt.gz 2026-03-12 00:54:09,737 - lava_callback - INFO - Starting async job submit for node 69b20e53b0f5558b5d7ccccd INFO: 172.21.0.1:56526 - "POST /node/69b20e53b0f5558b5d7ccccd HTTP/1.0" 202 Accepted 2026-03-12 00:54:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:10,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e53b0f5558b5d7ccccd HTTP/1.1" 200 None 2026-03-12 00:54:10,053 - lava_callback - DEBUG - Processing node 69b20e53b0f5558b5d7ccccd: baseline-arm64-broonie 2026-03-12 00:54:11,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:11,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:11,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:11,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:11,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:11,869 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbef/log.txt.gz 2026-03-12 00:54:11,942 - lava_callback - INFO - Received callback for node 69b20e3bb0f5558b5d7ccc74 2026-03-12 00:54:11,983 - lava_callback - INFO - Starting async job submit for node 69b20e3bb0f5558b5d7ccc74 INFO: 172.21.0.1:56540 - "POST /node/69b20e3bb0f5558b5d7ccc74 HTTP/1.0" 202 Accepted 2026-03-12 00:54:12,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:12,093 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e53b0f5558b5d7ccccd/log.txt.gz 2026-03-12 00:54:12,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:12,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:12,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e32b0f5558b5d7ccc34/lava-logs.yaml 2026-03-12 00:54:12,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:12,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3eb0f5558b5d7ccc7e/log.txt.gz 2026-03-12 00:54:12,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:12,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3bb0f5558b5d7ccc74 HTTP/1.1" 200 None 2026-03-12 00:54:12,368 - lava_callback - DEBUG - Processing node 69b20e3bb0f5558b5d7ccc74: baseline-nfs-arm64 2026-03-12 00:54:12,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:12,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:12,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e32b0f5558b5d7ccc34/lava_callback.json.gz 2026-03-12 00:54:13,116 - lava_callback - INFO - Received callback for node 69b20e64b0f5558b5d7ccd26 2026-03-12 00:54:13,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:13,158 - lava_callback - INFO - Starting async job submit for node 69b20e64b0f5558b5d7ccd26 INFO: 172.21.0.1:56550 - "POST /node/69b20e64b0f5558b5d7ccd26 HTTP/1.0" 202 Accepted 2026-03-12 00:54:13,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:13,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:13,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:13,313 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbef/lava-logs.yaml 2026-03-12 00:54:13,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e32b0f5558b5d7ccc34 HTTP/1.1" 200 None 2026-03-12 00:54:13,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:13,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:13,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e64b0f5558b5d7ccd26 HTTP/1.1" 200 None 2026-03-12 00:54:13,431 - lava_callback - DEBUG - Processing node 69b20e64b0f5558b5d7ccd26: baseline-arm64-pengutronix 2026-03-12 00:54:13,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:13,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:13,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e32b0f5558b5d7ccc34 HTTP/1.1" 200 None 2026-03-12 00:54:13,658 - lava_callback - INFO - Completed processing callback for node 69b20e32b0f5558b5d7ccc34 2026-03-12 00:54:13,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:14,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:14,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbef/lava_callback.json.gz 2026-03-12 00:54:14,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:14,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e53b0f5558b5d7ccccd/lava-logs.yaml 2026-03-12 00:54:14,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:14,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:14,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:14,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1cb0f5558b5d7ccbef HTTP/1.1" 200 None 2026-03-12 00:54:14,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:14,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:14,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:14,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:14,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1cb0f5558b5d7ccbef HTTP/1.1" 200 None 2026-03-12 00:54:14,536 - lava_callback - INFO - Completed processing callback for node 69b20e1cb0f5558b5d7ccbef 2026-03-12 00:54:14,964 - lava_callback - INFO - Received callback for node 69b20e57b0f5558b5d7cccd8 2026-03-12 00:54:14,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:14,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e53b0f5558b5d7ccccd/lava_callback.json.gz INFO: 172.21.0.1:56560 - "POST /node/69b20e57b0f5558b5d7cccd8 HTTP/1.0" 202 Accepted 2026-03-12 00:54:15,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:15,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:15,010 - lava_callback - INFO - Starting async job submit for node 69b20e57b0f5558b5d7cccd8 2026-03-12 00:54:15,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:15,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3eb0f5558b5d7ccc7e/lava-logs.yaml 2026-03-12 00:54:15,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3bb0f5558b5d7ccc74/log.txt.gz 2026-03-12 00:54:15,067 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e64b0f5558b5d7ccd26/log.txt.gz 2026-03-12 00:54:15,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56564 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 00:54:15,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:15,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:15,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e57b0f5558b5d7cccd8 HTTP/1.1" 200 None 2026-03-12 00:54:15,501 - lava_callback - DEBUG - Processing node 69b20e57b0f5558b5d7cccd8: baseline-arm64-broonie 2026-03-12 00:54:15,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e53b0f5558b5d7ccccd HTTP/1.1" 200 None 2026-03-12 00:54:15,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:15,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:15,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:15,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:15,860 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3eb0f5558b5d7ccc7e/lava_callback.json.gz 2026-03-12 00:54:15,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e53b0f5558b5d7ccccd HTTP/1.1" 200 None 2026-03-12 00:54:15,868 - lava_callback - INFO - Completed processing callback for node 69b20e53b0f5558b5d7ccccd 2026-03-12 00:54:15,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:16,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:16,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3eb0f5558b5d7ccc7e HTTP/1.1" 200 None 2026-03-12 00:54:16,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:16,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:16,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:16,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:16,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e3eb0f5558b5d7ccc7e HTTP/1.1" 200 None 2026-03-12 00:54:16,338 - lava_callback - INFO - Completed processing callback for node 69b20e3eb0f5558b5d7ccc7e INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:16,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:16,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:16,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e64b0f5558b5d7ccd26/lava-logs.yaml 2026-03-12 00:54:16,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:17,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,002 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e57b0f5558b5d7cccd8/log.txt.gz 2026-03-12 00:54:17,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3bb0f5558b5d7ccc74/lava-logs.yaml 2026-03-12 00:54:17,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:17,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e64b0f5558b5d7ccd26/lava_callback.json.gz 2026-03-12 00:54:17,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:17,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e64b0f5558b5d7ccd26 HTTP/1.1" 200 None 2026-03-12 00:54:17,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:17,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e64b0f5558b5d7ccd26 HTTP/1.1" 200 None 2026-03-12 00:54:17,481 - lava_callback - INFO - Completed processing callback for node 69b20e64b0f5558b5d7ccd26 2026-03-12 00:54:17,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3bb0f5558b5d7ccc74/lava_callback.json.gz 2026-03-12 00:54:17,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3bb0f5558b5d7ccc74 HTTP/1.1" 200 None 2026-03-12 00:54:17,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:17,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e57b0f5558b5d7cccd8/lava-logs.yaml 2026-03-12 00:54:17,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:17,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e3bb0f5558b5d7ccc74 HTTP/1.1" 200 None 2026-03-12 00:54:17,954 - lava_callback - INFO - Completed processing callback for node 69b20e3bb0f5558b5d7ccc74 2026-03-12 00:54:18,135 - lava_callback - INFO - Received callback for node 69b20e29b0f5558b5d7ccc19 INFO: 172.21.0.1:56576 - "POST /node/69b20e29b0f5558b5d7ccc19 HTTP/1.0" 202 Accepted 2026-03-12 00:54:18,150 - lava_callback - INFO - Starting async job submit for node 69b20e29b0f5558b5d7ccc19 2026-03-12 00:54:18,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:18,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e29b0f5558b5d7ccc19 HTTP/1.1" 200 None 2026-03-12 00:54:18,253 - lava_callback - DEBUG - Processing node 69b20e29b0f5558b5d7ccc19: baseline-arm64 2026-03-12 00:54:18,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:18,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e57b0f5558b5d7cccd8/lava_callback.json.gz 2026-03-12 00:54:18,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:18,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e57b0f5558b5d7cccd8 HTTP/1.1" 200 None 2026-03-12 00:54:18,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:18,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:18,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:18,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e57b0f5558b5d7cccd8 HTTP/1.1" 200 None 2026-03-12 00:54:18,770 - lava_callback - INFO - Completed processing callback for node 69b20e57b0f5558b5d7cccd8 2026-03-12 00:54:19,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:19,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:19,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e29b0f5558b5d7ccc19/log.txt.gz 2026-03-12 00:54:20,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:21,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:21,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e29b0f5558b5d7ccc19/lava-logs.yaml 2026-03-12 00:54:21,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:21,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:21,703 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e29b0f5558b5d7ccc19/lava_callback.json.gz 2026-03-12 00:54:21,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:21,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e29b0f5558b5d7ccc19 HTTP/1.1" 200 None 2026-03-12 00:54:21,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:21,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:21,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:21,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e29b0f5558b5d7ccc19 HTTP/1.1" 200 None 2026-03-12 00:54:21,863 - lava_callback - INFO - Completed processing callback for node 69b20e29b0f5558b5d7ccc19 2026-03-12 00:54:23,792 - lava_callback - INFO - Received callback for node 69b20de3b0f5558b5d7ccb21 INFO: 172.21.0.1:34796 - "POST /node/69b20de3b0f5558b5d7ccb21 HTTP/1.0" 202 Accepted 2026-03-12 00:54:23,801 - lava_callback - INFO - Starting async job submit for node 69b20de3b0f5558b5d7ccb21 2026-03-12 00:54:23,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:23,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de3b0f5558b5d7ccb21 HTTP/1.1" 200 None 2026-03-12 00:54:23,875 - lava_callback - DEBUG - Processing node 69b20de3b0f5558b5d7ccb21: baseline-arm-clabbe 2026-03-12 00:54:23,882 - lava_callback - INFO - Received callback for node 69b20e38b0f5558b5d7ccc47 INFO: 172.21.0.1:34800 - "POST /node/69b20e38b0f5558b5d7ccc47 HTTP/1.0" 202 Accepted 2026-03-12 00:54:23,902 - lava_callback - INFO - Starting async job submit for node 69b20e38b0f5558b5d7ccc47 2026-03-12 00:54:23,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:24,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e38b0f5558b5d7ccc47 HTTP/1.1" 200 None 2026-03-12 00:54:24,053 - lava_callback - DEBUG - Processing node 69b20e38b0f5558b5d7ccc47: baseline-nfs-arm64 2026-03-12 00:54:24,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:24,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:25,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:25,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de3b0f5558b5d7ccb21/log.txt.gz 2026-03-12 00:54:25,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:25,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e38b0f5558b5d7ccc47/log.txt.gz 2026-03-12 00:54:25,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:25,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:26,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:26,087 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de3b0f5558b5d7ccb21/lava-logs.yaml 2026-03-12 00:54:26,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:26,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:26,358 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e38b0f5558b5d7ccc47/lava-logs.yaml 2026-03-12 00:54:26,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:26,469 - lava_callback - INFO - Received callback for node 69b20e67b0f5558b5d7ccd2c INFO: 172.21.0.1:34810 - "POST /node/69b20e67b0f5558b5d7ccd2c HTTP/1.0" 202 Accepted 2026-03-12 00:54:26,482 - lava_callback - INFO - Starting async job submit for node 69b20e67b0f5558b5d7ccd2c 2026-03-12 00:54:26,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:26,535 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de3b0f5558b5d7ccb21/lava_callback.json.gz 2026-03-12 00:54:26,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:26,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:26,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e67b0f5558b5d7ccd2c HTTP/1.1" 200 None 2026-03-12 00:54:26,609 - lava_callback - DEBUG - Processing node 69b20e67b0f5558b5d7ccd2c: baseline-arm64-foundriesio 2026-03-12 00:54:26,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de3b0f5558b5d7ccb21 HTTP/1.1" 200 None 2026-03-12 00:54:26,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:26,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:54:26,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:26,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de3b0f5558b5d7ccb21 HTTP/1.1" 200 None 2026-03-12 00:54:26,766 - lava_callback - INFO - Completed processing callback for node 69b20de3b0f5558b5d7ccb21 2026-03-12 00:54:27,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:27,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e38b0f5558b5d7ccc47/lava_callback.json.gz 2026-03-12 00:54:27,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:27,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e38b0f5558b5d7ccc47 HTTP/1.1" 200 None 2026-03-12 00:54:27,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:27,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:27,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:27,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e38b0f5558b5d7ccc47 HTTP/1.1" 200 None 2026-03-12 00:54:27,394 - lava_callback - INFO - Completed processing callback for node 69b20e38b0f5558b5d7ccc47 2026-03-12 00:54:27,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:27,836 - lava_callback - INFO - Received callback for node 69b20e2fb0f5558b5d7ccc2e INFO: 172.21.0.1:34828 - "POST /node/69b20e2fb0f5558b5d7ccc2e HTTP/1.0" 202 Accepted 2026-03-12 00:54:27,860 - lava_callback - INFO - Starting async job submit for node 69b20e2fb0f5558b5d7ccc2e 2026-03-12 00:54:27,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:27,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2fb0f5558b5d7ccc2e HTTP/1.1" 200 None 2026-03-12 00:54:27,962 - lava_callback - DEBUG - Processing node 69b20e2fb0f5558b5d7ccc2e: baseline-nfs-arm64 2026-03-12 00:54:28,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:28,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:54:28,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:28,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e67b0f5558b5d7ccd2c/log.txt.gz 2026-03-12 00:54:28,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:29,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:29,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e2fb0f5558b5d7ccc2e/log.txt.gz 2026-03-12 00:54:29,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:29,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:29,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e67b0f5558b5d7ccd2c/lava-logs.yaml 2026-03-12 00:54:29,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:30,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:30,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e2fb0f5558b5d7ccc2e/lava-logs.yaml 2026-03-12 00:54:30,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:30,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:30,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e67b0f5558b5d7ccd2c/lava_callback.json.gz 2026-03-12 00:54:30,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:30,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e67b0f5558b5d7ccd2c HTTP/1.1" 200 None 2026-03-12 00:54:30,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:30,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:30,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:30,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e67b0f5558b5d7ccd2c HTTP/1.1" 200 None 2026-03-12 00:54:30,647 - lava_callback - INFO - Completed processing callback for node 69b20e67b0f5558b5d7ccd2c 2026-03-12 00:54:31,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:31,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e2fb0f5558b5d7ccc2e/lava_callback.json.gz 2026-03-12 00:54:31,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:31,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2fb0f5558b5d7ccc2e HTTP/1.1" 200 None 2026-03-12 00:54:31,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:31,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:31,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:31,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2fb0f5558b5d7ccc2e HTTP/1.1" 200 None 2026-03-12 00:54:31,226 - lava_callback - INFO - Completed processing callback for node 69b20e2fb0f5558b5d7ccc2e 2026-03-12 00:54:34,900 - lava_callback - INFO - Received callback for node 69b20e51b0f5558b5d7cccc3 INFO: 172.21.0.1:48798 - "POST /node/69b20e51b0f5558b5d7cccc3 HTTP/1.0" 202 Accepted 2026-03-12 00:54:34,910 - lava_callback - INFO - Starting async job submit for node 69b20e51b0f5558b5d7cccc3 2026-03-12 00:54:34,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:35,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e51b0f5558b5d7cccc3 HTTP/1.1" 200 None 2026-03-12 00:54:35,001 - lava_callback - DEBUG - Processing node 69b20e51b0f5558b5d7cccc3: baseline-arm64-broonie 2026-03-12 00:54:35,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:35,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:35,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e51b0f5558b5d7cccc3/log.txt.gz 2026-03-12 00:54:36,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:36,387 - lava_callback - INFO - Received callback for node 69b20e55b0f5558b5d7cccd4 INFO: 172.21.0.1:48814 - "POST /node/69b20e55b0f5558b5d7cccd4 HTTP/1.0" 202 Accepted 2026-03-12 00:54:36,398 - lava_callback - INFO - Starting async job submit for node 69b20e55b0f5558b5d7cccd4 2026-03-12 00:54:36,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:36,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e55b0f5558b5d7cccd4 HTTP/1.1" 200 None 2026-03-12 00:54:36,467 - lava_callback - DEBUG - Processing node 69b20e55b0f5558b5d7cccd4: baseline-arm64-broonie INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:36,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:36,826 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e51b0f5558b5d7cccc3/lava-logs.yaml 2026-03-12 00:54:36,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:36,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:37,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:37,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e51b0f5558b5d7cccc3/lava_callback.json.gz 2026-03-12 00:54:37,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:37,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e55b0f5558b5d7cccd4/log.txt.gz 2026-03-12 00:54:37,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:37,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e51b0f5558b5d7cccc3 HTTP/1.1" 200 None 2026-03-12 00:54:37,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:37,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:37,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:37,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e51b0f5558b5d7cccc3 HTTP/1.1" 200 None 2026-03-12 00:54:37,645 - lava_callback - INFO - Completed processing callback for node 69b20e51b0f5558b5d7cccc3 2026-03-12 00:54:37,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:38,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:38,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e55b0f5558b5d7cccd4/lava-logs.yaml 2026-03-12 00:54:38,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:38,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:38,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e55b0f5558b5d7cccd4/lava_callback.json.gz 2026-03-12 00:54:38,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:38,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e55b0f5558b5d7cccd4 HTTP/1.1" 200 None 2026-03-12 00:54:38,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:38,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:38,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:38,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e55b0f5558b5d7cccd4 HTTP/1.1" 200 None 2026-03-12 00:54:38,949 - lava_callback - INFO - Completed processing callback for node 69b20e55b0f5558b5d7cccd4 2026-03-12 00:54:45,018 - lava_callback - INFO - Received callback for node 69b20e39b0f5558b5d7ccc4a INFO: 172.21.0.1:43210 - "POST /node/69b20e39b0f5558b5d7ccc4a HTTP/1.0" 202 Accepted 2026-03-12 00:54:45,031 - lava_callback - INFO - Starting async job submit for node 69b20e39b0f5558b5d7ccc4a 2026-03-12 00:54:45,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:45,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e39b0f5558b5d7ccc4a HTTP/1.1" 200 None 2026-03-12 00:54:45,099 - lava_callback - DEBUG - Processing node 69b20e39b0f5558b5d7ccc4a: baseline-nfs-arm64 2026-03-12 00:54:46,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:46,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:46,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e39b0f5558b5d7ccc4a/log.txt.gz 2026-03-12 00:54:47,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:47,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:47,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e39b0f5558b5d7ccc4a/lava-logs.yaml 2026-03-12 00:54:47,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:47,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:47,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e39b0f5558b5d7ccc4a/lava_callback.json.gz 2026-03-12 00:54:47,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:47,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e39b0f5558b5d7ccc4a HTTP/1.1" 200 None 2026-03-12 00:54:47,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:47,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:47,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:47,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e39b0f5558b5d7ccc4a HTTP/1.1" 200 None 2026-03-12 00:54:47,762 - lava_callback - INFO - Completed processing callback for node 69b20e39b0f5558b5d7ccc4a 2026-03-12 00:54:49,660 - lava_callback - INFO - Received callback for node 69b20e58b0f5558b5d7cccdf INFO: 172.21.0.1:43236 - "POST /node/69b20e58b0f5558b5d7cccdf HTTP/1.0" 202 Accepted 2026-03-12 00:54:49,666 - lava_callback - INFO - Starting async job submit for node 69b20e58b0f5558b5d7cccdf 2026-03-12 00:54:49,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:49,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e58b0f5558b5d7cccdf HTTP/1.1" 200 None 2026-03-12 00:54:49,707 - lava_callback - DEBUG - Processing node 69b20e58b0f5558b5d7cccdf: baseline-arm64-broonie 2026-03-12 00:54:49,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:50,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:50,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e58b0f5558b5d7cccdf/log.txt.gz 2026-03-12 00:54:50,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:50,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:50,461 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e58b0f5558b5d7cccdf/lava-logs.yaml 2026-03-12 00:54:50,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:50,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:50,611 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e58b0f5558b5d7cccdf/lava_callback.json.gz 2026-03-12 00:54:50,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:50,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e58b0f5558b5d7cccdf HTTP/1.1" 200 None 2026-03-12 00:54:50,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:50,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:50,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:50,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e58b0f5558b5d7cccdf HTTP/1.1" 200 None 2026-03-12 00:54:50,694 - lava_callback - INFO - Completed processing callback for node 69b20e58b0f5558b5d7cccdf INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:58,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:58,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:10,038 - lava_callback - INFO - Received callback for node 69b20e4cb0f5558b5d7cccb6 INFO: 172.21.0.1:57634 - "POST /node/69b20e4cb0f5558b5d7cccb6 HTTP/1.0" 202 Accepted 2026-03-12 00:55:10,044 - lava_callback - INFO - Starting async job submit for node 69b20e4cb0f5558b5d7cccb6 2026-03-12 00:55:10,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:10,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4cb0f5558b5d7cccb6 HTTP/1.1" 200 None 2026-03-12 00:55:10,082 - lava_callback - DEBUG - Processing node 69b20e4cb0f5558b5d7cccb6: baseline-arm64-broonie 2026-03-12 00:55:10,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:10,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:10,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4cb0f5558b5d7cccb6/log.txt.gz 2026-03-12 00:55:10,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:10,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:10,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4cb0f5558b5d7cccb6/lava-logs.yaml 2026-03-12 00:55:10,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:10,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:10,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4cb0f5558b5d7cccb6/lava_callback.json.gz 2026-03-12 00:55:10,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:11,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4cb0f5558b5d7cccb6 HTTP/1.1" 200 None 2026-03-12 00:55:11,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:11,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:55:11,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:11,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e4cb0f5558b5d7cccb6 HTTP/1.1" 200 None 2026-03-12 00:55:11,061 - lava_callback - INFO - Completed processing callback for node 69b20e4cb0f5558b5d7cccb6 2026-03-12 00:55:15,131 - lava_callback - INFO - Received callback for node 69b20e05b0f5558b5d7ccb8b INFO: 172.21.0.1:57638 - "POST /node/69b20e05b0f5558b5d7ccb8b HTTP/1.0" 202 Accepted 2026-03-12 00:55:15,142 - lava_callback - INFO - Starting async job submit for node 69b20e05b0f5558b5d7ccb8b INFO: 172.21.0.1:57650 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 00:55:15,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:15,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e05b0f5558b5d7ccb8b HTTP/1.1" 200 None 2026-03-12 00:55:15,230 - lava_callback - DEBUG - Processing node 69b20e05b0f5558b5d7ccb8b: ltp-cve 2026-03-12 00:55:15,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:15,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:15,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b20e05b0f5558b5d7ccb8b/log.txt.gz 2026-03-12 00:55:16,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:16,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:16,221 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b20e05b0f5558b5d7ccb8b/lava-logs.yaml 2026-03-12 00:55:16,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:16,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:16,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b20e05b0f5558b5d7ccb8b/lava_callback.json.gz 2026-03-12 00:55:16,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:16,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e05b0f5558b5d7ccb8b HTTP/1.1" 200 None 2026-03-12 00:55:16,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:16,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:55:16,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:16,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e05b0f5558b5d7ccb8b HTTP/1.1" 200 None 2026-03-12 00:55:16,530 - lava_callback - INFO - Completed processing callback for node 69b20e05b0f5558b5d7ccb8b INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:27,745 - lava_callback - INFO - Received callback for node 69af6bee275c8d3b7939a4e0 INFO: 172.21.0.1:40390 - "POST /node/69af6bee275c8d3b7939a4e0 HTTP/1.0" 202 Accepted 2026-03-12 00:55:27,751 - lava_callback - INFO - Starting async job submit for node 69af6bee275c8d3b7939a4e0 2026-03-12 00:55:27,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:27,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bee275c8d3b7939a4e0 HTTP/1.1" 200 None 2026-03-12 00:55:27,767 - lava_callback - DEBUG - Processing node 69af6bee275c8d3b7939a4e0: baseline-arm-baylibre 2026-03-12 00:55:27,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bee275c8d3b7939a4e0 2026-03-12 00:55:27,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:27,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bee275c8d3b7939a4e0 HTTP/1.1" 200 None 2026-03-12 00:55:27,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:27,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:55:27,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:27,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bee275c8d3b7939a4e0 HTTP/1.1" 200 None 2026-03-12 00:55:27,824 - lava_callback - ERROR - Error processing callback for node 69af6bee275c8d3b7939a4e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:28,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:55:28,408 - lava_callback - INFO - Received callback for node 69af6bf3275c8d3b7939a4ef INFO: 172.21.0.1:40402 - "POST /node/69af6bf3275c8d3b7939a4ef HTTP/1.0" 202 Accepted 2026-03-12 00:55:28,414 - lava_callback - INFO - Starting async job submit for node 69af6bf3275c8d3b7939a4ef 2026-03-12 00:55:28,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf3275c8d3b7939a4ef HTTP/1.1" 200 None 2026-03-12 00:55:28,431 - lava_callback - DEBUG - Processing node 69af6bf3275c8d3b7939a4ef: baseline-arm64-baylibre 2026-03-12 00:55:28,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bf3275c8d3b7939a4ef 2026-03-12 00:55:28,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf3275c8d3b7939a4ef HTTP/1.1" 200 None 2026-03-12 00:55:28,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:28,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bf3275c8d3b7939a4ef HTTP/1.1" 200 None 2026-03-12 00:55:28,510 - lava_callback - ERROR - Error processing callback for node 69af6bf3275c8d3b7939a4ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:29,055 - lava_callback - INFO - Received callback for node 69af6bf5275c8d3b7939a509 INFO: 172.21.0.1:40412 - "POST /node/69af6bf5275c8d3b7939a509 HTTP/1.0" 202 Accepted 2026-03-12 00:55:29,066 - lava_callback - INFO - Starting async job submit for node 69af6bf5275c8d3b7939a509 2026-03-12 00:55:29,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf5275c8d3b7939a509 HTTP/1.1" 200 None 2026-03-12 00:55:29,101 - lava_callback - DEBUG - Processing node 69af6bf5275c8d3b7939a509: baseline-arm64-baylibre 2026-03-12 00:55:29,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bf5275c8d3b7939a509 2026-03-12 00:55:29,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf5275c8d3b7939a509 HTTP/1.1" 200 None 2026-03-12 00:55:29,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:29,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bf5275c8d3b7939a509 HTTP/1.1" 200 None 2026-03-12 00:55:29,193 - lava_callback - ERROR - Error processing callback for node 69af6bf5275c8d3b7939a509: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:29,759 - lava_callback - INFO - Received callback for node 69af6bf7275c8d3b7939a50c INFO: 172.21.0.1:43724 - "POST /node/69af6bf7275c8d3b7939a50c HTTP/1.0" 202 Accepted 2026-03-12 00:55:29,768 - lava_callback - INFO - Starting async job submit for node 69af6bf7275c8d3b7939a50c 2026-03-12 00:55:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf7275c8d3b7939a50c HTTP/1.1" 200 None 2026-03-12 00:55:29,801 - lava_callback - DEBUG - Processing node 69af6bf7275c8d3b7939a50c: baseline-arm64-baylibre 2026-03-12 00:55:29,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bf7275c8d3b7939a50c 2026-03-12 00:55:29,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf7275c8d3b7939a50c HTTP/1.1" 200 None 2026-03-12 00:55:29,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:29,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bf7275c8d3b7939a50c HTTP/1.1" 200 None 2026-03-12 00:55:29,895 - lava_callback - ERROR - Error processing callback for node 69af6bf7275c8d3b7939a50c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:30,176 - lava_callback - INFO - Received callback for node 69b20e00b0f5558b5d7ccb7d INFO: 172.21.0.1:43730 - "POST /node/69b20e00b0f5558b5d7ccb7d HTTP/1.0" 202 Accepted 2026-03-12 00:55:30,194 - lava_callback - INFO - Starting async job submit for node 69b20e00b0f5558b5d7ccb7d 2026-03-12 00:55:30,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e00b0f5558b5d7ccb7d HTTP/1.1" 200 None 2026-03-12 00:55:30,286 - lava_callback - DEBUG - Processing node 69b20e00b0f5558b5d7ccb7d: ltp-cap_bounds 2026-03-12 00:55:30,426 - lava_callback - INFO - Received callback for node 69af6bf9275c8d3b7939a517 INFO: 172.21.0.1:43746 - "POST /node/69af6bf9275c8d3b7939a517 HTTP/1.0" 202 Accepted 2026-03-12 00:55:30,441 - lava_callback - INFO - Starting async job submit for node 69af6bf9275c8d3b7939a517 2026-03-12 00:55:30,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf9275c8d3b7939a517 HTTP/1.1" 200 None 2026-03-12 00:55:30,535 - lava_callback - DEBUG - Processing node 69af6bf9275c8d3b7939a517: baseline-arm64-baylibre 2026-03-12 00:55:30,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bf9275c8d3b7939a517 2026-03-12 00:55:30,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf9275c8d3b7939a517 HTTP/1.1" 200 None 2026-03-12 00:55:30,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:30,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bf9275c8d3b7939a517 HTTP/1.1" 200 None 2026-03-12 00:55:30,780 - lava_callback - ERROR - Error processing callback for node 69af6bf9275c8d3b7939a517: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:31,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:31,105 - lava_callback - INFO - Received callback for node 69af6bfc275c8d3b7939a51a INFO: 172.21.0.1:43754 - "POST /node/69af6bfc275c8d3b7939a51a HTTP/1.0" 202 Accepted 2026-03-12 00:55:31,119 - lava_callback - INFO - Starting async job submit for node 69af6bfc275c8d3b7939a51a 2026-03-12 00:55:31,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:31,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bfc275c8d3b7939a51a HTTP/1.1" 200 None 2026-03-12 00:55:31,154 - lava_callback - DEBUG - Processing node 69af6bfc275c8d3b7939a51a: baseline-arm64-baylibre 2026-03-12 00:55:31,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bfc275c8d3b7939a51a 2026-03-12 00:55:31,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:31,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bfc275c8d3b7939a51a HTTP/1.1" 200 None 2026-03-12 00:55:31,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:31,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:31,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bfc275c8d3b7939a51a HTTP/1.1" 200 None 2026-03-12 00:55:31,261 - lava_callback - ERROR - Error processing callback for node 69af6bfc275c8d3b7939a51a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:31,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:31,382 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b20e00b0f5558b5d7ccb7d/log.txt.gz 2026-03-12 00:55:31,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:32,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:32,216 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b20e00b0f5558b5d7ccb7d/lava-logs.yaml 2026-03-12 00:55:32,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:32,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:32,509 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b20e00b0f5558b5d7ccb7d/lava_callback.json.gz 2026-03-12 00:55:32,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:32,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e00b0f5558b5d7ccb7d HTTP/1.1" 200 None 2026-03-12 00:55:32,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:32,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:55:32,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:32,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e00b0f5558b5d7ccb7d HTTP/1.1" 200 None 2026-03-12 00:55:32,662 - lava_callback - INFO - Completed processing callback for node 69b20e00b0f5558b5d7ccb7d 2026-03-12 00:55:35,350 - lava_callback - INFO - Received callback for node 69b20e12b0f5558b5d7ccba9 INFO: 172.21.0.1:43760 - "POST /node/69b20e12b0f5558b5d7ccba9 HTTP/1.0" 202 Accepted 2026-03-12 00:55:35,362 - lava_callback - INFO - Starting async job submit for node 69b20e12b0f5558b5d7ccba9 2026-03-12 00:55:35,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:35,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e12b0f5558b5d7ccba9 HTTP/1.1" 200 None 2026-03-12 00:55:35,458 - lava_callback - DEBUG - Processing node 69b20e12b0f5558b5d7ccba9: ltp-syscalls INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:36,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:36,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:36,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b20e12b0f5558b5d7ccba9/log.txt.gz 2026-03-12 00:55:37,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:38,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:38,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b20e12b0f5558b5d7ccba9/lava-logs.yaml 2026-03-12 00:55:38,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:38,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:38,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b20e12b0f5558b5d7ccba9/lava_callback.json.gz 2026-03-12 00:55:38,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e12b0f5558b5d7ccba9 HTTP/1.1" 200 None 2026-03-12 00:55:38,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:38,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:55:38,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:38,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e12b0f5558b5d7ccba9 HTTP/1.1" 200 None 2026-03-12 00:55:38,828 - lava_callback - INFO - Completed processing callback for node 69b20e12b0f5558b5d7ccba9 INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:55,160 - lava_callback - INFO - Received callback for node 69b20e01b0f5558b5d7ccb81 INFO: 172.21.0.1:51052 - "POST /node/69b20e01b0f5558b5d7ccb81 HTTP/1.0" 202 Accepted 2026-03-12 00:55:55,170 - lava_callback - INFO - Starting async job submit for node 69b20e01b0f5558b5d7ccb81 2026-03-12 00:55:55,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:55,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e01b0f5558b5d7ccb81 HTTP/1.1" 200 None 2026-03-12 00:55:55,279 - lava_callback - DEBUG - Processing node 69b20e01b0f5558b5d7ccb81: ltp-containers 2026-03-12 00:55:55,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:56,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:56,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b20e01b0f5558b5d7ccb81/log.txt.gz INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:56,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:57,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:57,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b20e01b0f5558b5d7ccb81/lava-logs.yaml 2026-03-12 00:55:57,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:57,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:57,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b20e01b0f5558b5d7ccb81/lava_callback.json.gz 2026-03-12 00:55:57,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:57,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e01b0f5558b5d7ccb81 HTTP/1.1" 200 None 2026-03-12 00:55:57,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:57,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:55:57,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:57,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e01b0f5558b5d7ccb81 HTTP/1.1" 200 None 2026-03-12 00:55:57,766 - lava_callback - INFO - Completed processing callback for node 69b20e01b0f5558b5d7ccb81 2026-03-12 00:55:58,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:58,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:56:02,750 - lava_callback - INFO - Received callback for node 69af6c0e275c8d3b7939a54e INFO: 172.21.0.1:58598 - "POST /node/69af6c0e275c8d3b7939a54e HTTP/1.0" 202 Accepted 2026-03-12 00:56:02,758 - lava_callback - INFO - Starting async job submit for node 69af6c0e275c8d3b7939a54e 2026-03-12 00:56:02,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:02,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c0e275c8d3b7939a54e HTTP/1.1" 200 None 2026-03-12 00:56:02,783 - lava_callback - DEBUG - Processing node 69af6c0e275c8d3b7939a54e: baseline-arm64-clabbe 2026-03-12 00:56:02,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c0e275c8d3b7939a54e 2026-03-12 00:56:02,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:02,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c0e275c8d3b7939a54e HTTP/1.1" 200 None 2026-03-12 00:56:02,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:02,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:02,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:02,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c0e275c8d3b7939a54e HTTP/1.1" 200 None 2026-03-12 00:56:02,873 - lava_callback - ERROR - Error processing callback for node 69af6c0e275c8d3b7939a54e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:03,079 - lava_callback - INFO - Received callback for node 69b20e20b0f5558b5d7ccbfc INFO: 172.21.0.1:58614 - "POST /node/69b20e20b0f5558b5d7ccbfc HTTP/1.0" 202 Accepted 2026-03-12 00:56:03,089 - lava_callback - INFO - Starting async job submit for node 69b20e20b0f5558b5d7ccbfc 2026-03-12 00:56:03,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e20b0f5558b5d7ccbfc HTTP/1.1" 200 None 2026-03-12 00:56:03,181 - lava_callback - DEBUG - Processing node 69b20e20b0f5558b5d7ccbfc: baseline-arm64 2026-03-12 00:56:03,410 - lava_callback - INFO - Received callback for node 69af6c10275c8d3b7939a551 INFO: 172.21.0.1:58630 - "POST /node/69af6c10275c8d3b7939a551 HTTP/1.0" 202 Accepted 2026-03-12 00:56:03,429 - lava_callback - INFO - Starting async job submit for node 69af6c10275c8d3b7939a551 2026-03-12 00:56:03,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c10275c8d3b7939a551 HTTP/1.1" 200 None 2026-03-12 00:56:03,519 - lava_callback - DEBUG - Processing node 69af6c10275c8d3b7939a551: baseline-arm64-clabbe 2026-03-12 00:56:03,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c10275c8d3b7939a551 2026-03-12 00:56:03,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c10275c8d3b7939a551 HTTP/1.1" 200 None 2026-03-12 00:56:03,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:03,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:03,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c10275c8d3b7939a551 HTTP/1.1" 200 None 2026-03-12 00:56:03,735 - lava_callback - ERROR - Error processing callback for node 69af6c10275c8d3b7939a551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:04,049 - lava_callback - INFO - Received callback for node 69af6c10275c8d3b7939a554 INFO: 172.21.0.1:58640 - "POST /node/69af6c10275c8d3b7939a554 HTTP/1.0" 202 Accepted 2026-03-12 00:56:04,057 - lava_callback - INFO - Starting async job submit for node 69af6c10275c8d3b7939a554 2026-03-12 00:56:04,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c10275c8d3b7939a554 HTTP/1.1" 200 None 2026-03-12 00:56:04,085 - lava_callback - DEBUG - Processing node 69af6c10275c8d3b7939a554: baseline-arm64-clabbe 2026-03-12 00:56:04,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c10275c8d3b7939a554 2026-03-12 00:56:04,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c10275c8d3b7939a554 HTTP/1.1" 200 None 2026-03-12 00:56:04,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:04,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c10275c8d3b7939a554 HTTP/1.1" 200 None 2026-03-12 00:56:04,170 - lava_callback - ERROR - Error processing callback for node 69af6c10275c8d3b7939a554: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:04,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:04,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e20b0f5558b5d7ccbfc/log.txt.gz 2026-03-12 00:56:04,695 - lava_callback - INFO - Received callback for node 69af6c11275c8d3b7939a558 INFO: 172.21.0.1:58642 - "POST /node/69af6c11275c8d3b7939a558 HTTP/1.0" 202 Accepted 2026-03-12 00:56:04,720 - lava_callback - INFO - Starting async job submit for node 69af6c11275c8d3b7939a558 2026-03-12 00:56:04,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:04,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c11275c8d3b7939a558 HTTP/1.1" 200 None 2026-03-12 00:56:04,765 - lava_callback - DEBUG - Processing node 69af6c11275c8d3b7939a558: baseline-arm64-clabbe 2026-03-12 00:56:04,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c11275c8d3b7939a558 2026-03-12 00:56:04,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c11275c8d3b7939a558 HTTP/1.1" 200 None 2026-03-12 00:56:04,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:04,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c11275c8d3b7939a558 HTTP/1.1" 200 None 2026-03-12 00:56:04,850 - lava_callback - ERROR - Error processing callback for node 69af6c11275c8d3b7939a558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:05,457 - lava_callback - INFO - Received callback for node 69af6c14275c8d3b7939a578 INFO: 172.21.0.1:58652 - "POST /node/69af6c14275c8d3b7939a578 HTTP/1.0" 202 Accepted 2026-03-12 00:56:05,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:05,467 - lava_callback - INFO - Starting async job submit for node 69af6c14275c8d3b7939a578 2026-03-12 00:56:05,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e20b0f5558b5d7ccbfc/lava-logs.yaml 2026-03-12 00:56:05,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:05,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:05,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c14275c8d3b7939a578 HTTP/1.1" 200 None 2026-03-12 00:56:05,502 - lava_callback - DEBUG - Processing node 69af6c14275c8d3b7939a578: baseline-arm64-clabbe 2026-03-12 00:56:05,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c14275c8d3b7939a578 2026-03-12 00:56:05,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:05,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c14275c8d3b7939a578 HTTP/1.1" 200 None 2026-03-12 00:56:05,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:05,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:05,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:05,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c14275c8d3b7939a578 HTTP/1.1" 200 None 2026-03-12 00:56:05,579 - lava_callback - ERROR - Error processing callback for node 69af6c14275c8d3b7939a578: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:06,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:06,083 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e20b0f5558b5d7ccbfc/lava_callback.json.gz 2026-03-12 00:56:06,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e20b0f5558b5d7ccbfc HTTP/1.1" 200 None 2026-03-12 00:56:06,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,151 - lava_callback - INFO - Received callback for node 69af6c13275c8d3b7939a575 INFO: 172.21.0.1:58658 - "POST /node/69af6c13275c8d3b7939a575 HTTP/1.0" 202 Accepted 2026-03-12 00:56:06,160 - lava_callback - INFO - Starting async job submit for node 69af6c13275c8d3b7939a575 2026-03-12 00:56:06,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:56:06,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c13275c8d3b7939a575 HTTP/1.1" 200 None 2026-03-12 00:56:06,192 - lava_callback - DEBUG - Processing node 69af6c13275c8d3b7939a575: baseline-arm64-clabbe 2026-03-12 00:56:06,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c13275c8d3b7939a575 2026-03-12 00:56:06,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e20b0f5558b5d7ccbfc HTTP/1.1" 200 None 2026-03-12 00:56:06,214 - lava_callback - INFO - Completed processing callback for node 69b20e20b0f5558b5d7ccbfc 2026-03-12 00:56:06,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c13275c8d3b7939a575 HTTP/1.1" 200 None 2026-03-12 00:56:06,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:06,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c13275c8d3b7939a575 HTTP/1.1" 200 None 2026-03-12 00:56:06,377 - lava_callback - ERROR - Error processing callback for node 69af6c13275c8d3b7939a575: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:07,743 - lava_callback - INFO - Received callback for node 69af6c1b275c8d3b7939a593 INFO: 172.21.0.1:58676 - "POST /node/69af6c1b275c8d3b7939a593 HTTP/1.0" 202 Accepted 2026-03-12 00:56:07,750 - lava_callback - INFO - Starting async job submit for node 69af6c1b275c8d3b7939a593 2026-03-12 00:56:07,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:07,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c1b275c8d3b7939a593 HTTP/1.1" 200 None 2026-03-12 00:56:07,779 - lava_callback - DEBUG - Processing node 69af6c1b275c8d3b7939a593: baseline-arm-baylibre 2026-03-12 00:56:07,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c1b275c8d3b7939a593 2026-03-12 00:56:07,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:07,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c1b275c8d3b7939a593 HTTP/1.1" 200 None 2026-03-12 00:56:07,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:07,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:56:07,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:07,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c1b275c8d3b7939a593 HTTP/1.1" 200 None 2026-03-12 00:56:07,866 - lava_callback - ERROR - Error processing callback for node 69af6c1b275c8d3b7939a593: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:20,959 - lava_callback - INFO - Received callback for node 69b20e30b0f5558b5d7ccc31 INFO: 172.21.0.1:60248 - "POST /node/69b20e30b0f5558b5d7ccc31 HTTP/1.0" 202 Accepted 2026-03-12 00:56:20,969 - lava_callback - INFO - Starting async job submit for node 69b20e30b0f5558b5d7ccc31 2026-03-12 00:56:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:21,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e30b0f5558b5d7ccc31 HTTP/1.1" 200 None 2026-03-12 00:56:21,024 - lava_callback - DEBUG - Processing node 69b20e30b0f5558b5d7ccc31: baseline-nfs-arm64 2026-03-12 00:56:21,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:22,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:22,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e30b0f5558b5d7ccc31/log.txt.gz 2026-03-12 00:56:22,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:23,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:23,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e30b0f5558b5d7ccc31/lava-logs.yaml 2026-03-12 00:56:23,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:23,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:23,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e30b0f5558b5d7ccc31/lava_callback.json.gz 2026-03-12 00:56:23,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:23,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e30b0f5558b5d7ccc31 HTTP/1.1" 200 None 2026-03-12 00:56:23,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:23,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:56:23,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:23,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e30b0f5558b5d7ccc31 HTTP/1.1" 200 None 2026-03-12 00:56:23,724 - lava_callback - INFO - Completed processing callback for node 69b20e30b0f5558b5d7ccc31 INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:26,953 - lava_callback - INFO - Received callback for node 69b20e5eb0f5558b5d7ccd13 INFO: 172.21.0.1:60278 - "POST /node/69b20e5eb0f5558b5d7ccd13 HTTP/1.0" 202 Accepted 2026-03-12 00:56:26,962 - lava_callback - INFO - Starting async job submit for node 69b20e5eb0f5558b5d7ccd13 2026-03-12 00:56:26,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:27,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5eb0f5558b5d7ccd13 HTTP/1.1" 200 None 2026-03-12 00:56:27,021 - lava_callback - DEBUG - Processing node 69b20e5eb0f5558b5d7ccd13: baseline-arm64-clabbe 2026-03-12 00:56:27,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:27,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:27,806 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b20e5eb0f5558b5d7ccd13/log.txt.gz 2026-03-12 00:56:27,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:28,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:28,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:56:28,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:28,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b20e5eb0f5558b5d7ccd13/lava-logs.yaml 2026-03-12 00:56:28,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:29,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:29,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b20e5eb0f5558b5d7ccd13/lava_callback.json.gz 2026-03-12 00:56:29,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5eb0f5558b5d7ccd13 HTTP/1.1" 200 None 2026-03-12 00:56:29,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:29,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:56:29,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:29,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e5eb0f5558b5d7ccd13 HTTP/1.1" 200 None 2026-03-12 00:56:29,131 - lava_callback - INFO - Completed processing callback for node 69b20e5eb0f5558b5d7ccd13 2026-03-12 00:56:29,713 - lava_callback - INFO - Received callback for node 69b20e52b0f5558b5d7cccca INFO: 172.21.0.1:33342 - "POST /node/69b20e52b0f5558b5d7cccca HTTP/1.0" 202 Accepted 2026-03-12 00:56:29,723 - lava_callback - INFO - Starting async job submit for node 69b20e52b0f5558b5d7cccca 2026-03-12 00:56:29,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:29,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e52b0f5558b5d7cccca HTTP/1.1" 200 None 2026-03-12 00:56:29,782 - lava_callback - DEBUG - Processing node 69b20e52b0f5558b5d7cccca: baseline-arm64-broonie 2026-03-12 00:56:30,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:30,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:30,668 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e52b0f5558b5d7cccca/log.txt.gz 2026-03-12 00:56:30,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:31,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:31,437 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e52b0f5558b5d7cccca/lava-logs.yaml 2026-03-12 00:56:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:31,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:31,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e52b0f5558b5d7cccca/lava_callback.json.gz 2026-03-12 00:56:31,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:31,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e52b0f5558b5d7cccca HTTP/1.1" 200 None 2026-03-12 00:56:31,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:32,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:56:32,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:32,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e52b0f5558b5d7cccca HTTP/1.1" 200 None 2026-03-12 00:56:32,040 - lava_callback - INFO - Completed processing callback for node 69b20e52b0f5558b5d7cccca 2026-03-12 00:56:35,191 - lava_callback - INFO - Received callback for node 69b20e08b0f5558b5d7ccb91 INFO: 172.21.0.1:33352 - "POST /node/69b20e08b0f5558b5d7ccb91 HTTP/1.0" 202 Accepted 2026-03-12 00:56:35,199 - lava_callback - INFO - Starting async job submit for node 69b20e08b0f5558b5d7ccb91 2026-03-12 00:56:35,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:35,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e08b0f5558b5d7ccb91 HTTP/1.1" 200 None 2026-03-12 00:56:35,264 - lava_callback - DEBUG - Processing node 69b20e08b0f5558b5d7ccb91: ltp-fs_bind 2026-03-12 00:56:35,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:36,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:36,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b20e08b0f5558b5d7ccb91/log.txt.gz INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:36,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:37,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:37,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b20e08b0f5558b5d7ccb91/lava-logs.yaml 2026-03-12 00:56:37,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:37,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:37,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b20e08b0f5558b5d7ccb91/lava_callback.json.gz 2026-03-12 00:56:37,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:37,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e08b0f5558b5d7ccb91 HTTP/1.1" 200 None 2026-03-12 00:56:37,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:37,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:56:37,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:37,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e08b0f5558b5d7ccb91 HTTP/1.1" 200 None 2026-03-12 00:56:37,784 - lava_callback - INFO - Completed processing callback for node 69b20e08b0f5558b5d7ccb91 INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:47,867 - lava_callback - INFO - Received callback for node 69af6c4a275c8d3b7939a5c0 INFO: 172.21.0.1:45276 - "POST /node/69af6c4a275c8d3b7939a5c0 HTTP/1.0" 202 Accepted 2026-03-12 00:56:47,876 - lava_callback - INFO - Starting async job submit for node 69af6c4a275c8d3b7939a5c0 2026-03-12 00:56:47,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:47,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c4a275c8d3b7939a5c0 HTTP/1.1" 200 None 2026-03-12 00:56:47,900 - lava_callback - DEBUG - Processing node 69af6c4a275c8d3b7939a5c0: baseline-arm-baylibre 2026-03-12 00:56:47,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c4a275c8d3b7939a5c0 2026-03-12 00:56:47,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:47,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c4a275c8d3b7939a5c0 HTTP/1.1" 200 None 2026-03-12 00:56:47,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:47,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:56:47,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:47,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c4a275c8d3b7939a5c0 HTTP/1.1" 200 None 2026-03-12 00:56:47,969 - lava_callback - ERROR - Error processing callback for node 69af6c4a275c8d3b7939a5c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:58,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:58,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:57:45,647 - lava_callback - INFO - Received callback for node 69af6c77275c8d3b7939a621 INFO: 172.21.0.1:46798 - "POST /node/69af6c77275c8d3b7939a621 HTTP/1.0" 202 Accepted 2026-03-12 00:57:45,655 - lava_callback - INFO - Starting async job submit for node 69af6c77275c8d3b7939a621 2026-03-12 00:57:45,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:57:45,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c77275c8d3b7939a621 HTTP/1.1" 200 None 2026-03-12 00:57:45,673 - lava_callback - DEBUG - Processing node 69af6c77275c8d3b7939a621: baseline-arm-clabbe 2026-03-12 00:57:45,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c77275c8d3b7939a621 2026-03-12 00:57:45,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:57:45,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c77275c8d3b7939a621 HTTP/1.1" 200 None 2026-03-12 00:57:45,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:57:45,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 00:57:45,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:57:45,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c77275c8d3b7939a621 HTTP/1.1" 200 None 2026-03-12 00:57:45,743 - lava_callback - ERROR - Error processing callback for node 69af6c77275c8d3b7939a621: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:58:22,024 - lava_callback - INFO - Received callback for node 69b20de6b0f5558b5d7ccb2d INFO: 172.21.0.1:37778 - "POST /node/69b20de6b0f5558b5d7ccb2d HTTP/1.0" 202 Accepted 2026-03-12 00:58:22,032 - lava_callback - INFO - Starting async job submit for node 69b20de6b0f5558b5d7ccb2d 2026-03-12 00:58:22,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:22,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de6b0f5558b5d7ccb2d HTTP/1.1" 200 None 2026-03-12 00:58:22,073 - lava_callback - DEBUG - Processing node 69b20de6b0f5558b5d7ccb2d: baseline-arm-clabbe 2026-03-12 00:58:22,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:22,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:22,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de6b0f5558b5d7ccb2d/log.txt.gz 2026-03-12 00:58:22,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:22,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:22,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de6b0f5558b5d7ccb2d/lava-logs.yaml 2026-03-12 00:58:22,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:22,903 - lava_callback - INFO - Received callback for node 69af6ca2275c8d3b7939a63c INFO: 172.21.0.1:37794 - "POST /node/69af6ca2275c8d3b7939a63c HTTP/1.0" 202 Accepted 2026-03-12 00:58:22,910 - lava_callback - INFO - Starting async job submit for node 69af6ca2275c8d3b7939a63c 2026-03-12 00:58:22,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:22,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6ca2275c8d3b7939a63c HTTP/1.1" 200 None 2026-03-12 00:58:22,935 - lava_callback - DEBUG - Processing node 69af6ca2275c8d3b7939a63c: baseline-arm-clabbe 2026-03-12 00:58:22,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6ca2275c8d3b7939a63c 2026-03-12 00:58:22,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:22,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6ca2275c8d3b7939a63c HTTP/1.1" 200 None 2026-03-12 00:58:22,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:22,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 00:58:22,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:23,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6ca2275c8d3b7939a63c HTTP/1.1" 200 None 2026-03-12 00:58:23,026 - lava_callback - ERROR - Error processing callback for node 69af6ca2275c8d3b7939a63c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:58:23,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:23,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de6b0f5558b5d7ccb2d/lava_callback.json.gz 2026-03-12 00:58:23,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:23,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de6b0f5558b5d7ccb2d HTTP/1.1" 200 None 2026-03-12 00:58:23,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:23,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:58:23,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:23,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de6b0f5558b5d7ccb2d HTTP/1.1" 200 None 2026-03-12 00:58:23,287 - lava_callback - INFO - Completed processing callback for node 69b20de6b0f5558b5d7ccb2d INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:58:28,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:28,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:58:55,278 - lava_callback - INFO - Received callback for node 69b20e03b0f5558b5d7ccb88 INFO: 172.21.0.1:35618 - "POST /node/69b20e03b0f5558b5d7ccb88 HTTP/1.0" 202 Accepted 2026-03-12 00:58:55,289 - lava_callback - INFO - Starting async job submit for node 69b20e03b0f5558b5d7ccb88 2026-03-12 00:58:55,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:55,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e03b0f5558b5d7ccb88 HTTP/1.1" 200 None 2026-03-12 00:58:55,353 - lava_callback - DEBUG - Processing node 69b20e03b0f5558b5d7ccb88: ltp-controllers 2026-03-12 00:58:56,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:56,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:56,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b20e03b0f5558b5d7ccb88/log.txt.gz INFO: 172.21.0.1:35630 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:58:56,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:56,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:56,747 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b20e03b0f5558b5d7ccb88/lava-logs.yaml 2026-03-12 00:58:56,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:57,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:57,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b20e03b0f5558b5d7ccb88/lava_callback.json.gz 2026-03-12 00:58:57,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:57,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e03b0f5558b5d7ccb88 HTTP/1.1" 200 None 2026-03-12 00:58:57,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:57,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:58:57,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:57,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e03b0f5558b5d7ccb88 HTTP/1.1" 200 None 2026-03-12 00:58:57,143 - lava_callback - INFO - Completed processing callback for node 69b20e03b0f5558b5d7ccb88 2026-03-12 00:58:58,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:58,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:59:02,752 - lava_callback - INFO - Received callback for node 69af6ccc275c8d3b7939a651 INFO: 172.21.0.1:44326 - "POST /node/69af6ccc275c8d3b7939a651 HTTP/1.0" 202 Accepted 2026-03-12 00:59:02,758 - lava_callback - INFO - Starting async job submit for node 69af6ccc275c8d3b7939a651 2026-03-12 00:59:02,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:02,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6ccc275c8d3b7939a651 HTTP/1.1" 200 None 2026-03-12 00:59:02,777 - lava_callback - DEBUG - Processing node 69af6ccc275c8d3b7939a651: baseline-arm-clabbe 2026-03-12 00:59:02,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6ccc275c8d3b7939a651 2026-03-12 00:59:02,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:02,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6ccc275c8d3b7939a651 HTTP/1.1" 200 None 2026-03-12 00:59:02,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:02,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 00:59:02,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:02,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6ccc275c8d3b7939a651 HTTP/1.1" 200 None 2026-03-12 00:59:02,854 - lava_callback - ERROR - Error processing callback for node 69af6ccc275c8d3b7939a651: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 00:59:15,440 - lava_callback - INFO - Received callback for node 69b20e0ab0f5558b5d7ccb94 INFO: 172.21.0.1:47638 - "POST /node/69b20e0ab0f5558b5d7ccb94 HTTP/1.0" 202 Accepted 2026-03-12 00:59:15,447 - lava_callback - INFO - Starting async job submit for node 69b20e0ab0f5558b5d7ccb94 2026-03-12 00:59:15,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:15,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0ab0f5558b5d7ccb94 HTTP/1.1" 200 None 2026-03-12 00:59:15,491 - lava_callback - DEBUG - Processing node 69b20e0ab0f5558b5d7ccb94: ltp-fsx 2026-03-12 00:59:16,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:16,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:16,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b20e0ab0f5558b5d7ccb94/log.txt.gz 2026-03-12 00:59:16,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:59:16,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:16,579 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b20e0ab0f5558b5d7ccb94/lava-logs.yaml 2026-03-12 00:59:16,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:16,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:16,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b20e0ab0f5558b5d7ccb94/lava_callback.json.gz 2026-03-12 00:59:16,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:16,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0ab0f5558b5d7ccb94 HTTP/1.1" 200 None 2026-03-12 00:59:16,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:16,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:59:16,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:16,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e0ab0f5558b5d7ccb94 HTTP/1.1" 200 None 2026-03-12 00:59:16,906 - lava_callback - INFO - Completed processing callback for node 69b20e0ab0f5558b5d7ccb94 INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:59:28,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:28,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:59:50,034 - lava_callback - INFO - Received callback for node 69b20e0bb0f5558b5d7ccb97 INFO: 172.21.0.1:55100 - "POST /node/69b20e0bb0f5558b5d7ccb97 HTTP/1.0" 202 Accepted 2026-03-12 00:59:50,041 - lava_callback - INFO - Starting async job submit for node 69b20e0bb0f5558b5d7ccb97 2026-03-12 00:59:50,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:50,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0bb0f5558b5d7ccb97 HTTP/1.1" 200 None 2026-03-12 00:59:50,080 - lava_callback - DEBUG - Processing node 69b20e0bb0f5558b5d7ccb97: ltp-input 2026-03-12 00:59:50,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:50,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:50,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b20e0bb0f5558b5d7ccb97/log.txt.gz 2026-03-12 00:59:50,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:51,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:51,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b20e0bb0f5558b5d7ccb97/lava-logs.yaml 2026-03-12 00:59:51,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:51,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:51,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b20e0bb0f5558b5d7ccb97/lava_callback.json.gz 2026-03-12 00:59:51,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:51,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0bb0f5558b5d7ccb97 HTTP/1.1" 200 None 2026-03-12 00:59:51,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:51,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:59:51,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:51,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e0bb0f5558b5d7ccb97 HTTP/1.1" 200 None 2026-03-12 00:59:51,295 - lava_callback - INFO - Completed processing callback for node 69b20e0bb0f5558b5d7ccb97 INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:59:58,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:58,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:10,478 - lava_callback - INFO - Received callback for node 69b20e2eb0f5558b5d7ccc2b INFO: 172.21.0.1:45930 - "POST /node/69b20e2eb0f5558b5d7ccc2b HTTP/1.0" 202 Accepted 2026-03-12 01:00:10,486 - lava_callback - INFO - Starting async job submit for node 69b20e2eb0f5558b5d7ccc2b 2026-03-12 01:00:10,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:10,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2eb0f5558b5d7ccc2b HTTP/1.1" 200 None 2026-03-12 01:00:10,537 - lava_callback - DEBUG - Processing node 69b20e2eb0f5558b5d7ccc2b: baseline-arm64 2026-03-12 01:00:10,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:11,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:11,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2eb0f5558b5d7ccc2b/log.txt.gz 2026-03-12 01:00:11,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:11,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:11,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2eb0f5558b5d7ccc2b/lava-logs.yaml 2026-03-12 01:00:11,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:11,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:11,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2eb0f5558b5d7ccc2b/lava_callback.json.gz DEBUG: Setup failed for 69b20e2eb0f5558b5d7ccc2b. Transitting job node result: incomplete -> fail 2026-03-12 01:00:11,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:11,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2eb0f5558b5d7ccc2b HTTP/1.1" 200 None 2026-03-12 01:00:11,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:11,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:00:11,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:11,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2eb0f5558b5d7ccc2b HTTP/1.1" 200 None 2026-03-12 01:00:11,903 - lava_callback - INFO - Completed processing callback for node 69b20e2eb0f5558b5d7ccc2b INFO: 172.21.0.1:45940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:21,491 - lava_callback - INFO - Received callback for node 69b20de7b0f5558b5d7ccb32 INFO: 172.21.0.1:40708 - "POST /node/69b20de7b0f5558b5d7ccb32 HTTP/1.0" 202 Accepted 2026-03-12 01:00:21,497 - lava_callback - INFO - Starting async job submit for node 69b20de7b0f5558b5d7ccb32 2026-03-12 01:00:21,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:21,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de7b0f5558b5d7ccb32 HTTP/1.1" 200 None 2026-03-12 01:00:21,533 - lava_callback - DEBUG - Processing node 69b20de7b0f5558b5d7ccb32: baseline-arm-clabbe 2026-03-12 01:00:21,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:21,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:21,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de7b0f5558b5d7ccb32/log.txt.gz 2026-03-12 01:00:22,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:22,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:22,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de7b0f5558b5d7ccb32/lava-logs.yaml 2026-03-12 01:00:22,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:22,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:22,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de7b0f5558b5d7ccb32/lava_callback.json.gz 2026-03-12 01:00:22,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:22,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de7b0f5558b5d7ccb32 HTTP/1.1" 200 None 2026-03-12 01:00:22,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:22,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:00:22,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:22,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de7b0f5558b5d7ccb32 HTTP/1.1" 200 None 2026-03-12 01:00:22,461 - lava_callback - INFO - Completed processing callback for node 69b20de7b0f5558b5d7ccb32 INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:28,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:00:35,287 - lava_callback - INFO - Received callback for node 69b20e0cb0f5558b5d7ccb9a INFO: 172.21.0.1:59028 - "POST /node/69b20e0cb0f5558b5d7ccb9a HTTP/1.0" 202 Accepted 2026-03-12 01:00:35,293 - lava_callback - INFO - Starting async job submit for node 69b20e0cb0f5558b5d7ccb9a 2026-03-12 01:00:35,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:35,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0cb0f5558b5d7ccb9a HTTP/1.1" 200 None 2026-03-12 01:00:35,334 - lava_callback - DEBUG - Processing node 69b20e0cb0f5558b5d7ccb9a: ltp-ipc 2026-03-12 01:00:35,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:35,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:35,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b20e0cb0f5558b5d7ccb9a/log.txt.gz 2026-03-12 01:00:36,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:36,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:36,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b20e0cb0f5558b5d7ccb9a/lava-logs.yaml 2026-03-12 01:00:36,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:36,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:36,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b20e0cb0f5558b5d7ccb9a/lava_callback.json.gz 2026-03-12 01:00:36,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:36,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0cb0f5558b5d7ccb9a HTTP/1.1" 200 None 2026-03-12 01:00:36,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:36,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:36,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:36,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e0cb0f5558b5d7ccb9a HTTP/1.1" 200 None 2026-03-12 01:00:36,583 - lava_callback - INFO - Completed processing callback for node 69b20e0cb0f5558b5d7ccb9a 2026-03-12 01:00:36,915 - lava_callback - INFO - Received callback for node 69b20e0eb0f5558b5d7ccb9d INFO: 172.21.0.1:59052 - "POST /node/69b20e0eb0f5558b5d7ccb9d HTTP/1.0" 202 Accepted 2026-03-12 01:00:36,923 - lava_callback - INFO - Starting async job submit for node 69b20e0eb0f5558b5d7ccb9d 2026-03-12 01:00:36,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:36,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0eb0f5558b5d7ccb9d HTTP/1.1" 200 None 2026-03-12 01:00:36,965 - lava_callback - DEBUG - Processing node 69b20e0eb0f5558b5d7ccb9d: ltp-pty 2026-03-12 01:00:37,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:37,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:37,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b20e0eb0f5558b5d7ccb9d/log.txt.gz 2026-03-12 01:00:37,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:37,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:37,939 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b20e0eb0f5558b5d7ccb9d/lava-logs.yaml 2026-03-12 01:00:37,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:38,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:38,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b20e0eb0f5558b5d7ccb9d/lava_callback.json.gz 2026-03-12 01:00:38,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:38,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0eb0f5558b5d7ccb9d HTTP/1.1" 200 None 2026-03-12 01:00:38,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:38,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:00:38,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:38,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e0eb0f5558b5d7ccb9d HTTP/1.1" 200 None 2026-03-12 01:00:38,214 - lava_callback - INFO - Completed processing callback for node 69b20e0eb0f5558b5d7ccb9d INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:58,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:58,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:01:05,323 - lava_callback - INFO - Received callback for node 69b2103ab0f5558b5d7ccf86 INFO: 172.21.0.1:37888 - "POST /node/69b2103ab0f5558b5d7ccf86 HTTP/1.0" 202 Accepted 2026-03-12 01:01:05,329 - lava_callback - INFO - Starting async job submit for node 69b2103ab0f5558b5d7ccf86 2026-03-12 01:01:05,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:05,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2103ab0f5558b5d7ccf86 HTTP/1.1" 200 None 2026-03-12 01:01:05,345 - lava_callback - DEBUG - Processing node 69b2103ab0f5558b5d7ccf86: baseline-nfs-arm64 2026-03-12 01:01:05,347 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:01:05,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:01:05,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:01:05,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2103ab0f5558b5d7ccf86/lava-logs.yaml 2026-03-12 01:01:05,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:01:05,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:01:05,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2103ab0f5558b5d7ccf86/lava_callback.json.gz 2026-03-12 01:01:05,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:05,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2103ab0f5558b5d7ccf86 HTTP/1.1" 200 None 2026-03-12 01:01:05,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:05,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:01:05,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:05,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2103ab0f5558b5d7ccf86 HTTP/1.1" 200 None 2026-03-12 01:01:05,683 - lava_callback - INFO - Completed processing callback for node 69b2103ab0f5558b5d7ccf86 INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:01:28,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:28,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:03,879 - lava_callback - INFO - Received callback for node 69b21080b0f5558b5d7ccf99 INFO: 172.21.0.1:53200 - "POST /node/69b21080b0f5558b5d7ccf99 HTTP/1.0" 202 Accepted 2026-03-12 01:03:03,885 - lava_callback - INFO - Starting async job submit for node 69b21080b0f5558b5d7ccf99 2026-03-12 01:03:03,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:03,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21080b0f5558b5d7ccf99 HTTP/1.1" 200 None 2026-03-12 01:03:03,929 - lava_callback - DEBUG - Processing node 69b21080b0f5558b5d7ccf99: baseline-arm64 2026-03-12 01:03:04,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:04,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:04,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21080b0f5558b5d7ccf99/log.txt.gz 2026-03-12 01:03:04,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:04,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:04,529 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21080b0f5558b5d7ccf99/lava-logs.yaml 2026-03-12 01:03:04,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:04,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:04,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21080b0f5558b5d7ccf99/lava_callback.json.gz 2026-03-12 01:03:04,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:04,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21080b0f5558b5d7ccf99 HTTP/1.1" 200 None 2026-03-12 01:03:04,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:04,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:03:04,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:04,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21080b0f5558b5d7ccf99 HTTP/1.1" 200 None 2026-03-12 01:03:04,845 - lava_callback - INFO - Completed processing callback for node 69b21080b0f5558b5d7ccf99 INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 01:03:15,477 - lava_callback - INFO - Received callback for node 69b20e11b0f5558b5d7ccba6 INFO: 172.21.0.1:38430 - "POST /node/69b20e11b0f5558b5d7ccba6 HTTP/1.0" 202 Accepted 2026-03-12 01:03:15,483 - lava_callback - INFO - Starting async job submit for node 69b20e11b0f5558b5d7ccba6 2026-03-12 01:03:15,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:15,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e11b0f5558b5d7ccba6 HTTP/1.1" 200 None 2026-03-12 01:03:15,523 - lava_callback - DEBUG - Processing node 69b20e11b0f5558b5d7ccba6: ltp-smoke 2026-03-12 01:03:15,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:16,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:16,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20e11b0f5558b5d7ccba6/log.txt.gz 2026-03-12 01:03:16,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:16,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:16,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20e11b0f5558b5d7ccba6/lava-logs.yaml 2026-03-12 01:03:16,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:16,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:16,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20e11b0f5558b5d7ccba6/lava_callback.json.gz 2026-03-12 01:03:16,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:16,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e11b0f5558b5d7ccba6 HTTP/1.1" 200 None 2026-03-12 01:03:16,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:16,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:03:16,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:16,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e11b0f5558b5d7ccba6 HTTP/1.1" 200 None 2026-03-12 01:03:16,782 - lava_callback - INFO - Completed processing callback for node 69b20e11b0f5558b5d7ccba6 INFO: 172.21.0.1:57296 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:28,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:28,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:54,386 - lava_callback - INFO - Received callback for node 69b210cdb0f5558b5d7ccfa4 INFO: 172.21.0.1:47212 - "POST /node/69b210cdb0f5558b5d7ccfa4 HTTP/1.0" 202 Accepted 2026-03-12 01:03:54,393 - lava_callback - INFO - Starting async job submit for node 69b210cdb0f5558b5d7ccfa4 2026-03-12 01:03:54,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:54,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b210cdb0f5558b5d7ccfa4 HTTP/1.1" 200 None 2026-03-12 01:03:54,461 - lava_callback - DEBUG - Processing node 69b210cdb0f5558b5d7ccfa4: baseline-arm64 2026-03-12 01:03:54,596 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:03:54,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:54,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:54,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b210cdb0f5558b5d7ccfa4/lava-logs.yaml 2026-03-12 01:03:54,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:54,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:54,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b210cdb0f5558b5d7ccfa4/lava_callback.json.gz 2026-03-12 01:03:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:55,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b210cdb0f5558b5d7ccfa4 HTTP/1.1" 200 None 2026-03-12 01:03:55,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:55,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:03:55,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:55,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b210cdb0f5558b5d7ccfa4 HTTP/1.1" 200 None 2026-03-12 01:03:55,160 - lava_callback - INFO - Completed processing callback for node 69b210cdb0f5558b5d7ccfa4 INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:58,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:58,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:04:10,242 - lava_callback - INFO - Received callback for node 69b20e14b0f5558b5d7ccbac INFO: 172.21.0.1:35362 - "POST /node/69b20e14b0f5558b5d7ccbac HTTP/1.0" 202 Accepted 2026-03-12 01:04:10,260 - lava_callback - INFO - Starting async job submit for node 69b20e14b0f5558b5d7ccbac 2026-03-12 01:04:10,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:10,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e14b0f5558b5d7ccbac HTTP/1.1" 200 None 2026-03-12 01:04:10,313 - lava_callback - DEBUG - Processing node 69b20e14b0f5558b5d7ccbac: ltp-syscalls-ipc 2026-03-12 01:04:10,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:10,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:10,846 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b20e14b0f5558b5d7ccbac/log.txt.gz 2026-03-12 01:04:11,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:11,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:11,296 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b20e14b0f5558b5d7ccbac/lava-logs.yaml 2026-03-12 01:04:11,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:11,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:11,504 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b20e14b0f5558b5d7ccbac/lava_callback.json.gz 2026-03-12 01:04:11,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:11,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e14b0f5558b5d7ccbac HTTP/1.1" 200 None 2026-03-12 01:04:11,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:11,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:04:11,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:11,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e14b0f5558b5d7ccbac HTTP/1.1" 200 None 2026-03-12 01:04:11,594 - lava_callback - INFO - Completed processing callback for node 69b20e14b0f5558b5d7ccbac INFO: 172.21.0.1:35378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:04:28,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:28,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:04:35,469 - lava_callback - INFO - Received callback for node 69b20e17b0f5558b5d7ccbb2 INFO: 172.21.0.1:42130 - "POST /node/69b20e17b0f5558b5d7ccbb2 HTTP/1.0" 202 Accepted 2026-03-12 01:04:35,476 - lava_callback - INFO - Starting async job submit for node 69b20e17b0f5558b5d7ccbb2 2026-03-12 01:04:35,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:35,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e17b0f5558b5d7ccbb2 HTTP/1.1" 200 None 2026-03-12 01:04:35,526 - lava_callback - DEBUG - Processing node 69b20e17b0f5558b5d7ccbb2: ltp-watchqueue 2026-03-12 01:04:35,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:36,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:36,046 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b20e17b0f5558b5d7ccbb2/log.txt.gz 2026-03-12 01:04:36,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:36,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:36,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b20e17b0f5558b5d7ccbb2/lava-logs.yaml 2026-03-12 01:04:36,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:04:36,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:36,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b20e17b0f5558b5d7ccbb2/lava_callback.json.gz 2026-03-12 01:04:36,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:36,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e17b0f5558b5d7ccbb2 HTTP/1.1" 200 None 2026-03-12 01:04:36,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:36,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:04:36,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:36,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e17b0f5558b5d7ccbb2 HTTP/1.1" 200 None 2026-03-12 01:04:36,740 - lava_callback - INFO - Completed processing callback for node 69b20e17b0f5558b5d7ccbb2 INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:04:58,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:58,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 01:05:15,516 - lava_callback - INFO - Received callback for node 69b20e15b0f5558b5d7ccbaf INFO: 172.21.0.1:58326 - "POST /node/69b20e15b0f5558b5d7ccbaf HTTP/1.0" 202 Accepted 2026-03-12 01:05:15,523 - lava_callback - INFO - Starting async job submit for node 69b20e15b0f5558b5d7ccbaf 2026-03-12 01:05:15,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:15,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e15b0f5558b5d7ccbaf HTTP/1.1" 200 None 2026-03-12 01:05:15,562 - lava_callback - DEBUG - Processing node 69b20e15b0f5558b5d7ccbaf: ltp-timers 2026-03-12 01:05:15,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:05:16,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:05:16,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b20e15b0f5558b5d7ccbaf/log.txt.gz 2026-03-12 01:05:16,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58338 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:05:16,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:05:16,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b20e15b0f5558b5d7ccbaf/lava-logs.yaml 2026-03-12 01:05:16,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:05:16,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:05:16,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b20e15b0f5558b5d7ccbaf/lava_callback.json.gz 2026-03-12 01:05:16,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:16,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e15b0f5558b5d7ccbaf HTTP/1.1" 200 None 2026-03-12 01:05:16,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:16,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:05:16,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:16,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e15b0f5558b5d7ccbaf HTTP/1.1" 200 None 2026-03-12 01:05:16,835 - lava_callback - INFO - Completed processing callback for node 69b20e15b0f5558b5d7ccbaf INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:05:28,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:28,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:06:31,639 - lava_callback - INFO - Received callback for node 69b21186b0f5558b5d7ccff2 INFO: 172.21.0.1:60468 - "POST /node/69b21186b0f5558b5d7ccff2 HTTP/1.0" 202 Accepted 2026-03-12 01:06:31,645 - lava_callback - INFO - Starting async job submit for node 69b21186b0f5558b5d7ccff2 2026-03-12 01:06:31,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:31,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21186b0f5558b5d7ccff2 HTTP/1.1" 200 None 2026-03-12 01:06:31,665 - lava_callback - DEBUG - Processing node 69b21186b0f5558b5d7ccff2: baseline-arm 2026-03-12 01:06:31,670 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:06:31,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:31,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:31,824 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b21186b0f5558b5d7ccff2/lava-logs.yaml 2026-03-12 01:06:31,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:31,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:31,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b21186b0f5558b5d7ccff2/lava_callback.json.gz 2026-03-12 01:06:31,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:32,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21186b0f5558b5d7ccff2 HTTP/1.1" 200 None 2026-03-12 01:06:32,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:32,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:06:32,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:32,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21186b0f5558b5d7ccff2 HTTP/1.1" 200 None 2026-03-12 01:06:32,054 - lava_callback - INFO - Completed processing callback for node 69b21186b0f5558b5d7ccff2 INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:06:51,368 - lava_callback - INFO - Received callback for node 69b20dcab0f5558b5d7ccab8 INFO: 172.21.0.1:43768 - "POST /node/69b20dcab0f5558b5d7ccab8 HTTP/1.0" 202 Accepted 2026-03-12 01:06:51,375 - lava_callback - INFO - Starting async job submit for node 69b20dcab0f5558b5d7ccab8 2026-03-12 01:06:51,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:51,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcab0f5558b5d7ccab8 HTTP/1.1" 200 None 2026-03-12 01:06:51,448 - lava_callback - DEBUG - Processing node 69b20dcab0f5558b5d7ccab8: baseline-arm 2026-03-12 01:06:52,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:52,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:52,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcab0f5558b5d7ccab8/log.txt.gz 2026-03-12 01:06:52,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:52,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:52,767 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcab0f5558b5d7ccab8/lava-logs.yaml 2026-03-12 01:06:52,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:52,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:52,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcab0f5558b5d7ccab8/lava_callback.json.gz DEBUG: Setup failed for 69b20dcab0f5558b5d7ccab8. Transitting job node result: incomplete -> fail 2026-03-12 01:06:53,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:53,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcab0f5558b5d7ccab8 HTTP/1.1" 200 None 2026-03-12 01:06:53,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:53,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:06:53,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:53,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dcab0f5558b5d7ccab8 HTTP/1.1" 200 None 2026-03-12 01:06:53,282 - lava_callback - INFO - Completed processing callback for node 69b20dcab0f5558b5d7ccab8 INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:06:58,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:58,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:10:31,882 - lava_callback - INFO - Received callback for node 69b20deeb0f5558b5d7ccb4b INFO: 172.21.0.1:56186 - "POST /node/69b20deeb0f5558b5d7ccb4b HTTP/1.0" 202 Accepted 2026-03-12 01:10:31,929 - lava_callback - INFO - Starting async job submit for node 69b20deeb0f5558b5d7ccb4b 2026-03-12 01:10:31,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:31,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20deeb0f5558b5d7ccb4b HTTP/1.1" 200 None 2026-03-12 01:10:31,970 - lava_callback - DEBUG - Processing node 69b20deeb0f5558b5d7ccb4b: baseline-arm-pengutronix 2026-03-12 01:10:32,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:10:32,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:10:32,203 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20deeb0f5558b5d7ccb4b/log.txt.gz 2026-03-12 01:10:32,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:10:32,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:10:32,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20deeb0f5558b5d7ccb4b/lava-logs.yaml 2026-03-12 01:10:32,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:10:32,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:10:32,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20deeb0f5558b5d7ccb4b/lava_callback.json.gz DEBUG: Setup failed for 69b20deeb0f5558b5d7ccb4b. Transitting job node result: incomplete -> fail 2026-03-12 01:10:32,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:32,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20deeb0f5558b5d7ccb4b HTTP/1.1" 200 None 2026-03-12 01:10:32,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:32,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:10:32,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:32,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20deeb0f5558b5d7ccb4b HTTP/1.1" 200 None 2026-03-12 01:10:32,762 - lava_callback - INFO - Completed processing callback for node 69b20deeb0f5558b5d7ccb4b INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:10:58,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:58,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:11:57,915 - lava_callback - INFO - Received callback for node 69b20e33b0f5558b5d7ccc37 INFO: 172.21.0.1:58614 - "POST /node/69b20e33b0f5558b5d7ccc37 HTTP/1.0" 202 Accepted 2026-03-12 01:11:57,923 - lava_callback - INFO - Starting async job submit for node 69b20e33b0f5558b5d7ccc37 2026-03-12 01:11:57,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:11:57,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e33b0f5558b5d7ccc37 HTTP/1.1" 200 None 2026-03-12 01:11:57,981 - lava_callback - DEBUG - Processing node 69b20e33b0f5558b5d7ccc37: baseline-nfs-arm64 2026-03-12 01:11:59,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:11:59,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:11:59,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e33b0f5558b5d7ccc37/log.txt.gz 2026-03-12 01:11:59,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:00,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:00,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e33b0f5558b5d7ccc37/lava-logs.yaml 2026-03-12 01:12:00,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:00,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:00,399 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e33b0f5558b5d7ccc37/lava_callback.json.gz DEBUG: Setup failed for 69b20e33b0f5558b5d7ccc37. Transitting job node result: incomplete -> fail 2026-03-12 01:12:00,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:00,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e33b0f5558b5d7ccc37 HTTP/1.1" 200 None 2026-03-12 01:12:00,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:00,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:12:00,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:00,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e33b0f5558b5d7ccc37 HTTP/1.1" 200 None 2026-03-12 01:12:00,654 - lava_callback - INFO - Completed processing callback for node 69b20e33b0f5558b5d7ccc37 INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:12:28,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:28,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:12:50,592 - lava_callback - INFO - Received callback for node 69b20edfb0f5558b5d7cce74 INFO: 172.21.0.1:38282 - "POST /node/69b20edfb0f5558b5d7cce74 HTTP/1.0" 202 Accepted 2026-03-12 01:12:50,599 - lava_callback - INFO - Starting async job submit for node 69b20edfb0f5558b5d7cce74 2026-03-12 01:12:50,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:50,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20edfb0f5558b5d7cce74 HTTP/1.1" 200 None 2026-03-12 01:12:50,692 - lava_callback - DEBUG - Processing node 69b20edfb0f5558b5d7cce74: ltp-smoke 2026-03-12 01:12:51,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:51,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:51,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20edfb0f5558b5d7cce74/log.txt.gz 2026-03-12 01:12:51,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:51,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:51,789 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20edfb0f5558b5d7cce74/lava-logs.yaml 2026-03-12 01:12:51,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:51,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:51,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20edfb0f5558b5d7cce74/lava_callback.json.gz 2026-03-12 01:12:52,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:52,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20edfb0f5558b5d7cce74 HTTP/1.1" 200 None 2026-03-12 01:12:52,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:52,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 01:12:52,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:52,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20edfb0f5558b5d7cce74 HTTP/1.1" 200 None 2026-03-12 01:12:52,303 - lava_callback - INFO - Completed processing callback for node 69b20edfb0f5558b5d7cce74 INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:12:58,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:58,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:20:55,722 - lava_callback - INFO - Received callback for node 69b20e10b0f5558b5d7ccba3 INFO: 172.21.0.1:47966 - "POST /node/69b20e10b0f5558b5d7ccba3 HTTP/1.0" 202 Accepted 2026-03-12 01:20:55,769 - lava_callback - INFO - Starting async job submit for node 69b20e10b0f5558b5d7ccba3 2026-03-12 01:20:55,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:20:55,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e10b0f5558b5d7ccba3 HTTP/1.1" 200 None 2026-03-12 01:20:55,832 - lava_callback - DEBUG - Processing node 69b20e10b0f5558b5d7ccba3: ltp-sched 2026-03-12 01:20:55,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:20:56,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:20:56,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b20e10b0f5558b5d7ccba3/log.txt.gz 2026-03-12 01:20:56,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:20:56,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:20:56,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b20e10b0f5558b5d7ccba3/lava-logs.yaml 2026-03-12 01:20:56,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:20:56,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:20:56,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b20e10b0f5558b5d7ccba3/lava_callback.json.gz 2026-03-12 01:20:56,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:20:56,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e10b0f5558b5d7ccba3 HTTP/1.1" 200 None 2026-03-12 01:20:56,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:20:56,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:20:56,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:20:56,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e10b0f5558b5d7ccba3 HTTP/1.1" 200 None 2026-03-12 01:20:56,653 - lava_callback - INFO - Completed processing callback for node 69b20e10b0f5558b5d7ccba3 2026-03-12 01:20:58,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:20:58,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:29:31,109 - lava_callback - INFO - Received callback for node 69b1c01aa26b422765ba3fa1 INFO: 172.21.0.1:37666 - "POST /node/69b1c01aa26b422765ba3fa1 HTTP/1.0" 202 Accepted 2026-03-12 01:29:31,116 - lava_callback - INFO - Starting async job submit for node 69b1c01aa26b422765ba3fa1 2026-03-12 01:29:31,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:31,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01aa26b422765ba3fa1 HTTP/1.1" 200 None 2026-03-12 01:29:31,148 - lava_callback - DEBUG - Processing node 69b1c01aa26b422765ba3fa1: baseline-arm64-broonie 2026-03-12 01:29:31,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:29:31,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:29:31,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01aa26b422765ba3fa1/log.txt.gz 2026-03-12 01:29:31,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:29:32,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:29:32,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01aa26b422765ba3fa1/lava-logs.yaml 2026-03-12 01:29:32,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:29:32,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:29:32,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01aa26b422765ba3fa1/lava_callback.json.gz 2026-03-12 01:29:32,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:32,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01aa26b422765ba3fa1 HTTP/1.1" 200 None 2026-03-12 01:29:32,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:32,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 01:29:32,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:32,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c01aa26b422765ba3fa1 HTTP/1.1" 200 None 2026-03-12 01:29:32,338 - lava_callback - INFO - Completed processing callback for node 69b1c01aa26b422765ba3fa1 INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:29:58,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:58,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:31:26,322 - lava_callback - INFO - Received callback for node 69b21753b0f5558b5d7cd198 INFO: 172.21.0.1:48902 - "POST /node/69b21753b0f5558b5d7cd198 HTTP/1.0" 202 Accepted 2026-03-12 01:31:26,328 - lava_callback - INFO - Starting async job submit for node 69b21753b0f5558b5d7cd198 2026-03-12 01:31:26,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:26,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21753b0f5558b5d7cd198 HTTP/1.1" 200 None 2026-03-12 01:31:26,345 - lava_callback - DEBUG - Processing node 69b21753b0f5558b5d7cd198: baseline-nfs-arm64 2026-03-12 01:31:26,346 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:31:26,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:31:26,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:31:26,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b21753b0f5558b5d7cd198/lava-logs.yaml 2026-03-12 01:31:26,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:31:26,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:31:26,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b21753b0f5558b5d7cd198/lava_callback.json.gz 2026-03-12 01:31:26,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:26,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21753b0f5558b5d7cd198 HTTP/1.1" 200 None 2026-03-12 01:31:26,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:26,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:31:26,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:26,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21753b0f5558b5d7cd198 HTTP/1.1" 200 None 2026-03-12 01:31:26,718 - lava_callback - INFO - Completed processing callback for node 69b21753b0f5558b5d7cd198 2026-03-12 01:31:28,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:28,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39608 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:32:51,110 - lava_callback - INFO - Received callback for node 69b20e4db0f5558b5d7cccb9 INFO: 172.21.0.1:39474 - "POST /node/69b20e4db0f5558b5d7cccb9 HTTP/1.0" 202 Accepted 2026-03-12 01:32:51,115 - lava_callback - INFO - Starting async job submit for node 69b20e4db0f5558b5d7cccb9 2026-03-12 01:32:51,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:51,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4db0f5558b5d7cccb9 HTTP/1.1" 200 None 2026-03-12 01:32:51,149 - lava_callback - DEBUG - Processing node 69b20e4db0f5558b5d7cccb9: baseline-arm64-broonie 2026-03-12 01:32:51,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:32:51,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:32:51,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4db0f5558b5d7cccb9/log.txt.gz 2026-03-12 01:32:51,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:32:52,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:32:52,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4db0f5558b5d7cccb9/lava-logs.yaml 2026-03-12 01:32:52,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:32:52,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:32:52,278 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4db0f5558b5d7cccb9/lava_callback.json.gz 2026-03-12 01:32:52,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:52,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4db0f5558b5d7cccb9 HTTP/1.1" 200 None 2026-03-12 01:32:52,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:52,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:32:52,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:52,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e4db0f5558b5d7cccb9 HTTP/1.1" 200 None 2026-03-12 01:32:52,415 - lava_callback - INFO - Completed processing callback for node 69b20e4db0f5558b5d7cccb9 INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:32:58,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:58,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:33:05,566 - lava_callback - INFO - Received callback for node 69b21797b0f5558b5d7cd1a5 INFO: 172.21.0.1:59038 - "POST /node/69b21797b0f5558b5d7cd1a5 HTTP/1.0" 202 Accepted 2026-03-12 01:33:05,572 - lava_callback - INFO - Starting async job submit for node 69b21797b0f5558b5d7cd1a5 2026-03-12 01:33:05,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:05,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21797b0f5558b5d7cd1a5 HTTP/1.1" 200 None 2026-03-12 01:33:05,618 - lava_callback - DEBUG - Processing node 69b21797b0f5558b5d7cd1a5: baseline-arm64 2026-03-12 01:33:05,760 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:33:05,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:33:06,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:33:06,039 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21797b0f5558b5d7cd1a5/lava-logs.yaml 2026-03-12 01:33:06,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:33:06,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:33:06,160 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21797b0f5558b5d7cd1a5/lava_callback.json.gz 2026-03-12 01:33:06,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:06,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21797b0f5558b5d7cd1a5 HTTP/1.1" 200 None 2026-03-12 01:33:06,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:06,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:33:06,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:06,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21797b0f5558b5d7cd1a5 HTTP/1.1" 200 None 2026-03-12 01:33:06,334 - lava_callback - INFO - Completed processing callback for node 69b21797b0f5558b5d7cd1a5 INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:33:28,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:28,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 01:34:15,750 - lava_callback - INFO - Received callback for node 69b217e3b0f5558b5d7cd1b8 INFO: 172.21.0.1:40828 - "POST /node/69b217e3b0f5558b5d7cd1b8 HTTP/1.0" 202 Accepted 2026-03-12 01:34:15,760 - lava_callback - INFO - Starting async job submit for node 69b217e3b0f5558b5d7cd1b8 2026-03-12 01:34:15,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:15,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b217e3b0f5558b5d7cd1b8 HTTP/1.1" 200 None 2026-03-12 01:34:15,805 - lava_callback - DEBUG - Processing node 69b217e3b0f5558b5d7cd1b8: baseline-arm64 2026-03-12 01:34:15,940 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:34:16,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:34:16,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:34:16,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b217e3b0f5558b5d7cd1b8/lava-logs.yaml 2026-03-12 01:34:16,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:34:16,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:34:16,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b217e3b0f5558b5d7cd1b8/lava_callback.json.gz 2026-03-12 01:34:16,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:16,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b217e3b0f5558b5d7cd1b8 HTTP/1.1" 200 None 2026-03-12 01:34:16,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:16,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:34:16,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:16,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b217e3b0f5558b5d7cd1b8 HTTP/1.1" 200 None 2026-03-12 01:34:16,521 - lava_callback - INFO - Completed processing callback for node 69b217e3b0f5558b5d7cd1b8 INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:34:28,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:28,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:35:51,217 - lava_callback - INFO - Received callback for node 69b21852b0f5558b5d7cd1d4 INFO: 172.21.0.1:54582 - "POST /node/69b21852b0f5558b5d7cd1d4 HTTP/1.0" 202 Accepted 2026-03-12 01:35:51,223 - lava_callback - INFO - Starting async job submit for node 69b21852b0f5558b5d7cd1d4 2026-03-12 01:35:51,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:51,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21852b0f5558b5d7cd1d4 HTTP/1.1" 200 None 2026-03-12 01:35:51,245 - lava_callback - DEBUG - Processing node 69b21852b0f5558b5d7cd1d4: baseline-arm 2026-03-12 01:35:51,250 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:35:51,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:35:51,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:35:51,464 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b21852b0f5558b5d7cd1d4/lava-logs.yaml 2026-03-12 01:35:51,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:35:51,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:35:51,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b21852b0f5558b5d7cd1d4/lava_callback.json.gz 2026-03-12 01:35:51,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:51,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21852b0f5558b5d7cd1d4 HTTP/1.1" 200 None 2026-03-12 01:35:51,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:51,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:35:51,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:51,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21852b0f5558b5d7cd1d4 HTTP/1.1" 200 None 2026-03-12 01:35:51,678 - lava_callback - INFO - Completed processing callback for node 69b21852b0f5558b5d7cd1d4 INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:35:58,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:58,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:36:56,538 - lava_callback - INFO - Received callback for node 69b21705b0f5558b5d7cd18b INFO: 172.21.0.1:36962 - "POST /node/69b21705b0f5558b5d7cd18b HTTP/1.0" 202 Accepted 2026-03-12 01:36:56,561 - lava_callback - INFO - Starting async job submit for node 69b21705b0f5558b5d7cd18b 2026-03-12 01:36:56,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:56,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21705b0f5558b5d7cd18b HTTP/1.1" 200 None 2026-03-12 01:36:56,612 - lava_callback - DEBUG - Processing node 69b21705b0f5558b5d7cd18b: baseline-arm64 2026-03-12 01:36:56,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:36:57,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:36:57,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21705b0f5558b5d7cd18b/log.txt.gz 2026-03-12 01:36:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:36:57,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:36:57,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21705b0f5558b5d7cd18b/lava-logs.yaml 2026-03-12 01:36:57,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:36:57,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:36:57,763 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21705b0f5558b5d7cd18b/lava_callback.json.gz DEBUG: Setup failed for 69b21705b0f5558b5d7cd18b. Transitting job node result: incomplete -> fail 2026-03-12 01:36:57,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:57,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21705b0f5558b5d7cd18b HTTP/1.1" 200 None 2026-03-12 01:36:57,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:57,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:36:57,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:57,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21705b0f5558b5d7cd18b HTTP/1.1" 200 None 2026-03-12 01:36:57,974 - lava_callback - INFO - Completed processing callback for node 69b21705b0f5558b5d7cd18b 2026-03-12 01:36:58,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:58,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:48:10,610 - lava_callback - INFO - Received callback for node 69af784f275c8d3b7939a8e0 INFO: 172.21.0.1:48356 - "POST /node/69af784f275c8d3b7939a8e0 HTTP/1.0" 202 Accepted 2026-03-12 01:48:10,616 - lava_callback - INFO - Starting async job submit for node 69af784f275c8d3b7939a8e0 2026-03-12 01:48:10,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:48:10,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af784f275c8d3b7939a8e0 HTTP/1.1" 200 None 2026-03-12 01:48:10,636 - lava_callback - DEBUG - Processing node 69af784f275c8d3b7939a8e0: baseline-arm64-baylibre 2026-03-12 01:48:10,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af784f275c8d3b7939a8e0 2026-03-12 01:48:10,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:48:10,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af784f275c8d3b7939a8e0 HTTP/1.1" 200 None 2026-03-12 01:48:10,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:48:10,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 01:48:10,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:48:10,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af784f275c8d3b7939a8e0 HTTP/1.1" 200 None 2026-03-12 01:48:10,703 - lava_callback - ERROR - Error processing callback for node 69af784f275c8d3b7939a8e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45518 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:51:05,206 - lava_callback - INFO - Received callback for node 69af78f6275c8d3b7939a909 INFO: 172.21.0.1:44046 - "POST /node/69af78f6275c8d3b7939a909 HTTP/1.0" 202 Accepted 2026-03-12 01:51:05,211 - lava_callback - INFO - Starting async job submit for node 69af78f6275c8d3b7939a909 2026-03-12 01:51:05,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:51:05,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af78f6275c8d3b7939a909 HTTP/1.1" 200 None 2026-03-12 01:51:05,230 - lava_callback - DEBUG - Processing node 69af78f6275c8d3b7939a909: baseline-arm64-clabbe 2026-03-12 01:51:05,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af78f6275c8d3b7939a909 2026-03-12 01:51:05,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:51:05,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af78f6275c8d3b7939a909 HTTP/1.1" 200 None 2026-03-12 01:51:05,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:51:05,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 01:51:05,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:51:05,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af78f6275c8d3b7939a909 HTTP/1.1" 200 None 2026-03-12 01:51:05,290 - lava_callback - ERROR - Error processing callback for node 69af78f6275c8d3b7939a909: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:52:23,235 - lava_callback - INFO - Received callback for node 69b21875b0f5558b5d7cd1e0 INFO: 172.21.0.1:44042 - "POST /node/69b21875b0f5558b5d7cd1e0 HTTP/1.0" 202 Accepted 2026-03-12 01:52:23,242 - lava_callback - INFO - Starting async job submit for node 69b21875b0f5558b5d7cd1e0 2026-03-12 01:52:23,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:23,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21875b0f5558b5d7cd1e0 HTTP/1.1" 200 None 2026-03-12 01:52:23,320 - lava_callback - DEBUG - Processing node 69b21875b0f5558b5d7cd1e0: baseline-arm 2026-03-12 01:52:23,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:52:24,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:52:24,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b21875b0f5558b5d7cd1e0/log.txt.gz 2026-03-12 01:52:24,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:52:24,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:52:24,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b21875b0f5558b5d7cd1e0/lava-logs.yaml 2026-03-12 01:52:24,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:52:24,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:52:24,856 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b21875b0f5558b5d7cd1e0/lava_callback.json.gz DEBUG: Setup failed for 69b21875b0f5558b5d7cd1e0. Transitting job node result: incomplete -> fail 2026-03-12 01:52:24,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:24,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21875b0f5558b5d7cd1e0 HTTP/1.1" 200 None 2026-03-12 01:52:24,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:24,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:52:24,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:25,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21875b0f5558b5d7cd1e0 HTTP/1.1" 200 None 2026-03-12 01:52:25,170 - lava_callback - INFO - Completed processing callback for node 69b21875b0f5558b5d7cd1e0 INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:52:28,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:28,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:55:05,370 - lava_callback - INFO - Received callback for node 69af79e7275c8d3b7939a946 INFO: 172.21.0.1:47774 - "POST /node/69af79e7275c8d3b7939a946 HTTP/1.0" 202 Accepted 2026-03-12 01:55:05,375 - lava_callback - INFO - Starting async job submit for node 69af79e7275c8d3b7939a946 2026-03-12 01:55:05,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:55:05,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af79e7275c8d3b7939a946 HTTP/1.1" 200 None 2026-03-12 01:55:05,391 - lava_callback - DEBUG - Processing node 69af79e7275c8d3b7939a946: baseline-arm64-clabbe 2026-03-12 01:55:05,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af79e7275c8d3b7939a946 2026-03-12 01:55:05,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:55:05,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af79e7275c8d3b7939a946 HTTP/1.1" 200 None 2026-03-12 01:55:05,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:55:05,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 01:55:05,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:55:05,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af79e7275c8d3b7939a946 HTTP/1.1" 200 None 2026-03-12 01:55:05,448 - lava_callback - ERROR - Error processing callback for node 69af79e7275c8d3b7939a946: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:57:06,571 - lava_callback - INFO - Received callback for node 69b218e9b0f5558b5d7cd216 INFO: 172.21.0.1:59616 - "POST /node/69b218e9b0f5558b5d7cd216 HTTP/1.0" 202 Accepted 2026-03-12 01:57:06,617 - lava_callback - INFO - Starting async job submit for node 69b218e9b0f5558b5d7cd216 2026-03-12 01:57:06,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:06,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b218e9b0f5558b5d7cd216 HTTP/1.1" 200 None 2026-03-12 01:57:06,665 - lava_callback - DEBUG - Processing node 69b218e9b0f5558b5d7cd216: baseline-arm-pengutronix 2026-03-12 01:57:06,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:06,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:06,917 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b218e9b0f5558b5d7cd216/log.txt.gz 2026-03-12 01:57:06,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:07,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:07,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b218e9b0f5558b5d7cd216/lava-logs.yaml 2026-03-12 01:57:07,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:07,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:07,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b218e9b0f5558b5d7cd216/lava_callback.json.gz DEBUG: Setup failed for 69b218e9b0f5558b5d7cd216. Transitting job node result: incomplete -> fail 2026-03-12 01:57:07,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:07,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b218e9b0f5558b5d7cd216 HTTP/1.1" 200 None 2026-03-12 01:57:07,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:07,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:57:07,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:07,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b218e9b0f5558b5d7cd216 HTTP/1.1" 200 None 2026-03-12 01:57:07,499 - lava_callback - INFO - Completed processing callback for node 69b218e9b0f5558b5d7cd216 INFO: 172.21.0.1:42930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:57:28,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:28,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:57:32,700 - lava_callback - INFO - Received callback for node 69b21d0db0f5558b5d7cd2d4 INFO: 172.21.0.1:43998 - "POST /node/69b21d0db0f5558b5d7cd2d4 HTTP/1.0" 202 Accepted 2026-03-12 01:57:32,706 - lava_callback - INFO - Starting async job submit for node 69b21d0db0f5558b5d7cd2d4 2026-03-12 01:57:32,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:32,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21d0db0f5558b5d7cd2d4 HTTP/1.1" 200 None 2026-03-12 01:57:32,738 - lava_callback - DEBUG - Processing node 69b21d0db0f5558b5d7cd2d4: baseline-arm64-broonie 2026-03-12 01:57:33,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:33,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:33,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d0db0f5558b5d7cd2d4/log.txt.gz 2026-03-12 01:57:33,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:33,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:33,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d0db0f5558b5d7cd2d4/lava-logs.yaml 2026-03-12 01:57:33,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:33,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:33,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d0db0f5558b5d7cd2d4/lava_callback.json.gz 2026-03-12 01:57:33,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:33,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21d0db0f5558b5d7cd2d4 HTTP/1.1" 200 None 2026-03-12 01:57:33,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:33,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 01:57:33,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:33,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21d0db0f5558b5d7cd2d4 HTTP/1.1" 200 None 2026-03-12 01:57:33,864 - lava_callback - INFO - Completed processing callback for node 69b21d0db0f5558b5d7cd2d4 INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:57:58,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:58,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:58:09,804 - lava_callback - INFO - Received callback for node 69b2190ab0f5558b5d7cd224 INFO: 172.21.0.1:58328 - "POST /node/69b2190ab0f5558b5d7cd224 HTTP/1.0" 202 Accepted 2026-03-12 01:58:09,812 - lava_callback - INFO - Starting async job submit for node 69b2190ab0f5558b5d7cd224 2026-03-12 01:58:09,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:09,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2190ab0f5558b5d7cd224 HTTP/1.1" 200 None 2026-03-12 01:58:09,870 - lava_callback - DEBUG - Processing node 69b2190ab0f5558b5d7cd224: baseline-nfs-arm64 2026-03-12 01:58:11,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:11,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:11,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2190ab0f5558b5d7cd224/log.txt.gz 2026-03-12 01:58:11,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:12,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:12,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2190ab0f5558b5d7cd224/lava-logs.yaml 2026-03-12 01:58:12,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:12,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:12,350 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2190ab0f5558b5d7cd224/lava_callback.json.gz DEBUG: Setup failed for 69b2190ab0f5558b5d7cd224. Transitting job node result: incomplete -> fail 2026-03-12 01:58:12,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:12,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2190ab0f5558b5d7cd224 HTTP/1.1" 200 None 2026-03-12 01:58:12,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:12,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:58:12,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:12,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2190ab0f5558b5d7cd224 HTTP/1.1" 200 None 2026-03-12 01:58:12,600 - lava_callback - INFO - Completed processing callback for node 69b2190ab0f5558b5d7cd224 INFO: 172.21.0.1:58332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:58:28,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:28,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:58:32,442 - lava_callback - INFO - Received callback for node 69b2198db0f5558b5d7cd232 INFO: 172.21.0.1:51074 - "POST /node/69b2198db0f5558b5d7cd232 HTTP/1.0" 202 Accepted 2026-03-12 01:58:32,448 - lava_callback - INFO - Starting async job submit for node 69b2198db0f5558b5d7cd232 2026-03-12 01:58:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:32,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2198db0f5558b5d7cd232 HTTP/1.1" 200 None 2026-03-12 01:58:32,526 - lava_callback - DEBUG - Processing node 69b2198db0f5558b5d7cd232: ltp-smoke 2026-03-12 01:58:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:33,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:33,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2198db0f5558b5d7cd232/log.txt.gz 2026-03-12 01:58:33,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:33,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:33,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2198db0f5558b5d7cd232/lava-logs.yaml 2026-03-12 01:58:33,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:34,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:34,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2198db0f5558b5d7cd232/lava_callback.json.gz 2026-03-12 01:58:34,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:34,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2198db0f5558b5d7cd232 HTTP/1.1" 200 None 2026-03-12 01:58:34,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:34,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 01:58:34,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:34,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2198db0f5558b5d7cd232 HTTP/1.1" 200 None 2026-03-12 01:58:34,465 - lava_callback - INFO - Completed processing callback for node 69b2198db0f5558b5d7cd232 INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:58:58,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:58,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:08:07,667 - lava_callback - INFO - Received callback for node 69b21fecb0f5558b5d7cd376 INFO: 172.21.0.1:36192 - "POST /node/69b21fecb0f5558b5d7cd376 HTTP/1.0" 202 Accepted 2026-03-12 02:08:07,673 - lava_callback - INFO - Starting async job submit for node 69b21fecb0f5558b5d7cd376 2026-03-12 02:08:07,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:07,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21fecb0f5558b5d7cd376 HTTP/1.1" 200 None 2026-03-12 02:08:07,690 - lava_callback - DEBUG - Processing node 69b21fecb0f5558b5d7cd376: baseline-nfs-arm64 2026-03-12 02:08:07,691 - lava_callback - WARNING - Failed to upload log 2026-03-12 02:08:07,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:08:07,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:08:07,840 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b21fecb0f5558b5d7cd376/lava-logs.yaml 2026-03-12 02:08:07,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:08:07,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:08:07,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b21fecb0f5558b5d7cd376/lava_callback.json.gz 2026-03-12 02:08:07,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:07,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21fecb0f5558b5d7cd376 HTTP/1.1" 200 None 2026-03-12 02:08:08,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:08:08,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:08,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21fecb0f5558b5d7cd376 HTTP/1.1" 200 None 2026-03-12 02:08:08,066 - lava_callback - INFO - Completed processing callback for node 69b21fecb0f5558b5d7cd376 INFO: 172.21.0.1:59296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:08:28,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:28,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:11:12,574 - lava_callback - INFO - Received callback for node 69b22041b0f5558b5d7cd386 INFO: 172.21.0.1:57662 - "POST /node/69b22041b0f5558b5d7cd386 HTTP/1.0" 202 Accepted 2026-03-12 02:11:12,580 - lava_callback - INFO - Starting async job submit for node 69b22041b0f5558b5d7cd386 2026-03-12 02:11:12,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:12,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22041b0f5558b5d7cd386 HTTP/1.1" 200 None 2026-03-12 02:11:12,611 - lava_callback - DEBUG - Processing node 69b22041b0f5558b5d7cd386: baseline-arm64-broonie 2026-03-12 02:11:12,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:13,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:13,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b22041b0f5558b5d7cd386/log.txt.gz 2026-03-12 02:11:13,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:13,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:13,405 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b22041b0f5558b5d7cd386/lava-logs.yaml 2026-03-12 02:11:13,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:13,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:13,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b22041b0f5558b5d7cd386/lava_callback.json.gz 2026-03-12 02:11:13,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:13,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22041b0f5558b5d7cd386 HTTP/1.1" 200 None 2026-03-12 02:11:13,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:13,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:11:13,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:13,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22041b0f5558b5d7cd386 HTTP/1.1" 200 None 2026-03-12 02:11:13,663 - lava_callback - INFO - Completed processing callback for node 69b22041b0f5558b5d7cd386 INFO: 172.21.0.1:57678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:11:28,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:28,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:11:37,723 - lava_callback - INFO - Received callback for node 69b2207eb0f5558b5d7cd391 INFO: 172.21.0.1:48710 - "POST /node/69b2207eb0f5558b5d7cd391 HTTP/1.0" 202 Accepted 2026-03-12 02:11:37,729 - lava_callback - INFO - Starting async job submit for node 69b2207eb0f5558b5d7cd391 2026-03-12 02:11:37,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:37,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2207eb0f5558b5d7cd391 HTTP/1.1" 200 None 2026-03-12 02:11:37,774 - lava_callback - DEBUG - Processing node 69b2207eb0f5558b5d7cd391: baseline-arm64 2026-03-12 02:11:37,975 - lava_callback - WARNING - Failed to upload log 2026-03-12 02:11:38,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:38,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:38,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b2207eb0f5558b5d7cd391/lava-logs.yaml 2026-03-12 02:11:38,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:38,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:38,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b2207eb0f5558b5d7cd391/lava_callback.json.gz 2026-03-12 02:11:38,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:38,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2207eb0f5558b5d7cd391 HTTP/1.1" 200 None 2026-03-12 02:11:38,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:38,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:11:38,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:38,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2207eb0f5558b5d7cd391 HTTP/1.1" 200 None 2026-03-12 02:11:38,579 - lava_callback - INFO - Completed processing callback for node 69b2207eb0f5558b5d7cd391 INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:11:58,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:58,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:12:16,656 - lava_callback - INFO - Received callback for node 69b220cab0f5558b5d7cd3a2 INFO: 172.21.0.1:52024 - "POST /node/69b220cab0f5558b5d7cd3a2 HTTP/1.0" 202 Accepted 2026-03-12 02:12:16,663 - lava_callback - INFO - Starting async job submit for node 69b220cab0f5558b5d7cd3a2 2026-03-12 02:12:16,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:16,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b220cab0f5558b5d7cd3a2 HTTP/1.1" 200 None 2026-03-12 02:12:16,711 - lava_callback - DEBUG - Processing node 69b220cab0f5558b5d7cd3a2: baseline-arm64 2026-03-12 02:12:16,845 - lava_callback - WARNING - Failed to upload log 2026-03-12 02:12:16,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:12:17,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:12:17,120 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b220cab0f5558b5d7cd3a2/lava-logs.yaml 2026-03-12 02:12:17,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:12:17,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:12:17,261 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b220cab0f5558b5d7cd3a2/lava_callback.json.gz 2026-03-12 02:12:17,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:17,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b220cab0f5558b5d7cd3a2 HTTP/1.1" 200 None 2026-03-12 02:12:17,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:17,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:12:17,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:17,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b220cab0f5558b5d7cd3a2 HTTP/1.1" 200 None 2026-03-12 02:12:17,409 - lava_callback - INFO - Completed processing callback for node 69b220cab0f5558b5d7cd3a2 INFO: 172.21.0.1:60034 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:12:28,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:28,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:14:59,503 - lava_callback - INFO - Received callback for node 69b21f93b0f5558b5d7cd362 INFO: 172.21.0.1:58554 - "POST /node/69b21f93b0f5558b5d7cd362 HTTP/1.0" 202 Accepted 2026-03-12 02:14:59,509 - lava_callback - INFO - Starting async job submit for node 69b21f93b0f5558b5d7cd362 2026-03-12 02:14:59,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:14:59,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21f93b0f5558b5d7cd362 HTTP/1.1" 200 None 2026-03-12 02:14:59,553 - lava_callback - DEBUG - Processing node 69b21f93b0f5558b5d7cd362: ltp-sched 2026-03-12 02:14:59,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:15:00,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:15:00,059 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b21f93b0f5558b5d7cd362/log.txt.gz 2026-03-12 02:15:00,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:15:00,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:15:00,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b21f93b0f5558b5d7cd362/lava-logs.yaml 2026-03-12 02:15:00,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:15:00,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:15:00,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b21f93b0f5558b5d7cd362/lava_callback.json.gz 2026-03-12 02:15:00,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:15:00,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21f93b0f5558b5d7cd362 HTTP/1.1" 200 None 2026-03-12 02:15:00,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:15:00,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 02:15:00,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:15:00,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21f93b0f5558b5d7cd362 HTTP/1.1" 200 None 2026-03-12 02:15:00,784 - lava_callback - INFO - Completed processing callback for node 69b21f93b0f5558b5d7cd362 INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:15:28,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:15:28,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET /node/69938cf3cebe99dd8e0720ac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:21:27,173 - lava_callback - INFO - Received callback for node 69b22168b0f5558b5d7cd3bf INFO: 172.21.0.1:36666 - "POST /node/69b22168b0f5558b5d7cd3bf HTTP/1.0" 202 Accepted 2026-03-12 02:21:27,180 - lava_callback - INFO - Starting async job submit for node 69b22168b0f5558b5d7cd3bf 2026-03-12 02:21:27,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:27,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22168b0f5558b5d7cd3bf HTTP/1.1" 200 None 2026-03-12 02:21:27,232 - lava_callback - DEBUG - Processing node 69b22168b0f5558b5d7cd3bf: baseline-arm64 2026-03-12 02:21:27,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:21:27,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:21:27,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b22168b0f5558b5d7cd3bf/log.txt.gz 2026-03-12 02:21:27,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:21:28,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:21:28,217 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b22168b0f5558b5d7cd3bf/lava-logs.yaml 2026-03-12 02:21:28,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:21:28,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:21:28,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b22168b0f5558b5d7cd3bf/lava_callback.json.gz DEBUG: Setup failed for 69b22168b0f5558b5d7cd3bf. Transitting job node result: incomplete -> fail 2026-03-12 02:21:28,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:28,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22168b0f5558b5d7cd3bf HTTP/1.1" 200 None 2026-03-12 02:21:28,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:28,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:21:28,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:28,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22168b0f5558b5d7cd3bf HTTP/1.1" 200 None 2026-03-12 02:21:28,634 - lava_callback - INFO - Completed processing callback for node 69b22168b0f5558b5d7cd3bf 2026-03-12 02:21:28,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:28,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:22:52,447 - lava_callback - INFO - Received callback for node 69af8074275c8d3b7939aa90 INFO: 172.21.0.1:40542 - "POST /node/69af8074275c8d3b7939aa90 HTTP/1.0" 202 Accepted 2026-03-12 02:22:52,453 - lava_callback - INFO - Starting async job submit for node 69af8074275c8d3b7939aa90 2026-03-12 02:22:52,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:22:52,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8074275c8d3b7939aa90 HTTP/1.1" 200 None 2026-03-12 02:22:52,471 - lava_callback - DEBUG - Processing node 69af8074275c8d3b7939aa90: baseline-arm64-baylibre 2026-03-12 02:22:52,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8074275c8d3b7939aa90 2026-03-12 02:22:52,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:22:52,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8074275c8d3b7939aa90 HTTP/1.1" 200 None 2026-03-12 02:22:52,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:22:52,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:22:52,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:22:52,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8074275c8d3b7939aa90 HTTP/1.1" 200 None 2026-03-12 02:22:52,524 - lava_callback - ERROR - Error processing callback for node 69af8074275c8d3b7939aa90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:24:12,525 - lava_callback - INFO - Received callback for node 69af80c0275c8d3b7939aa9c INFO: 172.21.0.1:40270 - "POST /node/69af80c0275c8d3b7939aa9c HTTP/1.0" 202 Accepted 2026-03-12 02:24:12,530 - lava_callback - INFO - Starting async job submit for node 69af80c0275c8d3b7939aa9c 2026-03-12 02:24:12,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:24:12,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af80c0275c8d3b7939aa9c HTTP/1.1" 200 None 2026-03-12 02:24:12,547 - lava_callback - DEBUG - Processing node 69af80c0275c8d3b7939aa9c: baseline-arm64-baylibre 2026-03-12 02:24:12,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af80c0275c8d3b7939aa9c 2026-03-12 02:24:12,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:24:12,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af80c0275c8d3b7939aa9c HTTP/1.1" 200 None 2026-03-12 02:24:12,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:24:12,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:24:12,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:24:12,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af80c0275c8d3b7939aa9c HTTP/1.1" 200 None 2026-03-12 02:24:12,609 - lava_callback - ERROR - Error processing callback for node 69af80c0275c8d3b7939aa9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:25:32,783 - lava_callback - INFO - Received callback for node 69af810f275c8d3b7939aaa4 INFO: 172.21.0.1:46438 - "POST /node/69af810f275c8d3b7939aaa4 HTTP/1.0" 202 Accepted 2026-03-12 02:25:32,788 - lava_callback - INFO - Starting async job submit for node 69af810f275c8d3b7939aaa4 2026-03-12 02:25:32,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:25:32,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af810f275c8d3b7939aaa4 HTTP/1.1" 200 None 2026-03-12 02:25:32,805 - lava_callback - DEBUG - Processing node 69af810f275c8d3b7939aaa4: baseline-arm64-baylibre 2026-03-12 02:25:32,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af810f275c8d3b7939aaa4 2026-03-12 02:25:32,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:25:32,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af810f275c8d3b7939aaa4 HTTP/1.1" 200 None 2026-03-12 02:25:32,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:25:32,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:25:32,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:25:32,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af810f275c8d3b7939aaa4 HTTP/1.1" 200 None 2026-03-12 02:25:32,871 - lava_callback - ERROR - Error processing callback for node 69af810f275c8d3b7939aaa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:26:52,852 - lava_callback - INFO - Received callback for node 69af815d275c8d3b7939aaae INFO: 172.21.0.1:42564 - "POST /node/69af815d275c8d3b7939aaae HTTP/1.0" 202 Accepted 2026-03-12 02:26:52,857 - lava_callback - INFO - Starting async job submit for node 69af815d275c8d3b7939aaae 2026-03-12 02:26:52,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:26:52,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af815d275c8d3b7939aaae HTTP/1.1" 200 None 2026-03-12 02:26:52,873 - lava_callback - DEBUG - Processing node 69af815d275c8d3b7939aaae: baseline-arm64-baylibre 2026-03-12 02:26:52,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af815d275c8d3b7939aaae 2026-03-12 02:26:52,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:26:52,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af815d275c8d3b7939aaae HTTP/1.1" 200 None 2026-03-12 02:26:52,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:26:52,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:26:52,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:26:52,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af815d275c8d3b7939aaae HTTP/1.1" 200 None 2026-03-12 02:26:52,931 - lava_callback - ERROR - Error processing callback for node 69af815d275c8d3b7939aaae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:28:06,771 - lava_callback - INFO - Received callback for node 69af81af275c8d3b7939aabb INFO: 172.21.0.1:53046 - "POST /node/69af81af275c8d3b7939aabb HTTP/1.0" 202 Accepted 2026-03-12 02:28:06,776 - lava_callback - INFO - Starting async job submit for node 69af81af275c8d3b7939aabb 2026-03-12 02:28:06,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:28:06,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af81af275c8d3b7939aabb HTTP/1.1" 200 None 2026-03-12 02:28:06,793 - lava_callback - DEBUG - Processing node 69af81af275c8d3b7939aabb: baseline-arm64-clabbe 2026-03-12 02:28:06,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af81af275c8d3b7939aabb 2026-03-12 02:28:06,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:28:06,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af81af275c8d3b7939aabb HTTP/1.1" 200 None 2026-03-12 02:28:06,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:28:06,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:28:06,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:28:06,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af81af275c8d3b7939aabb HTTP/1.1" 200 None 2026-03-12 02:28:06,856 - lava_callback - ERROR - Error processing callback for node 69af81af275c8d3b7939aabb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:29:26,796 - lava_callback - INFO - Received callback for node 69af81fd275c8d3b7939aac2 INFO: 172.21.0.1:51374 - "POST /node/69af81fd275c8d3b7939aac2 HTTP/1.0" 202 Accepted 2026-03-12 02:29:26,802 - lava_callback - INFO - Starting async job submit for node 69af81fd275c8d3b7939aac2 2026-03-12 02:29:26,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:29:26,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af81fd275c8d3b7939aac2 HTTP/1.1" 200 None 2026-03-12 02:29:26,836 - lava_callback - DEBUG - Processing node 69af81fd275c8d3b7939aac2: baseline-arm64-clabbe 2026-03-12 02:29:26,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af81fd275c8d3b7939aac2 2026-03-12 02:29:26,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:29:26,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af81fd275c8d3b7939aac2 HTTP/1.1" 200 None 2026-03-12 02:29:26,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:29:26,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:29:26,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:29:26,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af81fd275c8d3b7939aac2 HTTP/1.1" 200 None 2026-03-12 02:29:26,898 - lava_callback - ERROR - Error processing callback for node 69af81fd275c8d3b7939aac2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:33:13,051 - lava_callback - INFO - Received callback for node 69af82e3275c8d3b7939aaef INFO: 172.21.0.1:44930 - "POST /node/69af82e3275c8d3b7939aaef HTTP/1.0" 202 Accepted 2026-03-12 02:33:13,057 - lava_callback - INFO - Starting async job submit for node 69af82e3275c8d3b7939aaef 2026-03-12 02:33:13,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:33:13,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af82e3275c8d3b7939aaef HTTP/1.1" 200 None 2026-03-12 02:33:13,078 - lava_callback - DEBUG - Processing node 69af82e3275c8d3b7939aaef: baseline-arm64-baylibre 2026-03-12 02:33:13,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af82e3275c8d3b7939aaef 2026-03-12 02:33:13,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:33:13,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af82e3275c8d3b7939aaef HTTP/1.1" 200 None 2026-03-12 02:33:13,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:33:13,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:33:13,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:33:13,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af82e3275c8d3b7939aaef HTTP/1.1" 200 None 2026-03-12 02:33:13,138 - lava_callback - ERROR - Error processing callback for node 69af82e3275c8d3b7939aaef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57404 - "GET /node/69ae17658ef4424e487b3429%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:35:53,514 - lava_callback - INFO - Received callback for node 69af8384275c8d3b7939ab16 INFO: 172.21.0.1:51342 - "POST /node/69af8384275c8d3b7939ab16 HTTP/1.0" 202 Accepted 2026-03-12 02:35:53,520 - lava_callback - INFO - Starting async job submit for node 69af8384275c8d3b7939ab16 2026-03-12 02:35:53,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:35:53,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8384275c8d3b7939ab16 HTTP/1.1" 200 None 2026-03-12 02:35:53,546 - lava_callback - DEBUG - Processing node 69af8384275c8d3b7939ab16: baseline-arm64-baylibre 2026-03-12 02:35:53,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8384275c8d3b7939ab16 2026-03-12 02:35:53,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:35:53,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8384275c8d3b7939ab16 HTTP/1.1" 200 None 2026-03-12 02:35:53,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:35:53,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:35:53,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:35:53,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8384275c8d3b7939ab16 HTTP/1.1" 200 None 2026-03-12 02:35:53,603 - lava_callback - ERROR - Error processing callback for node 69af8384275c8d3b7939ab16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:38:33,333 - lava_callback - INFO - Received callback for node 69af8420275c8d3b7939ab31 INFO: 172.21.0.1:49128 - "POST /node/69af8420275c8d3b7939ab31 HTTP/1.0" 202 Accepted 2026-03-12 02:38:33,338 - lava_callback - INFO - Starting async job submit for node 69af8420275c8d3b7939ab31 2026-03-12 02:38:33,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:38:33,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8420275c8d3b7939ab31 HTTP/1.1" 200 None 2026-03-12 02:38:33,371 - lava_callback - DEBUG - Processing node 69af8420275c8d3b7939ab31: baseline-arm64-baylibre 2026-03-12 02:38:33,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8420275c8d3b7939ab31 2026-03-12 02:38:33,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:38:33,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8420275c8d3b7939ab31 HTTP/1.1" 200 None 2026-03-12 02:38:33,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:38:33,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:38:33,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:38:33,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8420275c8d3b7939ab31 HTTP/1.1" 200 None 2026-03-12 02:38:33,423 - lava_callback - ERROR - Error processing callback for node 69af8420275c8d3b7939ab31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:41:13,384 - lava_callback - INFO - Received callback for node 69af84ba275c8d3b7939ab48 INFO: 172.21.0.1:42562 - "POST /node/69af84ba275c8d3b7939ab48 HTTP/1.0" 202 Accepted 2026-03-12 02:41:13,390 - lava_callback - INFO - Starting async job submit for node 69af84ba275c8d3b7939ab48 2026-03-12 02:41:13,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:41:13,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af84ba275c8d3b7939ab48 HTTP/1.1" 200 None 2026-03-12 02:41:13,418 - lava_callback - DEBUG - Processing node 69af84ba275c8d3b7939ab48: baseline-arm64-baylibre 2026-03-12 02:41:13,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af84ba275c8d3b7939ab48 2026-03-12 02:41:13,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:41:13,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af84ba275c8d3b7939ab48 HTTP/1.1" 200 None 2026-03-12 02:41:13,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:41:13,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:41:13,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:41:13,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af84ba275c8d3b7939ab48 HTTP/1.1" 200 None 2026-03-12 02:41:13,474 - lava_callback - ERROR - Error processing callback for node 69af84ba275c8d3b7939ab48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:42:20,005 - lava_callback - INFO - Received callback for node 69b2241db0f5558b5d7cd45c INFO: 172.21.0.1:41832 - "POST /node/69b2241db0f5558b5d7cd45c HTTP/1.0" 202 Accepted 2026-03-12 02:42:20,012 - lava_callback - INFO - Starting async job submit for node 69b2241db0f5558b5d7cd45c 2026-03-12 02:42:20,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:20,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2241db0f5558b5d7cd45c HTTP/1.1" 200 None 2026-03-12 02:42:20,086 - lava_callback - DEBUG - Processing node 69b2241db0f5558b5d7cd45c: baseline-arm 2026-03-12 02:42:20,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:42:20,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:42:20,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b2241db0f5558b5d7cd45c/log.txt.gz 2026-03-12 02:42:21,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:42:21,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:42:21,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b2241db0f5558b5d7cd45c/lava-logs.yaml 2026-03-12 02:42:21,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:42:21,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:42:21,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b2241db0f5558b5d7cd45c/lava_callback.json.gz DEBUG: Setup failed for 69b2241db0f5558b5d7cd45c. Transitting job node result: incomplete -> fail 2026-03-12 02:42:21,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:21,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2241db0f5558b5d7cd45c HTTP/1.1" 200 None 2026-03-12 02:42:21,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:21,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 02:42:21,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:21,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2241db0f5558b5d7cd45c HTTP/1.1" 200 None 2026-03-12 02:42:21,920 - lava_callback - INFO - Completed processing callback for node 69b2241db0f5558b5d7cd45c INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:42:28,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:29,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 02:42:33,642 - lava_callback - INFO - Received callback for node 69af850b275c8d3b7939ab56 INFO: 172.21.0.1:49290 - "POST /node/69af850b275c8d3b7939ab56 HTTP/1.0" 202 Accepted 2026-03-12 02:42:33,648 - lava_callback - INFO - Starting async job submit for node 69af850b275c8d3b7939ab56 2026-03-12 02:42:33,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:33,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af850b275c8d3b7939ab56 HTTP/1.1" 200 None 2026-03-12 02:42:33,679 - lava_callback - DEBUG - Processing node 69af850b275c8d3b7939ab56: baseline-arm64-baylibre 2026-03-12 02:42:33,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af850b275c8d3b7939ab56 2026-03-12 02:42:33,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:33,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af850b275c8d3b7939ab56 HTTP/1.1" 200 None 2026-03-12 02:42:33,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:33,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:42:33,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:33,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af850b275c8d3b7939ab56 HTTP/1.1" 200 None 2026-03-12 02:42:33,765 - lava_callback - ERROR - Error processing callback for node 69af850b275c8d3b7939ab56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:45:13,698 - lava_callback - INFO - Received callback for node 69af85ab275c8d3b7939ab76 INFO: 172.21.0.1:59854 - "POST /node/69af85ab275c8d3b7939ab76 HTTP/1.0" 202 Accepted 2026-03-12 02:45:13,704 - lava_callback - INFO - Starting async job submit for node 69af85ab275c8d3b7939ab76 2026-03-12 02:45:13,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:45:13,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af85ab275c8d3b7939ab76 HTTP/1.1" 200 None 2026-03-12 02:45:13,720 - lava_callback - DEBUG - Processing node 69af85ab275c8d3b7939ab76: baseline-arm64-baylibre 2026-03-12 02:45:13,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af85ab275c8d3b7939ab76 2026-03-12 02:45:13,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:45:13,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af85ab275c8d3b7939ab76 HTTP/1.1" 200 None 2026-03-12 02:45:13,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:45:13,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:45:13,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:45:13,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af85ab275c8d3b7939ab76 HTTP/1.1" 200 None 2026-03-12 02:45:13,777 - lava_callback - ERROR - Error processing callback for node 69af85ab275c8d3b7939ab76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:47:30,698 - lava_callback - INFO - Received callback for node 69b226eab0f5558b5d7cd502 INFO: 172.21.0.1:44738 - "POST /node/69b226eab0f5558b5d7cd502 HTTP/1.0" 202 Accepted 2026-03-12 02:47:30,705 - lava_callback - INFO - Starting async job submit for node 69b226eab0f5558b5d7cd502 2026-03-12 02:47:30,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:30,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b226eab0f5558b5d7cd502 HTTP/1.1" 200 None 2026-03-12 02:47:30,755 - lava_callback - DEBUG - Processing node 69b226eab0f5558b5d7cd502: baseline-arm64 2026-03-12 02:47:31,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:47:31,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:47:31,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b226eab0f5558b5d7cd502/log.txt.gz 2026-03-12 02:47:31,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:47:31,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:47:31,808 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b226eab0f5558b5d7cd502/lava-logs.yaml 2026-03-12 02:47:31,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:47:32,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:47:32,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b226eab0f5558b5d7cd502/lava_callback.json.gz DEBUG: Setup failed for 69b226eab0f5558b5d7cd502. Transitting job node result: incomplete -> fail 2026-03-12 02:47:32,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:32,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b226eab0f5558b5d7cd502 HTTP/1.1" 200 None 2026-03-12 02:47:32,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:32,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:47:32,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:32,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b226eab0f5558b5d7cd502 HTTP/1.1" 200 None 2026-03-12 02:47:32,253 - lava_callback - INFO - Completed processing callback for node 69b226eab0f5558b5d7cd502 INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:47:59,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:59,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:49:28,501 - lava_callback - INFO - Received callback for node 69b22535b0f5558b5d7cd48b INFO: 172.21.0.1:43380 - "POST /node/69b22535b0f5558b5d7cd48b HTTP/1.0" 202 Accepted 2026-03-12 02:49:28,549 - lava_callback - INFO - Starting async job submit for node 69b22535b0f5558b5d7cd48b 2026-03-12 02:49:28,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:28,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22535b0f5558b5d7cd48b HTTP/1.1" 200 None 2026-03-12 02:49:28,588 - lava_callback - DEBUG - Processing node 69b22535b0f5558b5d7cd48b: baseline-arm-pengutronix 2026-03-12 02:49:28,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:28,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:28,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22535b0f5558b5d7cd48b/log.txt.gz 2026-03-12 02:49:28,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:29,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:29,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22535b0f5558b5d7cd48b/lava-logs.yaml 2026-03-12 02:49:29,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:29,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:29,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22535b0f5558b5d7cd48b/lava_callback.json.gz DEBUG: Setup failed for 69b22535b0f5558b5d7cd48b. Transitting job node result: incomplete -> fail 2026-03-12 02:49:29,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:29,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22535b0f5558b5d7cd48b HTTP/1.1" 200 None 2026-03-12 02:49:29,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:29,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 02:49:29,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:29,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22535b0f5558b5d7cd48b HTTP/1.1" 200 None 2026-03-12 02:49:29,348 - lava_callback - INFO - Completed processing callback for node 69b22535b0f5558b5d7cd48b INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:49:54,337 - lava_callback - INFO - Received callback for node 69b2259bb0f5558b5d7cd4a0 INFO: 172.21.0.1:47314 - "POST /node/69b2259bb0f5558b5d7cd4a0 HTTP/1.0" 202 Accepted 2026-03-12 02:49:54,343 - lava_callback - INFO - Starting async job submit for node 69b2259bb0f5558b5d7cd4a0 2026-03-12 02:49:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:54,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2259bb0f5558b5d7cd4a0 HTTP/1.1" 200 None 2026-03-12 02:49:54,437 - lava_callback - DEBUG - Processing node 69b2259bb0f5558b5d7cd4a0: ltp-smoke 2026-03-12 02:49:54,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:55,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:55,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2259bb0f5558b5d7cd4a0/log.txt.gz 2026-03-12 02:49:55,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:55,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:55,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2259bb0f5558b5d7cd4a0/lava-logs.yaml 2026-03-12 02:49:55,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:55,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:55,787 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2259bb0f5558b5d7cd4a0/lava_callback.json.gz 2026-03-12 02:49:55,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:55,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2259bb0f5558b5d7cd4a0 HTTP/1.1" 200 None 2026-03-12 02:49:55,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:55,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 02:49:55,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:55,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2259bb0f5558b5d7cd4a0 HTTP/1.1" 200 None 2026-03-12 02:49:56,105 - lava_callback - INFO - Completed processing callback for node 69b2259bb0f5558b5d7cd4a0 INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:49:59,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:59,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:50:28,930 - lava_callback - INFO - Received callback for node 69b22555b0f5558b5d7cd49a INFO: 172.21.0.1:54082 - "POST /node/69b22555b0f5558b5d7cd49a HTTP/1.0" 202 Accepted 2026-03-12 02:50:28,938 - lava_callback - INFO - Starting async job submit for node 69b22555b0f5558b5d7cd49a 2026-03-12 02:50:28,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:28,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22555b0f5558b5d7cd49a HTTP/1.1" 200 None 2026-03-12 02:50:28,997 - lava_callback - DEBUG - Processing node 69b22555b0f5558b5d7cd49a: baseline-nfs-arm64 2026-03-12 02:50:30,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:50:30,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:50:30,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22555b0f5558b5d7cd49a/log.txt.gz 2026-03-12 02:50:30,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:50:31,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:50:31,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22555b0f5558b5d7cd49a/lava-logs.yaml 2026-03-12 02:50:31,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:50:31,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:50:31,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22555b0f5558b5d7cd49a/lava_callback.json.gz DEBUG: Setup failed for 69b22555b0f5558b5d7cd49a. Transitting job node result: incomplete -> fail 2026-03-12 02:50:31,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:31,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22555b0f5558b5d7cd49a HTTP/1.1" 200 None 2026-03-12 02:50:31,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:31,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:50:31,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:31,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22555b0f5558b5d7cd49a HTTP/1.1" 200 None 2026-03-12 02:50:31,662 - lava_callback - INFO - Completed processing callback for node 69b22555b0f5558b5d7cd49a INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:50:59,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:59,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:05:21,456 - lava_callback - INFO - Received callback for node 69b2296db0f5558b5d7cd57e INFO: 172.21.0.1:48662 - "POST /node/69b2296db0f5558b5d7cd57e HTTP/1.0" 202 Accepted 2026-03-12 03:05:21,462 - lava_callback - INFO - Starting async job submit for node 69b2296db0f5558b5d7cd57e 2026-03-12 03:05:21,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:21,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2296db0f5558b5d7cd57e HTTP/1.1" 200 None 2026-03-12 03:05:21,536 - lava_callback - DEBUG - Processing node 69b2296db0f5558b5d7cd57e: baseline-arm 2026-03-12 03:05:22,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:05:22,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:05:22,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b2296db0f5558b5d7cd57e/log.txt.gz 2026-03-12 03:05:22,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:05:22,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:05:22,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b2296db0f5558b5d7cd57e/lava-logs.yaml 2026-03-12 03:05:22,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:05:23,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:05:23,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b2296db0f5558b5d7cd57e/lava_callback.json.gz DEBUG: Setup failed for 69b2296db0f5558b5d7cd57e. Transitting job node result: incomplete -> fail 2026-03-12 03:05:23,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:23,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2296db0f5558b5d7cd57e HTTP/1.1" 200 None 2026-03-12 03:05:23,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:23,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 03:05:23,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:23,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2296db0f5558b5d7cd57e HTTP/1.1" 200 None 2026-03-12 03:05:23,338 - lava_callback - INFO - Completed processing callback for node 69b2296db0f5558b5d7cd57e INFO: 172.21.0.1:48678 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:05:29,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:29,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:11:09,563 - lava_callback - INFO - Received callback for node 69b22a49b0f5558b5d7cd5f7 INFO: 172.21.0.1:35034 - "POST /node/69b22a49b0f5558b5d7cd5f7 HTTP/1.0" 202 Accepted 2026-03-12 03:11:09,609 - lava_callback - INFO - Starting async job submit for node 69b22a49b0f5558b5d7cd5f7 2026-03-12 03:11:09,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:09,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22a49b0f5558b5d7cd5f7 HTTP/1.1" 200 None 2026-03-12 03:11:09,647 - lava_callback - DEBUG - Processing node 69b22a49b0f5558b5d7cd5f7: baseline-arm-pengutronix 2026-03-12 03:11:09,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:11:09,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:11:09,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22a49b0f5558b5d7cd5f7/log.txt.gz 2026-03-12 03:11:10,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:11:10,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:11:10,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22a49b0f5558b5d7cd5f7/lava-logs.yaml 2026-03-12 03:11:10,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:11:10,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:11:10,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22a49b0f5558b5d7cd5f7/lava_callback.json.gz DEBUG: Setup failed for 69b22a49b0f5558b5d7cd5f7. Transitting job node result: incomplete -> fail 2026-03-12 03:11:10,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:10,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22a49b0f5558b5d7cd5f7 HTTP/1.1" 200 None 2026-03-12 03:11:10,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:10,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 03:11:10,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:10,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22a49b0f5558b5d7cd5f7 HTTP/1.1" 200 None 2026-03-12 03:11:10,531 - lava_callback - INFO - Completed processing callback for node 69b22a49b0f5558b5d7cd5f7 INFO: 172.21.0.1:43472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:11:29,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:29,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:13:32,329 - lava_callback - INFO - Received callback for node 69b22ab9b0f5558b5d7cd613 INFO: 172.21.0.1:57274 - "POST /node/69b22ab9b0f5558b5d7cd613 HTTP/1.0" 202 Accepted 2026-03-12 03:13:32,337 - lava_callback - INFO - Starting async job submit for node 69b22ab9b0f5558b5d7cd613 2026-03-12 03:13:32,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:32,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22ab9b0f5558b5d7cd613 HTTP/1.1" 200 None 2026-03-12 03:13:32,395 - lava_callback - DEBUG - Processing node 69b22ab9b0f5558b5d7cd613: baseline-nfs-arm64 2026-03-12 03:13:33,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:13:33,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:13:33,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22ab9b0f5558b5d7cd613/log.txt.gz 2026-03-12 03:13:34,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:13:34,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:13:34,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22ab9b0f5558b5d7cd613/lava-logs.yaml 2026-03-12 03:13:34,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:13:34,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:13:34,834 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22ab9b0f5558b5d7cd613/lava_callback.json.gz DEBUG: Setup failed for 69b22ab9b0f5558b5d7cd613. Transitting job node result: incomplete -> fail 2026-03-12 03:13:34,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:34,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22ab9b0f5558b5d7cd613 HTTP/1.1" 200 None 2026-03-12 03:13:34,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:34,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 03:13:34,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:34,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22ab9b0f5558b5d7cd613 HTTP/1.1" 200 None 2026-03-12 03:13:35,074 - lava_callback - INFO - Completed processing callback for node 69b22ab9b0f5558b5d7cd613 INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:13:59,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:59,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:16:35,481 - lava_callback - INFO - Received callback for node 69af8d03275c8d3b7939ad63 INFO: 172.21.0.1:54844 - "POST /node/69af8d03275c8d3b7939ad63 HTTP/1.0" 202 Accepted 2026-03-12 03:16:35,486 - lava_callback - INFO - Starting async job submit for node 69af8d03275c8d3b7939ad63 2026-03-12 03:16:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:16:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d03275c8d3b7939ad63 HTTP/1.1" 200 None 2026-03-12 03:16:35,505 - lava_callback - DEBUG - Processing node 69af8d03275c8d3b7939ad63: baseline-arm-baylibre 2026-03-12 03:16:35,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8d03275c8d3b7939ad63 2026-03-12 03:16:35,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:16:35,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d03275c8d3b7939ad63 HTTP/1.1" 200 None 2026-03-12 03:16:35,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:16:35,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:16:35,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:16:35,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8d03275c8d3b7939ad63 HTTP/1.1" 200 None 2026-03-12 03:16:35,561 - lava_callback - ERROR - Error processing callback for node 69af8d03275c8d3b7939ad63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 03:17:15,417 - lava_callback - INFO - Received callback for node 69af8d2c275c8d3b7939ad70 INFO: 172.21.0.1:44006 - "POST /node/69af8d2c275c8d3b7939ad70 HTTP/1.0" 202 Accepted 2026-03-12 03:17:15,423 - lava_callback - INFO - Starting async job submit for node 69af8d2c275c8d3b7939ad70 2026-03-12 03:17:15,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:15,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d2c275c8d3b7939ad70 HTTP/1.1" 200 None 2026-03-12 03:17:15,460 - lava_callback - DEBUG - Processing node 69af8d2c275c8d3b7939ad70: baseline-arm-baylibre 2026-03-12 03:17:15,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8d2c275c8d3b7939ad70 2026-03-12 03:17:15,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:15,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d2c275c8d3b7939ad70 HTTP/1.1" 200 None 2026-03-12 03:17:15,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:15,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:17:15,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:15,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8d2c275c8d3b7939ad70 HTTP/1.1" 200 None 2026-03-12 03:17:15,519 - lava_callback - ERROR - Error processing callback for node 69af8d2c275c8d3b7939ad70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:17:55,512 - lava_callback - INFO - Received callback for node 69af8d54275c8d3b7939ad7a INFO: 172.21.0.1:37706 - "POST /node/69af8d54275c8d3b7939ad7a HTTP/1.0" 202 Accepted 2026-03-12 03:17:55,518 - lava_callback - INFO - Starting async job submit for node 69af8d54275c8d3b7939ad7a 2026-03-12 03:17:55,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:55,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d54275c8d3b7939ad7a HTTP/1.1" 200 None 2026-03-12 03:17:55,533 - lava_callback - DEBUG - Processing node 69af8d54275c8d3b7939ad7a: baseline-arm-baylibre 2026-03-12 03:17:55,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8d54275c8d3b7939ad7a 2026-03-12 03:17:55,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:55,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d54275c8d3b7939ad7a HTTP/1.1" 200 None 2026-03-12 03:17:55,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:55,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:17:55,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:55,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8d54275c8d3b7939ad7a HTTP/1.1" 200 None 2026-03-12 03:17:55,590 - lava_callback - ERROR - Error processing callback for node 69af8d54275c8d3b7939ad7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 03:21:15,659 - lava_callback - INFO - Received callback for node 69af8e18275c8d3b7939adab INFO: 172.21.0.1:35224 - "POST /node/69af8e18275c8d3b7939adab HTTP/1.0" 202 Accepted 2026-03-12 03:21:15,665 - lava_callback - INFO - Starting async job submit for node 69af8e18275c8d3b7939adab 2026-03-12 03:21:15,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:21:15,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8e18275c8d3b7939adab HTTP/1.1" 200 None 2026-03-12 03:21:15,681 - lava_callback - DEBUG - Processing node 69af8e18275c8d3b7939adab: baseline-arm-baylibre 2026-03-12 03:21:15,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8e18275c8d3b7939adab 2026-03-12 03:21:15,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:21:15,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8e18275c8d3b7939adab HTTP/1.1" 200 None 2026-03-12 03:21:15,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:21:15,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:21:15,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:21:15,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8e18275c8d3b7939adab HTTP/1.1" 200 None 2026-03-12 03:21:15,789 - lava_callback - ERROR - Error processing callback for node 69af8e18275c8d3b7939adab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:22:55,969 - lava_callback - INFO - Received callback for node 69af8e8e275c8d3b7939adc3 INFO: 172.21.0.1:45680 - "POST /node/69af8e8e275c8d3b7939adc3 HTTP/1.0" 202 Accepted 2026-03-12 03:22:55,975 - lava_callback - INFO - Starting async job submit for node 69af8e8e275c8d3b7939adc3 2026-03-12 03:22:55,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:22:55,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8e8e275c8d3b7939adc3 HTTP/1.1" 200 None 2026-03-12 03:22:55,992 - lava_callback - DEBUG - Processing node 69af8e8e275c8d3b7939adc3: baseline-arm-baylibre 2026-03-12 03:22:55,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8e8e275c8d3b7939adc3 2026-03-12 03:22:55,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:22:56,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8e8e275c8d3b7939adc3 HTTP/1.1" 200 None 2026-03-12 03:22:56,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:22:56,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:22:56,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:22:56,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8e8e275c8d3b7939adc3 HTTP/1.1" 200 None 2026-03-12 03:22:56,052 - lava_callback - ERROR - Error processing callback for node 69af8e8e275c8d3b7939adc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:26:29,236 - lava_callback - INFO - Received callback for node 69af8f5a275c8d3b7939adf3 INFO: 172.21.0.1:40908 - "POST /node/69af8f5a275c8d3b7939adf3 HTTP/1.0" 202 Accepted 2026-03-12 03:26:29,242 - lava_callback - INFO - Starting async job submit for node 69af8f5a275c8d3b7939adf3 2026-03-12 03:26:29,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:26:29,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8f5a275c8d3b7939adf3 HTTP/1.1" 200 None 2026-03-12 03:26:29,259 - lava_callback - DEBUG - Processing node 69af8f5a275c8d3b7939adf3: baseline-arm-clabbe 2026-03-12 03:26:29,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8f5a275c8d3b7939adf3 2026-03-12 03:26:29,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:26:29,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8f5a275c8d3b7939adf3 HTTP/1.1" 200 None 2026-03-12 03:26:29,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:26:29,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:26:29,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:26:29,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8f5a275c8d3b7939adf3 HTTP/1.1" 200 None 2026-03-12 03:26:29,319 - lava_callback - ERROR - Error processing callback for node 69af8f5a275c8d3b7939adf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:27:09,205 - lava_callback - INFO - Received callback for node 69af8f83275c8d3b7939adff INFO: 172.21.0.1:34028 - "POST /node/69af8f83275c8d3b7939adff HTTP/1.0" 202 Accepted 2026-03-12 03:27:09,210 - lava_callback - INFO - Starting async job submit for node 69af8f83275c8d3b7939adff 2026-03-12 03:27:09,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:09,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8f83275c8d3b7939adff HTTP/1.1" 200 None 2026-03-12 03:27:09,228 - lava_callback - DEBUG - Processing node 69af8f83275c8d3b7939adff: baseline-arm-clabbe 2026-03-12 03:27:09,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8f83275c8d3b7939adff 2026-03-12 03:27:09,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:09,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8f83275c8d3b7939adff HTTP/1.1" 200 None 2026-03-12 03:27:09,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:09,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:27:09,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:09,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8f83275c8d3b7939adff HTTP/1.1" 200 None 2026-03-12 03:27:09,284 - lava_callback - ERROR - Error processing callback for node 69af8f83275c8d3b7939adff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:27:49,285 - lava_callback - INFO - Received callback for node 69af8fad275c8d3b7939ae07 INFO: 172.21.0.1:60192 - "POST /node/69af8fad275c8d3b7939ae07 HTTP/1.0" 202 Accepted 2026-03-12 03:27:49,290 - lava_callback - INFO - Starting async job submit for node 69af8fad275c8d3b7939ae07 2026-03-12 03:27:49,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:49,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8fad275c8d3b7939ae07 HTTP/1.1" 200 None 2026-03-12 03:27:49,306 - lava_callback - DEBUG - Processing node 69af8fad275c8d3b7939ae07: baseline-arm-clabbe 2026-03-12 03:27:49,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8fad275c8d3b7939ae07 2026-03-12 03:27:49,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:49,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8fad275c8d3b7939ae07 HTTP/1.1" 200 None 2026-03-12 03:27:49,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:49,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:27:49,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:49,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8fad275c8d3b7939ae07 HTTP/1.1" 200 None 2026-03-12 03:27:49,367 - lava_callback - ERROR - Error processing callback for node 69af8fad275c8d3b7939ae07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:28:29,292 - lava_callback - INFO - Received callback for node 69af8fd5275c8d3b7939ae11 INFO: 172.21.0.1:41534 - "POST /node/69af8fd5275c8d3b7939ae11 HTTP/1.0" 202 Accepted 2026-03-12 03:28:29,297 - lava_callback - INFO - Starting async job submit for node 69af8fd5275c8d3b7939ae11 2026-03-12 03:28:29,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:28:29,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8fd5275c8d3b7939ae11 HTTP/1.1" 200 None 2026-03-12 03:28:29,318 - lava_callback - DEBUG - Processing node 69af8fd5275c8d3b7939ae11: baseline-arm-clabbe 2026-03-12 03:28:29,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8fd5275c8d3b7939ae11 2026-03-12 03:28:29,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:28:29,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8fd5275c8d3b7939ae11 HTTP/1.1" 200 None 2026-03-12 03:28:29,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:28:29,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:28:29,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:28:29,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8fd5275c8d3b7939ae11 HTTP/1.1" 200 None 2026-03-12 03:28:29,379 - lava_callback - ERROR - Error processing callback for node 69af8fd5275c8d3b7939ae11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:30:29,438 - lava_callback - INFO - Received callback for node 69af904c275c8d3b7939ae28 INFO: 172.21.0.1:33420 - "POST /node/69af904c275c8d3b7939ae28 HTTP/1.0" 202 Accepted 2026-03-12 03:30:29,444 - lava_callback - INFO - Starting async job submit for node 69af904c275c8d3b7939ae28 2026-03-12 03:30:29,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:30:29,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af904c275c8d3b7939ae28 HTTP/1.1" 200 None 2026-03-12 03:30:29,461 - lava_callback - DEBUG - Processing node 69af904c275c8d3b7939ae28: baseline-arm-clabbe 2026-03-12 03:30:29,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af904c275c8d3b7939ae28 2026-03-12 03:30:29,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:30:29,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af904c275c8d3b7939ae28 HTTP/1.1" 200 None 2026-03-12 03:30:29,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:30:29,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:30:29,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:30:29,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af904c275c8d3b7939ae28 HTTP/1.1" 200 None 2026-03-12 03:30:29,523 - lava_callback - ERROR - Error processing callback for node 69af904c275c8d3b7939ae28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:04:58,215 - lava_callback - INFO - Received callback for node 69af985a275c8d3b7939afc3 INFO: 172.21.0.1:48544 - "POST /node/69af985a275c8d3b7939afc3 HTTP/1.0" 202 Accepted 2026-03-12 04:04:58,220 - lava_callback - INFO - Starting async job submit for node 69af985a275c8d3b7939afc3 2026-03-12 04:04:58,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:04:58,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af985a275c8d3b7939afc3 HTTP/1.1" 200 None 2026-03-12 04:04:58,237 - lava_callback - DEBUG - Processing node 69af985a275c8d3b7939afc3: baseline-arm64-baylibre 2026-03-12 04:04:58,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af985a275c8d3b7939afc3 2026-03-12 04:04:58,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:04:58,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af985a275c8d3b7939afc3 HTTP/1.1" 200 None 2026-03-12 04:04:58,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:04:58,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:04:58,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:04:58,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af985a275c8d3b7939afc3 HTTP/1.1" 200 None 2026-03-12 04:04:58,291 - lava_callback - ERROR - Error processing callback for node 69af985a275c8d3b7939afc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:07:38,298 - lava_callback - INFO - Received callback for node 69af98f5275c8d3b7939afe0 INFO: 172.21.0.1:47038 - "POST /node/69af98f5275c8d3b7939afe0 HTTP/1.0" 202 Accepted 2026-03-12 04:07:38,303 - lava_callback - INFO - Starting async job submit for node 69af98f5275c8d3b7939afe0 2026-03-12 04:07:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:07:38,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af98f5275c8d3b7939afe0 HTTP/1.1" 200 None 2026-03-12 04:07:38,320 - lava_callback - DEBUG - Processing node 69af98f5275c8d3b7939afe0: baseline-arm64-baylibre 2026-03-12 04:07:38,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af98f5275c8d3b7939afe0 2026-03-12 04:07:38,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:07:38,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af98f5275c8d3b7939afe0 HTTP/1.1" 200 None 2026-03-12 04:07:38,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:07:38,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:07:38,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:07:38,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af98f5275c8d3b7939afe0 HTTP/1.1" 200 None 2026-03-12 04:07:38,377 - lava_callback - ERROR - Error processing callback for node 69af98f5275c8d3b7939afe0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:09:58,444 - lava_callback - INFO - Received callback for node 69af998e275c8d3b7939afff INFO: 172.21.0.1:37170 - "POST /node/69af998e275c8d3b7939afff HTTP/1.0" 202 Accepted 2026-03-12 04:09:58,450 - lava_callback - INFO - Starting async job submit for node 69af998e275c8d3b7939afff 2026-03-12 04:09:58,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:09:58,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af998e275c8d3b7939afff HTTP/1.1" 200 None 2026-03-12 04:09:58,483 - lava_callback - DEBUG - Processing node 69af998e275c8d3b7939afff: baseline-arm64-baylibre 2026-03-12 04:09:58,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af998e275c8d3b7939afff 2026-03-12 04:09:58,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:09:58,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af998e275c8d3b7939afff HTTP/1.1" 200 None 2026-03-12 04:09:58,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:09:58,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:09:58,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:09:58,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af998e275c8d3b7939afff HTTP/1.1" 200 None 2026-03-12 04:09:58,546 - lava_callback - ERROR - Error processing callback for node 69af998e275c8d3b7939afff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:11:18,645 - lava_callback - INFO - Received callback for node 69af99dd275c8d3b7939b011 INFO: 172.21.0.1:48180 - "POST /node/69af99dd275c8d3b7939b011 HTTP/1.0" 202 Accepted 2026-03-12 04:11:18,651 - lava_callback - INFO - Starting async job submit for node 69af99dd275c8d3b7939b011 2026-03-12 04:11:18,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:11:18,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af99dd275c8d3b7939b011 HTTP/1.1" 200 None 2026-03-12 04:11:18,666 - lava_callback - DEBUG - Processing node 69af99dd275c8d3b7939b011: baseline-arm64-baylibre 2026-03-12 04:11:18,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af99dd275c8d3b7939b011 2026-03-12 04:11:18,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:11:18,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af99dd275c8d3b7939b011 HTTP/1.1" 200 None 2026-03-12 04:11:18,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:11:18,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:11:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:11:18,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af99dd275c8d3b7939b011 HTTP/1.1" 200 None 2026-03-12 04:11:18,718 - lava_callback - ERROR - Error processing callback for node 69af99dd275c8d3b7939b011: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:12:38,555 - lava_callback - INFO - Received callback for node 69af9a2b275c8d3b7939b01f INFO: 172.21.0.1:45058 - "POST /node/69af9a2b275c8d3b7939b01f HTTP/1.0" 202 Accepted 2026-03-12 04:12:38,561 - lava_callback - INFO - Starting async job submit for node 69af9a2b275c8d3b7939b01f 2026-03-12 04:12:38,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:12:38,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9a2b275c8d3b7939b01f HTTP/1.1" 200 None 2026-03-12 04:12:38,580 - lava_callback - DEBUG - Processing node 69af9a2b275c8d3b7939b01f: baseline-arm64-baylibre 2026-03-12 04:12:38,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9a2b275c8d3b7939b01f 2026-03-12 04:12:38,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:12:38,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9a2b275c8d3b7939b01f HTTP/1.1" 200 None 2026-03-12 04:12:38,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:12:38,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:12:38,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:12:38,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9a2b275c8d3b7939b01f HTTP/1.1" 200 None 2026-03-12 04:12:38,644 - lava_callback - ERROR - Error processing callback for node 69af9a2b275c8d3b7939b01f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:15:18,695 - lava_callback - INFO - Received callback for node 69af9ac5275c8d3b7939b02e INFO: 172.21.0.1:34256 - "POST /node/69af9ac5275c8d3b7939b02e HTTP/1.0" 202 Accepted 2026-03-12 04:15:18,701 - lava_callback - INFO - Starting async job submit for node 69af9ac5275c8d3b7939b02e 2026-03-12 04:15:18,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:15:18,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9ac5275c8d3b7939b02e HTTP/1.1" 200 None 2026-03-12 04:15:18,724 - lava_callback - DEBUG - Processing node 69af9ac5275c8d3b7939b02e: baseline-arm64-baylibre 2026-03-12 04:15:18,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9ac5275c8d3b7939b02e 2026-03-12 04:15:18,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:15:18,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9ac5275c8d3b7939b02e HTTP/1.1" 200 None 2026-03-12 04:15:18,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:15:18,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:15:18,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:15:18,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9ac5275c8d3b7939b02e HTTP/1.1" 200 None 2026-03-12 04:15:18,774 - lava_callback - ERROR - Error processing callback for node 69af9ac5275c8d3b7939b02e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:17:51,384 - lava_callback - INFO - Received callback for node 69af9b64275c8d3b7939b043 INFO: 172.21.0.1:56208 - "POST /node/69af9b64275c8d3b7939b043 HTTP/1.0" 202 Accepted 2026-03-12 04:17:51,390 - lava_callback - INFO - Starting async job submit for node 69af9b64275c8d3b7939b043 2026-03-12 04:17:51,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:17:51,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9b64275c8d3b7939b043 HTTP/1.1" 200 None 2026-03-12 04:17:51,406 - lava_callback - DEBUG - Processing node 69af9b64275c8d3b7939b043: baseline-arm64-clabbe 2026-03-12 04:17:51,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9b64275c8d3b7939b043 2026-03-12 04:17:51,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:17:51,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9b64275c8d3b7939b043 HTTP/1.1" 200 None 2026-03-12 04:17:51,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:17:51,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:17:51,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:17:51,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9b64275c8d3b7939b043 HTTP/1.1" 200 None 2026-03-12 04:17:51,497 - lava_callback - ERROR - Error processing callback for node 69af9b64275c8d3b7939b043: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:19:11,529 - lava_callback - INFO - Received callback for node 69af9bb2275c8d3b7939b04c INFO: 172.21.0.1:54660 - "POST /node/69af9bb2275c8d3b7939b04c HTTP/1.0" 202 Accepted 2026-03-12 04:19:11,535 - lava_callback - INFO - Starting async job submit for node 69af9bb2275c8d3b7939b04c 2026-03-12 04:19:11,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:19:11,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9bb2275c8d3b7939b04c HTTP/1.1" 200 None 2026-03-12 04:19:11,551 - lava_callback - DEBUG - Processing node 69af9bb2275c8d3b7939b04c: baseline-arm64-clabbe 2026-03-12 04:19:11,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9bb2275c8d3b7939b04c 2026-03-12 04:19:11,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:19:11,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9bb2275c8d3b7939b04c HTTP/1.1" 200 None 2026-03-12 04:19:11,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:19:11,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:19:11,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:19:11,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9bb2275c8d3b7939b04c HTTP/1.1" 200 None 2026-03-12 04:19:11,613 - lava_callback - ERROR - Error processing callback for node 69af9bb2275c8d3b7939b04c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:22:11,504 - lava_callback - INFO - Received callback for node 69af9c5f275c8d3b7939b05c INFO: 172.21.0.1:36442 - "POST /node/69af9c5f275c8d3b7939b05c HTTP/1.0" 202 Accepted 2026-03-12 04:22:11,510 - lava_callback - INFO - Starting async job submit for node 69af9c5f275c8d3b7939b05c 2026-03-12 04:22:11,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:22:11,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9c5f275c8d3b7939b05c HTTP/1.1" 200 None 2026-03-12 04:22:11,526 - lava_callback - DEBUG - Processing node 69af9c5f275c8d3b7939b05c: baseline-arm64-clabbe 2026-03-12 04:22:11,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9c5f275c8d3b7939b05c 2026-03-12 04:22:11,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:22:11,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9c5f275c8d3b7939b05c HTTP/1.1" 200 None 2026-03-12 04:22:11,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:22:11,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:22:11,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:22:11,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9c5f275c8d3b7939b05c HTTP/1.1" 200 None 2026-03-12 04:22:11,598 - lava_callback - ERROR - Error processing callback for node 69af9c5f275c8d3b7939b05c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:23:31,567 - lava_callback - INFO - Received callback for node 69af9cb3275c8d3b7939b06c INFO: 172.21.0.1:55422 - "POST /node/69af9cb3275c8d3b7939b06c HTTP/1.0" 202 Accepted 2026-03-12 04:23:31,573 - lava_callback - INFO - Starting async job submit for node 69af9cb3275c8d3b7939b06c 2026-03-12 04:23:31,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:23:31,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9cb3275c8d3b7939b06c HTTP/1.1" 200 None 2026-03-12 04:23:31,598 - lava_callback - DEBUG - Processing node 69af9cb3275c8d3b7939b06c: baseline-arm64-clabbe 2026-03-12 04:23:31,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9cb3275c8d3b7939b06c 2026-03-12 04:23:31,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:23:31,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9cb3275c8d3b7939b06c HTTP/1.1" 200 None 2026-03-12 04:23:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:23:31,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:23:31,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:23:31,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9cb3275c8d3b7939b06c HTTP/1.1" 200 None 2026-03-12 04:23:31,660 - lava_callback - ERROR - Error processing callback for node 69af9cb3275c8d3b7939b06c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:24:51,628 - lava_callback - INFO - Received callback for node 69af9d05275c8d3b7939b076 INFO: 172.21.0.1:56370 - "POST /node/69af9d05275c8d3b7939b076 HTTP/1.0" 202 Accepted 2026-03-12 04:24:51,634 - lava_callback - INFO - Starting async job submit for node 69af9d05275c8d3b7939b076 2026-03-12 04:24:51,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:24:51,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9d05275c8d3b7939b076 HTTP/1.1" 200 None 2026-03-12 04:24:51,655 - lava_callback - DEBUG - Processing node 69af9d05275c8d3b7939b076: baseline-arm64-clabbe 2026-03-12 04:24:51,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9d05275c8d3b7939b076 2026-03-12 04:24:51,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:24:51,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9d05275c8d3b7939b076 HTTP/1.1" 200 None 2026-03-12 04:24:51,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:24:51,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:24:51,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:24:51,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9d05275c8d3b7939b076 HTTP/1.1" 200 None 2026-03-12 04:24:51,766 - lava_callback - ERROR - Error processing callback for node 69af9d05275c8d3b7939b076: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:26:11,676 - lava_callback - INFO - Received callback for node 69af9d56275c8d3b7939b07f INFO: 172.21.0.1:35964 - "POST /node/69af9d56275c8d3b7939b07f HTTP/1.0" 202 Accepted 2026-03-12 04:26:11,682 - lava_callback - INFO - Starting async job submit for node 69af9d56275c8d3b7939b07f 2026-03-12 04:26:11,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:11,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9d56275c8d3b7939b07f HTTP/1.1" 200 None 2026-03-12 04:26:11,699 - lava_callback - DEBUG - Processing node 69af9d56275c8d3b7939b07f: baseline-arm64-clabbe 2026-03-12 04:26:11,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9d56275c8d3b7939b07f 2026-03-12 04:26:11,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:11,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9d56275c8d3b7939b07f HTTP/1.1" 200 None 2026-03-12 04:26:11,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:11,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:26:11,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:11,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9d56275c8d3b7939b07f HTTP/1.1" 200 None 2026-03-12 04:26:11,761 - lava_callback - ERROR - Error processing callback for node 69af9d56275c8d3b7939b07f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:26:22,855 - lava_callback - INFO - Received callback for node 69b1c01ca26b422765ba3fa8 INFO: 172.21.0.1:56420 - "POST /node/69b1c01ca26b422765ba3fa8 HTTP/1.0" 202 Accepted 2026-03-12 04:26:22,861 - lava_callback - INFO - Starting async job submit for node 69b1c01ca26b422765ba3fa8 2026-03-12 04:26:22,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:22,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01ca26b422765ba3fa8 HTTP/1.1" 200 None 2026-03-12 04:26:22,902 - lava_callback - DEBUG - Processing node 69b1c01ca26b422765ba3fa8: baseline-arm64-broonie 2026-03-12 04:26:23,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:26:23,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:26:23,394 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ca26b422765ba3fa8/log.txt.gz 2026-03-12 04:26:23,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:26:23,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:26:23,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ca26b422765ba3fa8/lava-logs.yaml 2026-03-12 04:26:23,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:26:23,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:26:23,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ca26b422765ba3fa8/lava_callback.json.gz 2026-03-12 04:26:24,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:24,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01ca26b422765ba3fa8 HTTP/1.1" 200 None 2026-03-12 04:26:24,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:24,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 04:26:24,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:24,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c01ca26b422765ba3fa8 HTTP/1.1" 200 None 2026-03-12 04:26:24,066 - lava_callback - INFO - Completed processing callback for node 69b1c01ca26b422765ba3fa8 INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:26:29,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:29,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:28:22,959 - lava_callback - INFO - Received callback for node 69b20e4fb0f5558b5d7cccc0 INFO: 172.21.0.1:40774 - "POST /node/69b20e4fb0f5558b5d7cccc0 HTTP/1.0" 202 Accepted 2026-03-12 04:28:22,965 - lava_callback - INFO - Starting async job submit for node 69b20e4fb0f5558b5d7cccc0 2026-03-12 04:28:22,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:23,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4fb0f5558b5d7cccc0 HTTP/1.1" 200 None 2026-03-12 04:28:23,003 - lava_callback - DEBUG - Processing node 69b20e4fb0f5558b5d7cccc0: baseline-arm64-broonie 2026-03-12 04:28:23,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:28:23,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:28:23,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4fb0f5558b5d7cccc0/log.txt.gz 2026-03-12 04:28:23,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:28:23,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:28:23,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4fb0f5558b5d7cccc0/lava-logs.yaml 2026-03-12 04:28:23,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:28:24,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:28:24,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4fb0f5558b5d7cccc0/lava_callback.json.gz 2026-03-12 04:28:24,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:24,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4fb0f5558b5d7cccc0 HTTP/1.1" 200 None 2026-03-12 04:28:24,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:24,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 04:28:24,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:24,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e4fb0f5558b5d7cccc0 HTTP/1.1" 200 None 2026-03-12 04:28:24,190 - lava_callback - INFO - Completed processing callback for node 69b20e4fb0f5558b5d7cccc0 INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:28:29,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:29,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:30:23,733 - lava_callback - INFO - Received callback for node 69b21d5ab0f5558b5d7cd2e2 INFO: 172.21.0.1:37780 - "POST /node/69b21d5ab0f5558b5d7cd2e2 HTTP/1.0" 202 Accepted 2026-03-12 04:30:23,739 - lava_callback - INFO - Starting async job submit for node 69b21d5ab0f5558b5d7cd2e2 2026-03-12 04:30:23,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:23,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21d5ab0f5558b5d7cd2e2 HTTP/1.1" 200 None 2026-03-12 04:30:23,799 - lava_callback - DEBUG - Processing node 69b21d5ab0f5558b5d7cd2e2: baseline-arm64-broonie 2026-03-12 04:30:24,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:30:24,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:30:24,237 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d5ab0f5558b5d7cd2e2/log.txt.gz 2026-03-12 04:30:24,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:30:24,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:30:24,634 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d5ab0f5558b5d7cd2e2/lava-logs.yaml 2026-03-12 04:30:24,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:30:24,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:30:24,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d5ab0f5558b5d7cd2e2/lava_callback.json.gz 2026-03-12 04:30:24,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:24,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21d5ab0f5558b5d7cd2e2 HTTP/1.1" 200 None 2026-03-12 04:30:24,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:24,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 04:30:24,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:24,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21d5ab0f5558b5d7cd2e2 HTTP/1.1" 200 None 2026-03-12 04:30:24,889 - lava_callback - INFO - Completed processing callback for node 69b21d5ab0f5558b5d7cd2e2 INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:30:29,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:29,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:46:40,459 - lava_callback - INFO - Received callback for node 69afa21b275c8d3b7939b132 INFO: 172.21.0.1:41580 - "POST /node/69afa21b275c8d3b7939b132 HTTP/1.0" 202 Accepted 2026-03-12 04:46:40,465 - lava_callback - INFO - Starting async job submit for node 69afa21b275c8d3b7939b132 2026-03-12 04:46:40,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:46:40,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa21b275c8d3b7939b132 HTTP/1.1" 200 None 2026-03-12 04:46:40,481 - lava_callback - DEBUG - Processing node 69afa21b275c8d3b7939b132: baseline-arm-baylibre 2026-03-12 04:46:40,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa21b275c8d3b7939b132 2026-03-12 04:46:40,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:46:40,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa21b275c8d3b7939b132 HTTP/1.1" 200 None 2026-03-12 04:46:40,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:46:40,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:46:40,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:46:40,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa21b275c8d3b7939b132 HTTP/1.1" 200 None 2026-03-12 04:46:40,547 - lava_callback - ERROR - Error processing callback for node 69afa21b275c8d3b7939b132: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:47:20,313 - lava_callback - INFO - Received callback for node 69afa244275c8d3b7939b143 INFO: 172.21.0.1:35718 - "POST /node/69afa244275c8d3b7939b143 HTTP/1.0" 202 Accepted 2026-03-12 04:47:20,318 - lava_callback - INFO - Starting async job submit for node 69afa244275c8d3b7939b143 2026-03-12 04:47:20,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:47:20,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa244275c8d3b7939b143 HTTP/1.1" 200 None 2026-03-12 04:47:20,337 - lava_callback - DEBUG - Processing node 69afa244275c8d3b7939b143: baseline-arm-baylibre 2026-03-12 04:47:20,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa244275c8d3b7939b143 2026-03-12 04:47:20,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:47:20,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa244275c8d3b7939b143 HTTP/1.1" 200 None 2026-03-12 04:47:20,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:47:20,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:47:20,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:47:20,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa244275c8d3b7939b143 HTTP/1.1" 200 None 2026-03-12 04:47:20,405 - lava_callback - ERROR - Error processing callback for node 69afa244275c8d3b7939b143: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:49:00,499 - lava_callback - INFO - Received callback for node 69afa2ac275c8d3b7939b155 INFO: 172.21.0.1:40108 - "POST /node/69afa2ac275c8d3b7939b155 HTTP/1.0" 202 Accepted 2026-03-12 04:49:00,504 - lava_callback - INFO - Starting async job submit for node 69afa2ac275c8d3b7939b155 2026-03-12 04:49:00,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:00,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2ac275c8d3b7939b155 HTTP/1.1" 200 None 2026-03-12 04:49:00,520 - lava_callback - DEBUG - Processing node 69afa2ac275c8d3b7939b155: baseline-arm-baylibre 2026-03-12 04:49:00,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa2ac275c8d3b7939b155 2026-03-12 04:49:00,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:00,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2ac275c8d3b7939b155 HTTP/1.1" 200 None 2026-03-12 04:49:00,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:00,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:49:00,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:00,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa2ac275c8d3b7939b155 HTTP/1.1" 200 None 2026-03-12 04:49:00,600 - lava_callback - ERROR - Error processing callback for node 69afa2ac275c8d3b7939b155: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:49:40,428 - lava_callback - INFO - Received callback for node 69afa2d4275c8d3b7939b162 INFO: 172.21.0.1:47868 - "POST /node/69afa2d4275c8d3b7939b162 HTTP/1.0" 202 Accepted 2026-03-12 04:49:40,433 - lava_callback - INFO - Starting async job submit for node 69afa2d4275c8d3b7939b162 2026-03-12 04:49:40,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:40,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2d4275c8d3b7939b162 HTTP/1.1" 200 None 2026-03-12 04:49:40,450 - lava_callback - DEBUG - Processing node 69afa2d4275c8d3b7939b162: baseline-arm-baylibre 2026-03-12 04:49:40,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa2d4275c8d3b7939b162 2026-03-12 04:49:40,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:40,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2d4275c8d3b7939b162 HTTP/1.1" 200 None 2026-03-12 04:49:40,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:40,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:49:40,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:40,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa2d4275c8d3b7939b162 HTTP/1.1" 200 None 2026-03-12 04:49:40,511 - lava_callback - ERROR - Error processing callback for node 69afa2d4275c8d3b7939b162: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:50:20,563 - lava_callback - INFO - Received callback for node 69afa2fb275c8d3b7939b16e INFO: 172.21.0.1:54534 - "POST /node/69afa2fb275c8d3b7939b16e HTTP/1.0" 202 Accepted 2026-03-12 04:50:20,569 - lava_callback - INFO - Starting async job submit for node 69afa2fb275c8d3b7939b16e 2026-03-12 04:50:20,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:50:20,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2fb275c8d3b7939b16e HTTP/1.1" 200 None 2026-03-12 04:50:20,606 - lava_callback - DEBUG - Processing node 69afa2fb275c8d3b7939b16e: baseline-arm-baylibre 2026-03-12 04:50:20,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa2fb275c8d3b7939b16e 2026-03-12 04:50:20,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:50:20,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2fb275c8d3b7939b16e HTTP/1.1" 200 None 2026-03-12 04:50:20,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:50:20,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:50:20,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:50:20,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa2fb275c8d3b7939b16e HTTP/1.1" 200 None 2026-03-12 04:50:20,711 - lava_callback - ERROR - Error processing callback for node 69afa2fb275c8d3b7939b16e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:51:00,537 - lava_callback - INFO - Received callback for node 69afa328275c8d3b7939b17e INFO: 172.21.0.1:49540 - "POST /node/69afa328275c8d3b7939b17e HTTP/1.0" 202 Accepted 2026-03-12 04:51:00,543 - lava_callback - INFO - Starting async job submit for node 69afa328275c8d3b7939b17e 2026-03-12 04:51:00,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:00,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa328275c8d3b7939b17e HTTP/1.1" 200 None 2026-03-12 04:51:00,558 - lava_callback - DEBUG - Processing node 69afa328275c8d3b7939b17e: baseline-arm-baylibre 2026-03-12 04:51:00,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa328275c8d3b7939b17e 2026-03-12 04:51:00,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:00,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa328275c8d3b7939b17e HTTP/1.1" 200 None 2026-03-12 04:51:00,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:00,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:51:00,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:00,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa328275c8d3b7939b17e HTTP/1.1" 200 None 2026-03-12 04:51:00,629 - lava_callback - ERROR - Error processing callback for node 69afa328275c8d3b7939b17e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:51:32,744 - lava_callback - INFO - Received callback for node 69afa350275c8d3b7939b18d INFO: 172.21.0.1:33644 - "POST /node/69afa350275c8d3b7939b18d HTTP/1.0" 202 Accepted 2026-03-12 04:51:32,750 - lava_callback - INFO - Starting async job submit for node 69afa350275c8d3b7939b18d 2026-03-12 04:51:32,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:32,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa350275c8d3b7939b18d HTTP/1.1" 200 None 2026-03-12 04:51:32,766 - lava_callback - DEBUG - Processing node 69afa350275c8d3b7939b18d: baseline-arm-clabbe 2026-03-12 04:51:32,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa350275c8d3b7939b18d 2026-03-12 04:51:32,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:32,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa350275c8d3b7939b18d HTTP/1.1" 200 None 2026-03-12 04:51:32,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:32,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:51:32,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:32,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa350275c8d3b7939b18d HTTP/1.1" 200 None 2026-03-12 04:51:32,825 - lava_callback - ERROR - Error processing callback for node 69afa350275c8d3b7939b18d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:52:12,691 - lava_callback - INFO - Received callback for node 69afa377275c8d3b7939b198 INFO: 172.21.0.1:35480 - "POST /node/69afa377275c8d3b7939b198 HTTP/1.0" 202 Accepted 2026-03-12 04:52:12,696 - lava_callback - INFO - Starting async job submit for node 69afa377275c8d3b7939b198 2026-03-12 04:52:12,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:52:12,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa377275c8d3b7939b198 HTTP/1.1" 200 None 2026-03-12 04:52:12,713 - lava_callback - DEBUG - Processing node 69afa377275c8d3b7939b198: baseline-arm-clabbe 2026-03-12 04:52:12,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa377275c8d3b7939b198 2026-03-12 04:52:12,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:52:12,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa377275c8d3b7939b198 HTTP/1.1" 200 None 2026-03-12 04:52:12,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:52:12,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:52:12,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:52:12,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa377275c8d3b7939b198 HTTP/1.1" 200 None 2026-03-12 04:52:12,814 - lava_callback - ERROR - Error processing callback for node 69afa377275c8d3b7939b198: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:54:20,814 - lava_callback - INFO - Received callback for node 69afa3e7275c8d3b7939b1bd INFO: 172.21.0.1:46530 - "POST /node/69afa3e7275c8d3b7939b1bd HTTP/1.0" 202 Accepted 2026-03-12 04:54:20,819 - lava_callback - INFO - Starting async job submit for node 69afa3e7275c8d3b7939b1bd 2026-03-12 04:54:20,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:54:20,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa3e7275c8d3b7939b1bd HTTP/1.1" 200 None 2026-03-12 04:54:20,836 - lava_callback - DEBUG - Processing node 69afa3e7275c8d3b7939b1bd: baseline-arm-baylibre 2026-03-12 04:54:20,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa3e7275c8d3b7939b1bd 2026-03-12 04:54:20,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:54:20,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa3e7275c8d3b7939b1bd HTTP/1.1" 200 None 2026-03-12 04:54:20,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:54:20,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:54:20,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:54:20,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa3e7275c8d3b7939b1bd HTTP/1.1" 200 None 2026-03-12 04:54:20,912 - lava_callback - ERROR - Error processing callback for node 69afa3e7275c8d3b7939b1bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:55:00,784 - lava_callback - INFO - Received callback for node 69afa416275c8d3b7939b1ca INFO: 172.21.0.1:53136 - "POST /node/69afa416275c8d3b7939b1ca HTTP/1.0" 202 Accepted 2026-03-12 04:55:00,790 - lava_callback - INFO - Starting async job submit for node 69afa416275c8d3b7939b1ca 2026-03-12 04:55:00,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:00,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa416275c8d3b7939b1ca HTTP/1.1" 200 None 2026-03-12 04:55:00,806 - lava_callback - DEBUG - Processing node 69afa416275c8d3b7939b1ca: baseline-arm-baylibre 2026-03-12 04:55:00,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa416275c8d3b7939b1ca 2026-03-12 04:55:00,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:00,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa416275c8d3b7939b1ca HTTP/1.1" 200 None 2026-03-12 04:55:00,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:00,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:55:00,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:00,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa416275c8d3b7939b1ca HTTP/1.1" 200 None 2026-03-12 04:55:00,876 - lava_callback - ERROR - Error processing callback for node 69afa416275c8d3b7939b1ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:55:40,846 - lava_callback - INFO - Received callback for node 69afa43b275c8d3b7939b1d4 INFO: 172.21.0.1:57860 - "POST /node/69afa43b275c8d3b7939b1d4 HTTP/1.0" 202 Accepted 2026-03-12 04:55:40,852 - lava_callback - INFO - Starting async job submit for node 69afa43b275c8d3b7939b1d4 2026-03-12 04:55:40,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:40,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa43b275c8d3b7939b1d4 HTTP/1.1" 200 None 2026-03-12 04:55:40,872 - lava_callback - DEBUG - Processing node 69afa43b275c8d3b7939b1d4: baseline-arm-baylibre 2026-03-12 04:55:40,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa43b275c8d3b7939b1d4 2026-03-12 04:55:40,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:40,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa43b275c8d3b7939b1d4 HTTP/1.1" 200 None 2026-03-12 04:55:40,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:40,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:55:40,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:40,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa43b275c8d3b7939b1d4 HTTP/1.1" 200 None 2026-03-12 04:55:40,939 - lava_callback - ERROR - Error processing callback for node 69afa43b275c8d3b7939b1d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:56:20,812 - lava_callback - INFO - Received callback for node 69afa461275c8d3b7939b1e5 INFO: 172.21.0.1:33094 - "POST /node/69afa461275c8d3b7939b1e5 HTTP/1.0" 202 Accepted 2026-03-12 04:56:20,818 - lava_callback - INFO - Starting async job submit for node 69afa461275c8d3b7939b1e5 2026-03-12 04:56:20,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:56:20,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa461275c8d3b7939b1e5 HTTP/1.1" 200 None 2026-03-12 04:56:20,834 - lava_callback - DEBUG - Processing node 69afa461275c8d3b7939b1e5: baseline-arm-baylibre 2026-03-12 04:56:20,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa461275c8d3b7939b1e5 2026-03-12 04:56:20,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:56:20,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa461275c8d3b7939b1e5 HTTP/1.1" 200 None 2026-03-12 04:56:20,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:56:20,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:56:20,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:56:20,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa461275c8d3b7939b1e5 HTTP/1.1" 200 None 2026-03-12 04:56:20,897 - lava_callback - ERROR - Error processing callback for node 69afa461275c8d3b7939b1e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:57:00,928 - lava_callback - INFO - Received callback for node 69afa488275c8d3b7939b1ee INFO: 172.21.0.1:36652 - "POST /node/69afa488275c8d3b7939b1ee HTTP/1.0" 202 Accepted 2026-03-12 04:57:00,935 - lava_callback - INFO - Starting async job submit for node 69afa488275c8d3b7939b1ee 2026-03-12 04:57:00,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:00,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa488275c8d3b7939b1ee HTTP/1.1" 200 None 2026-03-12 04:57:00,953 - lava_callback - DEBUG - Processing node 69afa488275c8d3b7939b1ee: baseline-arm-baylibre 2026-03-12 04:57:00,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa488275c8d3b7939b1ee 2026-03-12 04:57:00,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:00,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa488275c8d3b7939b1ee HTTP/1.1" 200 None 2026-03-12 04:57:00,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:00,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:57:00,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:01,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa488275c8d3b7939b1ee HTTP/1.1" 200 None 2026-03-12 04:57:01,043 - lava_callback - ERROR - Error processing callback for node 69afa488275c8d3b7939b1ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:57:20,858 - lava_callback - INFO - Received callback for node 69afa4af275c8d3b7939b1fc INFO: 172.21.0.1:60168 - "POST /node/69afa4af275c8d3b7939b1fc HTTP/1.0" 202 Accepted 2026-03-12 04:57:20,864 - lava_callback - INFO - Starting async job submit for node 69afa4af275c8d3b7939b1fc 2026-03-12 04:57:20,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:20,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4af275c8d3b7939b1fc HTTP/1.1" 200 None 2026-03-12 04:57:20,881 - lava_callback - DEBUG - Processing node 69afa4af275c8d3b7939b1fc: baseline-arm-baylibre 2026-03-12 04:57:20,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa4af275c8d3b7939b1fc 2026-03-12 04:57:20,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:20,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4af275c8d3b7939b1fc HTTP/1.1" 200 None 2026-03-12 04:57:20,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:20,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:57:20,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:20,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa4af275c8d3b7939b1fc HTTP/1.1" 200 None 2026-03-12 04:57:20,941 - lava_callback - ERROR - Error processing callback for node 69afa4af275c8d3b7939b1fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:58:13,006 - lava_callback - INFO - Received callback for node 69afa4d7275c8d3b7939b211 INFO: 172.21.0.1:54526 - "POST /node/69afa4d7275c8d3b7939b211 HTTP/1.0" 202 Accepted 2026-03-12 04:58:13,011 - lava_callback - INFO - Starting async job submit for node 69afa4d7275c8d3b7939b211 2026-03-12 04:58:13,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:13,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4d7275c8d3b7939b211 HTTP/1.1" 200 None 2026-03-12 04:58:13,029 - lava_callback - DEBUG - Processing node 69afa4d7275c8d3b7939b211: baseline-arm-clabbe 2026-03-12 04:58:13,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa4d7275c8d3b7939b211 2026-03-12 04:58:13,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:13,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4d7275c8d3b7939b211 HTTP/1.1" 200 None 2026-03-12 04:58:13,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:13,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:58:13,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:13,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa4d7275c8d3b7939b211 HTTP/1.1" 200 None 2026-03-12 04:58:13,106 - lava_callback - ERROR - Error processing callback for node 69afa4d7275c8d3b7939b211: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:58:52,989 - lava_callback - INFO - Received callback for node 69afa4fe275c8d3b7939b219 INFO: 172.21.0.1:54148 - "POST /node/69afa4fe275c8d3b7939b219 HTTP/1.0" 202 Accepted 2026-03-12 04:58:52,995 - lava_callback - INFO - Starting async job submit for node 69afa4fe275c8d3b7939b219 2026-03-12 04:58:52,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:53,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4fe275c8d3b7939b219 HTTP/1.1" 200 None 2026-03-12 04:58:53,020 - lava_callback - DEBUG - Processing node 69afa4fe275c8d3b7939b219: baseline-arm-clabbe 2026-03-12 04:58:53,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa4fe275c8d3b7939b219 2026-03-12 04:58:53,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:53,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4fe275c8d3b7939b219 HTTP/1.1" 200 None 2026-03-12 04:58:53,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:53,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:58:53,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:53,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa4fe275c8d3b7939b219 HTTP/1.1" 200 None 2026-03-12 04:58:53,108 - lava_callback - ERROR - Error processing callback for node 69afa4fe275c8d3b7939b219: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:59:33,002 - lava_callback - INFO - Received callback for node 69afa524275c8d3b7939b225 INFO: 172.21.0.1:42722 - "POST /node/69afa524275c8d3b7939b225 HTTP/1.0" 202 Accepted 2026-03-12 04:59:33,007 - lava_callback - INFO - Starting async job submit for node 69afa524275c8d3b7939b225 2026-03-12 04:59:33,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:59:33,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa524275c8d3b7939b225 HTTP/1.1" 200 None 2026-03-12 04:59:33,025 - lava_callback - DEBUG - Processing node 69afa524275c8d3b7939b225: baseline-arm-clabbe 2026-03-12 04:59:33,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa524275c8d3b7939b225 2026-03-12 04:59:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:59:33,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa524275c8d3b7939b225 HTTP/1.1" 200 None 2026-03-12 04:59:33,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:59:33,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:59:33,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:59:33,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa524275c8d3b7939b225 HTTP/1.1" 200 None 2026-03-12 04:59:33,086 - lava_callback - ERROR - Error processing callback for node 69afa524275c8d3b7939b225: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:00:53,100 - lava_callback - INFO - Received callback for node 69afa571275c8d3b7939b23e INFO: 172.21.0.1:58720 - "POST /node/69afa571275c8d3b7939b23e HTTP/1.0" 202 Accepted 2026-03-12 05:00:53,106 - lava_callback - INFO - Starting async job submit for node 69afa571275c8d3b7939b23e 2026-03-12 05:00:53,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:00:53,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa571275c8d3b7939b23e HTTP/1.1" 200 None 2026-03-12 05:00:53,123 - lava_callback - DEBUG - Processing node 69afa571275c8d3b7939b23e: baseline-arm-clabbe 2026-03-12 05:00:53,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa571275c8d3b7939b23e 2026-03-12 05:00:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:00:53,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa571275c8d3b7939b23e HTTP/1.1" 200 None 2026-03-12 05:00:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:00:53,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 05:00:53,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:00:53,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa571275c8d3b7939b23e HTTP/1.1" 200 None 2026-03-12 05:00:53,182 - lava_callback - ERROR - Error processing callback for node 69afa571275c8d3b7939b23e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:02:13,140 - lava_callback - INFO - Received callback for node 69afa5c0275c8d3b7939b25b INFO: 172.21.0.1:60344 - "POST /node/69afa5c0275c8d3b7939b25b HTTP/1.0" 202 Accepted 2026-03-12 05:02:13,145 - lava_callback - INFO - Starting async job submit for node 69afa5c0275c8d3b7939b25b 2026-03-12 05:02:13,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:13,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa5c0275c8d3b7939b25b HTTP/1.1" 200 None 2026-03-12 05:02:13,190 - lava_callback - DEBUG - Processing node 69afa5c0275c8d3b7939b25b: baseline-arm-clabbe 2026-03-12 05:02:13,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa5c0275c8d3b7939b25b 2026-03-12 05:02:13,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:13,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa5c0275c8d3b7939b25b HTTP/1.1" 200 None 2026-03-12 05:02:13,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:13,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:02:13,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:13,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa5c0275c8d3b7939b25b HTTP/1.1" 200 None 2026-03-12 05:02:13,313 - lava_callback - ERROR - Error processing callback for node 69afa5c0275c8d3b7939b25b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:02:33,134 - lava_callback - INFO - Received callback for node 69afa5e6275c8d3b7939b267 INFO: 172.21.0.1:40948 - "POST /node/69afa5e6275c8d3b7939b267 HTTP/1.0" 202 Accepted 2026-03-12 05:02:33,140 - lava_callback - INFO - Starting async job submit for node 69afa5e6275c8d3b7939b267 2026-03-12 05:02:33,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:33,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa5e6275c8d3b7939b267 HTTP/1.1" 200 None 2026-03-12 05:02:33,158 - lava_callback - DEBUG - Processing node 69afa5e6275c8d3b7939b267: baseline-arm-clabbe 2026-03-12 05:02:33,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa5e6275c8d3b7939b267 2026-03-12 05:02:33,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:33,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa5e6275c8d3b7939b267 HTTP/1.1" 200 None 2026-03-12 05:02:33,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:33,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:02:33,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:33,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa5e6275c8d3b7939b267 HTTP/1.1" 200 None 2026-03-12 05:02:33,218 - lava_callback - ERROR - Error processing callback for node 69afa5e6275c8d3b7939b267: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:03:13,188 - lava_callback - INFO - Received callback for node 69afa60c275c8d3b7939b270 INFO: 172.21.0.1:38348 - "POST /node/69afa60c275c8d3b7939b270 HTTP/1.0" 202 Accepted 2026-03-12 05:03:13,193 - lava_callback - INFO - Starting async job submit for node 69afa60c275c8d3b7939b270 2026-03-12 05:03:13,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:13,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa60c275c8d3b7939b270 HTTP/1.1" 200 None 2026-03-12 05:03:13,212 - lava_callback - DEBUG - Processing node 69afa60c275c8d3b7939b270: baseline-arm-clabbe 2026-03-12 05:03:13,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa60c275c8d3b7939b270 2026-03-12 05:03:13,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:13,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa60c275c8d3b7939b270 HTTP/1.1" 200 None 2026-03-12 05:03:13,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:13,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:03:13,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa60c275c8d3b7939b270 HTTP/1.1" 200 None 2026-03-12 05:03:13,288 - lava_callback - ERROR - Error processing callback for node 69afa60c275c8d3b7939b270: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:03:53,182 - lava_callback - INFO - Received callback for node 69afa633275c8d3b7939b282 INFO: 172.21.0.1:38580 - "POST /node/69afa633275c8d3b7939b282 HTTP/1.0" 202 Accepted 2026-03-12 05:03:53,187 - lava_callback - INFO - Starting async job submit for node 69afa633275c8d3b7939b282 2026-03-12 05:03:53,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:53,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa633275c8d3b7939b282 HTTP/1.1" 200 None 2026-03-12 05:03:53,203 - lava_callback - DEBUG - Processing node 69afa633275c8d3b7939b282: baseline-arm-clabbe 2026-03-12 05:03:53,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa633275c8d3b7939b282 2026-03-12 05:03:53,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:53,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa633275c8d3b7939b282 HTTP/1.1" 200 None 2026-03-12 05:03:53,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:53,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:03:53,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:53,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa633275c8d3b7939b282 HTTP/1.1" 200 None 2026-03-12 05:03:53,261 - lava_callback - ERROR - Error processing callback for node 69afa633275c8d3b7939b282: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:04:33,236 - lava_callback - INFO - Received callback for node 69afa658275c8d3b7939b291 INFO: 172.21.0.1:60728 - "POST /node/69afa658275c8d3b7939b291 HTTP/1.0" 202 Accepted 2026-03-12 05:04:33,241 - lava_callback - INFO - Starting async job submit for node 69afa658275c8d3b7939b291 2026-03-12 05:04:33,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:04:33,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa658275c8d3b7939b291 HTTP/1.1" 200 None 2026-03-12 05:04:33,258 - lava_callback - DEBUG - Processing node 69afa658275c8d3b7939b291: baseline-arm-clabbe 2026-03-12 05:04:33,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa658275c8d3b7939b291 2026-03-12 05:04:33,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:04:33,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa658275c8d3b7939b291 HTTP/1.1" 200 None 2026-03-12 05:04:33,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:04:33,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:04:33,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:04:33,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa658275c8d3b7939b291 HTTP/1.1" 200 None 2026-03-12 05:04:33,315 - lava_callback - ERROR - Error processing callback for node 69afa658275c8d3b7939b291: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:06:33,319 - lava_callback - INFO - Received callback for node 69afa6cd275c8d3b7939b2aa INFO: 172.21.0.1:52250 - "POST /node/69afa6cd275c8d3b7939b2aa HTTP/1.0" 202 Accepted 2026-03-12 05:06:33,324 - lava_callback - INFO - Starting async job submit for node 69afa6cd275c8d3b7939b2aa 2026-03-12 05:06:33,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:06:33,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa6cd275c8d3b7939b2aa HTTP/1.1" 200 None 2026-03-12 05:06:33,342 - lava_callback - DEBUG - Processing node 69afa6cd275c8d3b7939b2aa: baseline-arm-clabbe 2026-03-12 05:06:33,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa6cd275c8d3b7939b2aa 2026-03-12 05:06:33,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:06:33,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa6cd275c8d3b7939b2aa HTTP/1.1" 200 None 2026-03-12 05:06:33,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:06:33,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 05:06:33,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:06:33,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa6cd275c8d3b7939b2aa HTTP/1.1" 200 None 2026-03-12 05:06:33,402 - lava_callback - ERROR - Error processing callback for node 69afa6cd275c8d3b7939b2aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:07:13,333 - lava_callback - INFO - Received callback for node 69afa6f3275c8d3b7939b2b9 INFO: 172.21.0.1:43658 - "POST /node/69afa6f3275c8d3b7939b2b9 HTTP/1.0" 202 Accepted 2026-03-12 05:07:13,339 - lava_callback - INFO - Starting async job submit for node 69afa6f3275c8d3b7939b2b9 2026-03-12 05:07:13,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:13,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa6f3275c8d3b7939b2b9 HTTP/1.1" 200 None 2026-03-12 05:07:13,359 - lava_callback - DEBUG - Processing node 69afa6f3275c8d3b7939b2b9: baseline-arm-clabbe 2026-03-12 05:07:13,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa6f3275c8d3b7939b2b9 2026-03-12 05:07:13,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:13,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa6f3275c8d3b7939b2b9 HTTP/1.1" 200 None 2026-03-12 05:07:13,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:13,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 05:07:13,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:13,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa6f3275c8d3b7939b2b9 HTTP/1.1" 200 None 2026-03-12 05:07:13,423 - lava_callback - ERROR - Error processing callback for node 69afa6f3275c8d3b7939b2b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:07:53,394 - lava_callback - INFO - Received callback for node 69afa719275c8d3b7939b2c0 INFO: 172.21.0.1:47200 - "POST /node/69afa719275c8d3b7939b2c0 HTTP/1.0" 202 Accepted 2026-03-12 05:07:53,400 - lava_callback - INFO - Starting async job submit for node 69afa719275c8d3b7939b2c0 2026-03-12 05:07:53,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:53,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa719275c8d3b7939b2c0 HTTP/1.1" 200 None 2026-03-12 05:07:53,428 - lava_callback - DEBUG - Processing node 69afa719275c8d3b7939b2c0: baseline-arm-clabbe 2026-03-12 05:07:53,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa719275c8d3b7939b2c0 2026-03-12 05:07:53,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:53,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa719275c8d3b7939b2c0 HTTP/1.1" 200 None 2026-03-12 05:07:53,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:53,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 05:07:53,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:53,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa719275c8d3b7939b2c0 HTTP/1.1" 200 None 2026-03-12 05:07:53,492 - lava_callback - ERROR - Error processing callback for node 69afa719275c8d3b7939b2c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:13:01,830 - lava_callback - INFO - Received callback for node 69afa85a275c8d3b7939b2e1 INFO: 172.21.0.1:59260 - "POST /node/69afa85a275c8d3b7939b2e1 HTTP/1.0" 202 Accepted 2026-03-12 05:13:01,836 - lava_callback - INFO - Starting async job submit for node 69afa85a275c8d3b7939b2e1 2026-03-12 05:13:01,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:13:01,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa85a275c8d3b7939b2e1 HTTP/1.1" 200 None 2026-03-12 05:13:01,857 - lava_callback - DEBUG - Processing node 69afa85a275c8d3b7939b2e1: baseline-arm64-baylibre 2026-03-12 05:13:01,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa85a275c8d3b7939b2e1 2026-03-12 05:13:01,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:13:01,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa85a275c8d3b7939b2e1 HTTP/1.1" 200 None 2026-03-12 05:13:01,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:13:01,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:13:01,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:13:01,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa85a275c8d3b7939b2e1 HTTP/1.1" 200 None 2026-03-12 05:13:01,909 - lava_callback - ERROR - Error processing callback for node 69afa85a275c8d3b7939b2e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:14:21,787 - lava_callback - INFO - Received callback for node 69afa8a9275c8d3b7939b2e9 INFO: 172.21.0.1:40954 - "POST /node/69afa8a9275c8d3b7939b2e9 HTTP/1.0" 202 Accepted 2026-03-12 05:14:21,793 - lava_callback - INFO - Starting async job submit for node 69afa8a9275c8d3b7939b2e9 2026-03-12 05:14:21,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:14:21,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa8a9275c8d3b7939b2e9 HTTP/1.1" 200 None 2026-03-12 05:14:21,809 - lava_callback - DEBUG - Processing node 69afa8a9275c8d3b7939b2e9: baseline-arm64-baylibre 2026-03-12 05:14:21,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa8a9275c8d3b7939b2e9 2026-03-12 05:14:21,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:14:21,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa8a9275c8d3b7939b2e9 HTTP/1.1" 200 None 2026-03-12 05:14:21,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:14:21,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:14:21,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:14:21,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa8a9275c8d3b7939b2e9 HTTP/1.1" 200 None 2026-03-12 05:14:21,870 - lava_callback - ERROR - Error processing callback for node 69afa8a9275c8d3b7939b2e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:15:41,852 - lava_callback - INFO - Received callback for node 69afa8f8275c8d3b7939b2f7 INFO: 172.21.0.1:44908 - "POST /node/69afa8f8275c8d3b7939b2f7 HTTP/1.0" 202 Accepted 2026-03-12 05:15:41,857 - lava_callback - INFO - Starting async job submit for node 69afa8f8275c8d3b7939b2f7 2026-03-12 05:15:41,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:15:41,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa8f8275c8d3b7939b2f7 HTTP/1.1" 200 None 2026-03-12 05:15:41,881 - lava_callback - DEBUG - Processing node 69afa8f8275c8d3b7939b2f7: baseline-arm64-baylibre 2026-03-12 05:15:41,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa8f8275c8d3b7939b2f7 2026-03-12 05:15:41,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:15:41,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa8f8275c8d3b7939b2f7 HTTP/1.1" 200 None 2026-03-12 05:15:41,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:15:41,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:15:41,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:15:41,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa8f8275c8d3b7939b2f7 HTTP/1.1" 200 None 2026-03-12 05:15:41,959 - lava_callback - ERROR - Error processing callback for node 69afa8f8275c8d3b7939b2f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:17:01,927 - lava_callback - INFO - Received callback for node 69afa945275c8d3b7939b307 INFO: 172.21.0.1:56872 - "POST /node/69afa945275c8d3b7939b307 HTTP/1.0" 202 Accepted 2026-03-12 05:17:01,932 - lava_callback - INFO - Starting async job submit for node 69afa945275c8d3b7939b307 2026-03-12 05:17:01,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:17:01,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa945275c8d3b7939b307 HTTP/1.1" 200 None 2026-03-12 05:17:01,949 - lava_callback - DEBUG - Processing node 69afa945275c8d3b7939b307: baseline-arm64-baylibre 2026-03-12 05:17:01,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa945275c8d3b7939b307 2026-03-12 05:17:01,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:17:01,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa945275c8d3b7939b307 HTTP/1.1" 200 None 2026-03-12 05:17:01,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:17:01,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:17:01,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:17:02,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa945275c8d3b7939b307 HTTP/1.1" 200 None 2026-03-12 05:17:02,008 - lava_callback - ERROR - Error processing callback for node 69afa945275c8d3b7939b307: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:19:02,373 - lava_callback - INFO - Received callback for node 69afa9b8275c8d3b7939b322 INFO: 172.21.0.1:56070 - "POST /node/69afa9b8275c8d3b7939b322 HTTP/1.0" 202 Accepted 2026-03-12 05:19:02,379 - lava_callback - INFO - Starting async job submit for node 69afa9b8275c8d3b7939b322 2026-03-12 05:19:02,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:19:02,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa9b8275c8d3b7939b322 HTTP/1.1" 200 None 2026-03-12 05:19:02,418 - lava_callback - DEBUG - Processing node 69afa9b8275c8d3b7939b322: baseline-arm64-baylibre 2026-03-12 05:19:02,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa9b8275c8d3b7939b322 2026-03-12 05:19:02,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:19:02,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa9b8275c8d3b7939b322 HTTP/1.1" 200 None 2026-03-12 05:19:02,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:19:02,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:19:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:19:02,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa9b8275c8d3b7939b322 HTTP/1.1" 200 None 2026-03-12 05:19:02,506 - lava_callback - ERROR - Error processing callback for node 69afa9b8275c8d3b7939b322: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:20:33,955 - lava_callback - INFO - Received callback for node 69afaa0e275c8d3b7939b330 INFO: 172.21.0.1:41424 - "POST /node/69afaa0e275c8d3b7939b330 HTTP/1.0" 202 Accepted 2026-03-12 05:20:33,961 - lava_callback - INFO - Starting async job submit for node 69afaa0e275c8d3b7939b330 2026-03-12 05:20:33,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:20:33,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaa0e275c8d3b7939b330 HTTP/1.1" 200 None 2026-03-12 05:20:33,977 - lava_callback - DEBUG - Processing node 69afaa0e275c8d3b7939b330: baseline-arm64-clabbe 2026-03-12 05:20:33,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaa0e275c8d3b7939b330 2026-03-12 05:20:33,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:20:33,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaa0e275c8d3b7939b330 HTTP/1.1" 200 None 2026-03-12 05:20:33,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:20:34,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:20:34,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:20:34,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaa0e275c8d3b7939b330 HTTP/1.1" 200 None 2026-03-12 05:20:34,040 - lava_callback - ERROR - Error processing callback for node 69afaa0e275c8d3b7939b330: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:21:54,042 - lava_callback - INFO - Received callback for node 69afaa5e275c8d3b7939b33b INFO: 172.21.0.1:35694 - "POST /node/69afaa5e275c8d3b7939b33b HTTP/1.0" 202 Accepted 2026-03-12 05:21:54,047 - lava_callback - INFO - Starting async job submit for node 69afaa5e275c8d3b7939b33b 2026-03-12 05:21:54,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:21:54,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaa5e275c8d3b7939b33b HTTP/1.1" 200 None 2026-03-12 05:21:54,069 - lava_callback - DEBUG - Processing node 69afaa5e275c8d3b7939b33b: baseline-arm64-clabbe 2026-03-12 05:21:54,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaa5e275c8d3b7939b33b 2026-03-12 05:21:54,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:21:54,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaa5e275c8d3b7939b33b HTTP/1.1" 200 None 2026-03-12 05:21:54,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:21:54,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:21:54,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:21:54,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaa5e275c8d3b7939b33b HTTP/1.1" 200 None 2026-03-12 05:21:54,121 - lava_callback - ERROR - Error processing callback for node 69afaa5e275c8d3b7939b33b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:23:02,259 - lava_callback - INFO - Received callback for node 69afaaa7275c8d3b7939b345 INFO: 172.21.0.1:39470 - "POST /node/69afaaa7275c8d3b7939b345 HTTP/1.0" 202 Accepted 2026-03-12 05:23:02,264 - lava_callback - INFO - Starting async job submit for node 69afaaa7275c8d3b7939b345 2026-03-12 05:23:02,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:23:02,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaaa7275c8d3b7939b345 HTTP/1.1" 200 None 2026-03-12 05:23:02,287 - lava_callback - DEBUG - Processing node 69afaaa7275c8d3b7939b345: baseline-arm64-baylibre 2026-03-12 05:23:02,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaaa7275c8d3b7939b345 2026-03-12 05:23:02,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:23:02,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaaa7275c8d3b7939b345 HTTP/1.1" 200 None 2026-03-12 05:23:02,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:23:02,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:23:02,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:23:02,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaaa7275c8d3b7939b345 HTTP/1.1" 200 None 2026-03-12 05:23:02,342 - lava_callback - ERROR - Error processing callback for node 69afaaa7275c8d3b7939b345: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:24:22,322 - lava_callback - INFO - Received callback for node 69afaaf7275c8d3b7939b354 INFO: 172.21.0.1:52590 - "POST /node/69afaaf7275c8d3b7939b354 HTTP/1.0" 202 Accepted 2026-03-12 05:24:22,328 - lava_callback - INFO - Starting async job submit for node 69afaaf7275c8d3b7939b354 2026-03-12 05:24:22,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:24:22,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaaf7275c8d3b7939b354 HTTP/1.1" 200 None 2026-03-12 05:24:22,357 - lava_callback - DEBUG - Processing node 69afaaf7275c8d3b7939b354: baseline-arm64-baylibre 2026-03-12 05:24:22,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaaf7275c8d3b7939b354 2026-03-12 05:24:22,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:24:22,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaaf7275c8d3b7939b354 HTTP/1.1" 200 None 2026-03-12 05:24:22,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:24:22,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:24:22,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:24:22,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaaf7275c8d3b7939b354 HTTP/1.1" 200 None 2026-03-12 05:24:22,440 - lava_callback - ERROR - Error processing callback for node 69afaaf7275c8d3b7939b354: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:25:54,259 - lava_callback - INFO - Received callback for node 69afab4d275c8d3b7939b360 INFO: 172.21.0.1:51168 - "POST /node/69afab4d275c8d3b7939b360 HTTP/1.0" 202 Accepted 2026-03-12 05:25:54,265 - lava_callback - INFO - Starting async job submit for node 69afab4d275c8d3b7939b360 2026-03-12 05:25:54,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:25:54,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afab4d275c8d3b7939b360 HTTP/1.1" 200 None 2026-03-12 05:25:54,283 - lava_callback - DEBUG - Processing node 69afab4d275c8d3b7939b360: baseline-arm64-clabbe 2026-03-12 05:25:54,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afab4d275c8d3b7939b360 2026-03-12 05:25:54,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:25:54,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afab4d275c8d3b7939b360 HTTP/1.1" 200 None 2026-03-12 05:25:54,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:25:54,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:25:54,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:25:54,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afab4d275c8d3b7939b360 HTTP/1.1" 200 None 2026-03-12 05:25:54,348 - lava_callback - ERROR - Error processing callback for node 69afab4d275c8d3b7939b360: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:28:14,248 - lava_callback - INFO - Received callback for node 69afabdd275c8d3b7939b376 INFO: 172.21.0.1:35636 - "POST /node/69afabdd275c8d3b7939b376 HTTP/1.0" 202 Accepted 2026-03-12 05:28:14,254 - lava_callback - INFO - Starting async job submit for node 69afabdd275c8d3b7939b376 2026-03-12 05:28:14,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:28:14,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afabdd275c8d3b7939b376 HTTP/1.1" 200 None 2026-03-12 05:28:14,270 - lava_callback - DEBUG - Processing node 69afabdd275c8d3b7939b376: baseline-arm64-clabbe 2026-03-12 05:28:14,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afabdd275c8d3b7939b376 2026-03-12 05:28:14,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:28:14,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afabdd275c8d3b7939b376 HTTP/1.1" 200 None 2026-03-12 05:28:14,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:28:14,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:28:14,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:28:14,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afabdd275c8d3b7939b376 HTTP/1.1" 200 None 2026-03-12 05:28:14,335 - lava_callback - ERROR - Error processing callback for node 69afabdd275c8d3b7939b376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:29:22,623 - lava_callback - INFO - Received callback for node 69afac26275c8d3b7939b37e INFO: 172.21.0.1:33174 - "POST /node/69afac26275c8d3b7939b37e HTTP/1.0" 202 Accepted 2026-03-12 05:29:22,629 - lava_callback - INFO - Starting async job submit for node 69afac26275c8d3b7939b37e 2026-03-12 05:29:22,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:29:22,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afac26275c8d3b7939b37e HTTP/1.1" 200 None 2026-03-12 05:29:22,645 - lava_callback - DEBUG - Processing node 69afac26275c8d3b7939b37e: baseline-arm64-baylibre 2026-03-12 05:29:22,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afac26275c8d3b7939b37e 2026-03-12 05:29:22,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:29:22,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afac26275c8d3b7939b37e HTTP/1.1" 200 None 2026-03-12 05:29:22,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:29:22,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:29:22,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:29:22,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afac26275c8d3b7939b37e HTTP/1.1" 200 None 2026-03-12 05:29:22,738 - lava_callback - ERROR - Error processing callback for node 69afac26275c8d3b7939b37e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:30:54,382 - lava_callback - INFO - Received callback for node 69afac7b275c8d3b7939b38e INFO: 172.21.0.1:42994 - "POST /node/69afac7b275c8d3b7939b38e HTTP/1.0" 202 Accepted 2026-03-12 05:30:54,388 - lava_callback - INFO - Starting async job submit for node 69afac7b275c8d3b7939b38e 2026-03-12 05:30:54,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:30:54,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afac7b275c8d3b7939b38e HTTP/1.1" 200 None 2026-03-12 05:30:54,405 - lava_callback - DEBUG - Processing node 69afac7b275c8d3b7939b38e: baseline-arm64-clabbe 2026-03-12 05:30:54,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afac7b275c8d3b7939b38e 2026-03-12 05:30:54,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:30:54,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afac7b275c8d3b7939b38e HTTP/1.1" 200 None 2026-03-12 05:30:54,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:30:54,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:30:54,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:30:54,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afac7b275c8d3b7939b38e HTTP/1.1" 200 None 2026-03-12 05:30:54,475 - lava_callback - ERROR - Error processing callback for node 69afac7b275c8d3b7939b38e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:32:14,430 - lava_callback - INFO - Received callback for node 69afaccb275c8d3b7939b39a INFO: 172.21.0.1:54140 - "POST /node/69afaccb275c8d3b7939b39a HTTP/1.0" 202 Accepted 2026-03-12 05:32:14,435 - lava_callback - INFO - Starting async job submit for node 69afaccb275c8d3b7939b39a 2026-03-12 05:32:14,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:32:14,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaccb275c8d3b7939b39a HTTP/1.1" 200 None 2026-03-12 05:32:14,463 - lava_callback - DEBUG - Processing node 69afaccb275c8d3b7939b39a: baseline-arm64-clabbe 2026-03-12 05:32:14,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaccb275c8d3b7939b39a 2026-03-12 05:32:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:32:14,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaccb275c8d3b7939b39a HTTP/1.1" 200 None 2026-03-12 05:32:14,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:32:14,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:32:14,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:32:14,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaccb275c8d3b7939b39a HTTP/1.1" 200 None 2026-03-12 05:32:14,522 - lava_callback - ERROR - Error processing callback for node 69afaccb275c8d3b7939b39a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:35:42,898 - lava_callback - INFO - Received callback for node 69afadac275c8d3b7939b3b5 INFO: 172.21.0.1:40012 - "POST /node/69afadac275c8d3b7939b3b5 HTTP/1.0" 202 Accepted 2026-03-12 05:35:42,904 - lava_callback - INFO - Starting async job submit for node 69afadac275c8d3b7939b3b5 2026-03-12 05:35:42,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:35:42,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afadac275c8d3b7939b3b5 HTTP/1.1" 200 None 2026-03-12 05:35:42,923 - lava_callback - DEBUG - Processing node 69afadac275c8d3b7939b3b5: baseline-arm64-baylibre 2026-03-12 05:35:42,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afadac275c8d3b7939b3b5 2026-03-12 05:35:42,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:35:42,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afadac275c8d3b7939b3b5 HTTP/1.1" 200 None 2026-03-12 05:35:42,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:35:42,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:35:42,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:35:42,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afadac275c8d3b7939b3b5 HTTP/1.1" 200 None 2026-03-12 05:35:42,985 - lava_callback - ERROR - Error processing callback for node 69afadac275c8d3b7939b3b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:37:02,952 - lava_callback - INFO - Received callback for node 69afadfb275c8d3b7939b3c6 INFO: 172.21.0.1:49770 - "POST /node/69afadfb275c8d3b7939b3c6 HTTP/1.0" 202 Accepted 2026-03-12 05:37:02,958 - lava_callback - INFO - Starting async job submit for node 69afadfb275c8d3b7939b3c6 2026-03-12 05:37:02,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:37:02,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afadfb275c8d3b7939b3c6 HTTP/1.1" 200 None 2026-03-12 05:37:02,978 - lava_callback - DEBUG - Processing node 69afadfb275c8d3b7939b3c6: baseline-arm64-baylibre 2026-03-12 05:37:02,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afadfb275c8d3b7939b3c6 2026-03-12 05:37:02,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:37:03,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afadfb275c8d3b7939b3c6 HTTP/1.1" 200 None 2026-03-12 05:37:03,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:37:03,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:37:03,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:37:03,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afadfb275c8d3b7939b3c6 HTTP/1.1" 200 None 2026-03-12 05:37:03,043 - lava_callback - ERROR - Error processing callback for node 69afadfb275c8d3b7939b3c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:38:23,065 - lava_callback - INFO - Received callback for node 69afae4a275c8d3b7939b3d1 INFO: 172.21.0.1:53978 - "POST /node/69afae4a275c8d3b7939b3d1 HTTP/1.0" 202 Accepted 2026-03-12 05:38:23,071 - lava_callback - INFO - Starting async job submit for node 69afae4a275c8d3b7939b3d1 2026-03-12 05:38:23,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:38:23,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afae4a275c8d3b7939b3d1 HTTP/1.1" 200 None 2026-03-12 05:38:23,090 - lava_callback - DEBUG - Processing node 69afae4a275c8d3b7939b3d1: baseline-arm64-baylibre 2026-03-12 05:38:23,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afae4a275c8d3b7939b3d1 2026-03-12 05:38:23,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:38:23,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afae4a275c8d3b7939b3d1 HTTP/1.1" 200 None 2026-03-12 05:38:23,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:38:23,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:38:23,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:38:23,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afae4a275c8d3b7939b3d1 HTTP/1.1" 200 None 2026-03-12 05:38:23,158 - lava_callback - ERROR - Error processing callback for node 69afae4a275c8d3b7939b3d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:39:43,136 - lava_callback - INFO - Received callback for node 69afae9a275c8d3b7939b3dd INFO: 172.21.0.1:45500 - "POST /node/69afae9a275c8d3b7939b3dd HTTP/1.0" 202 Accepted 2026-03-12 05:39:43,142 - lava_callback - INFO - Starting async job submit for node 69afae9a275c8d3b7939b3dd 2026-03-12 05:39:43,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:39:43,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afae9a275c8d3b7939b3dd HTTP/1.1" 200 None 2026-03-12 05:39:43,158 - lava_callback - DEBUG - Processing node 69afae9a275c8d3b7939b3dd: baseline-arm64-baylibre 2026-03-12 05:39:43,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afae9a275c8d3b7939b3dd 2026-03-12 05:39:43,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:39:43,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afae9a275c8d3b7939b3dd HTTP/1.1" 200 None 2026-03-12 05:39:43,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:39:43,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:39:43,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:39:43,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afae9a275c8d3b7939b3dd HTTP/1.1" 200 None 2026-03-12 05:39:43,211 - lava_callback - ERROR - Error processing callback for node 69afae9a275c8d3b7939b3dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33898 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:41:43,184 - lava_callback - INFO - Received callback for node 69afaf0e275c8d3b7939b3f5 INFO: 172.21.0.1:43848 - "POST /node/69afaf0e275c8d3b7939b3f5 HTTP/1.0" 202 Accepted 2026-03-12 05:41:43,189 - lava_callback - INFO - Starting async job submit for node 69afaf0e275c8d3b7939b3f5 2026-03-12 05:41:43,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:41:43,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaf0e275c8d3b7939b3f5 HTTP/1.1" 200 None 2026-03-12 05:41:43,212 - lava_callback - DEBUG - Processing node 69afaf0e275c8d3b7939b3f5: baseline-arm64-baylibre 2026-03-12 05:41:43,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaf0e275c8d3b7939b3f5 2026-03-12 05:41:43,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:41:43,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaf0e275c8d3b7939b3f5 HTTP/1.1" 200 None 2026-03-12 05:41:43,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:41:43,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:41:43,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:41:43,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaf0e275c8d3b7939b3f5 HTTP/1.1" 200 None 2026-03-12 05:41:43,287 - lava_callback - ERROR - Error processing callback for node 69afaf0e275c8d3b7939b3f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:43:03,299 - lava_callback - INFO - Received callback for node 69afaf5e275c8d3b7939b3fd INFO: 172.21.0.1:51996 - "POST /node/69afaf5e275c8d3b7939b3fd HTTP/1.0" 202 Accepted 2026-03-12 05:43:03,304 - lava_callback - INFO - Starting async job submit for node 69afaf5e275c8d3b7939b3fd 2026-03-12 05:43:03,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:43:03,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaf5e275c8d3b7939b3fd HTTP/1.1" 200 None 2026-03-12 05:43:03,325 - lava_callback - DEBUG - Processing node 69afaf5e275c8d3b7939b3fd: baseline-arm64-baylibre 2026-03-12 05:43:03,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaf5e275c8d3b7939b3fd 2026-03-12 05:43:03,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:43:03,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaf5e275c8d3b7939b3fd HTTP/1.1" 200 None 2026-03-12 05:43:03,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:43:03,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:43:03,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:43:03,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaf5e275c8d3b7939b3fd HTTP/1.1" 200 None 2026-03-12 05:43:03,377 - lava_callback - ERROR - Error processing callback for node 69afaf5e275c8d3b7939b3fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:45:54,959 - lava_callback - INFO - Received callback for node 69afafff275c8d3b7939b417 INFO: 172.21.0.1:57220 - "POST /node/69afafff275c8d3b7939b417 HTTP/1.0" 202 Accepted 2026-03-12 05:45:54,965 - lava_callback - INFO - Starting async job submit for node 69afafff275c8d3b7939b417 2026-03-12 05:45:54,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:45:54,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afafff275c8d3b7939b417 HTTP/1.1" 200 None 2026-03-12 05:45:54,980 - lava_callback - DEBUG - Processing node 69afafff275c8d3b7939b417: baseline-arm64-clabbe 2026-03-12 05:45:54,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afafff275c8d3b7939b417 2026-03-12 05:45:54,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:45:54,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afafff275c8d3b7939b417 HTTP/1.1" 200 None 2026-03-12 05:45:54,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:45:55,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:45:55,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:45:55,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afafff275c8d3b7939b417 HTTP/1.1" 200 None 2026-03-12 05:45:55,038 - lava_callback - ERROR - Error processing callback for node 69afafff275c8d3b7939b417: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:47:15,017 - lava_callback - INFO - Received callback for node 69afb04f275c8d3b7939b41f INFO: 172.21.0.1:44930 - "POST /node/69afb04f275c8d3b7939b41f HTTP/1.0" 202 Accepted 2026-03-12 05:47:15,023 - lava_callback - INFO - Starting async job submit for node 69afb04f275c8d3b7939b41f 2026-03-12 05:47:15,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:47:15,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb04f275c8d3b7939b41f HTTP/1.1" 200 None 2026-03-12 05:47:15,048 - lava_callback - DEBUG - Processing node 69afb04f275c8d3b7939b41f: baseline-arm64-clabbe 2026-03-12 05:47:15,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb04f275c8d3b7939b41f 2026-03-12 05:47:15,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:47:15,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb04f275c8d3b7939b41f HTTP/1.1" 200 None 2026-03-12 05:47:15,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:47:15,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:47:15,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:47:15,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb04f275c8d3b7939b41f HTTP/1.1" 200 None 2026-03-12 05:47:15,112 - lava_callback - ERROR - Error processing callback for node 69afb04f275c8d3b7939b41f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:48:35,076 - lava_callback - INFO - Received callback for node 69afb09d275c8d3b7939b42c INFO: 172.21.0.1:37988 - "POST /node/69afb09d275c8d3b7939b42c HTTP/1.0" 202 Accepted 2026-03-12 05:48:35,082 - lava_callback - INFO - Starting async job submit for node 69afb09d275c8d3b7939b42c 2026-03-12 05:48:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:48:35,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb09d275c8d3b7939b42c HTTP/1.1" 200 None 2026-03-12 05:48:35,119 - lava_callback - DEBUG - Processing node 69afb09d275c8d3b7939b42c: baseline-arm64-clabbe 2026-03-12 05:48:35,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb09d275c8d3b7939b42c 2026-03-12 05:48:35,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:48:35,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb09d275c8d3b7939b42c HTTP/1.1" 200 None 2026-03-12 05:48:35,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:48:35,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:48:35,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:48:35,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb09d275c8d3b7939b42c HTTP/1.1" 200 None 2026-03-12 05:48:35,192 - lava_callback - ERROR - Error processing callback for node 69afb09d275c8d3b7939b42c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:49:55,158 - lava_callback - INFO - Received callback for node 69afb0f0275c8d3b7939b438 INFO: 172.21.0.1:39762 - "POST /node/69afb0f0275c8d3b7939b438 HTTP/1.0" 202 Accepted 2026-03-12 05:49:55,163 - lava_callback - INFO - Starting async job submit for node 69afb0f0275c8d3b7939b438 2026-03-12 05:49:55,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:49:55,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb0f0275c8d3b7939b438 HTTP/1.1" 200 None 2026-03-12 05:49:55,181 - lava_callback - DEBUG - Processing node 69afb0f0275c8d3b7939b438: baseline-arm64-clabbe 2026-03-12 05:49:55,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb0f0275c8d3b7939b438 2026-03-12 05:49:55,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:49:55,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb0f0275c8d3b7939b438 HTTP/1.1" 200 None 2026-03-12 05:49:55,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:49:55,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:49:55,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:49:55,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb0f0275c8d3b7939b438 HTTP/1.1" 200 None 2026-03-12 05:49:55,241 - lava_callback - ERROR - Error processing callback for node 69afb0f0275c8d3b7939b438: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 05:51:15,203 - lava_callback - INFO - Received callback for node 69afb140275c8d3b7939b442 INFO: 172.21.0.1:51226 - "POST /node/69afb140275c8d3b7939b442 HTTP/1.0" 202 Accepted 2026-03-12 05:51:15,208 - lava_callback - INFO - Starting async job submit for node 69afb140275c8d3b7939b442 2026-03-12 05:51:15,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:51:15,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb140275c8d3b7939b442 HTTP/1.1" 200 None 2026-03-12 05:51:15,224 - lava_callback - DEBUG - Processing node 69afb140275c8d3b7939b442: baseline-arm64-clabbe 2026-03-12 05:51:15,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb140275c8d3b7939b442 2026-03-12 05:51:15,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:51:15,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb140275c8d3b7939b442 HTTP/1.1" 200 None 2026-03-12 05:51:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:51:15,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:51:15,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:51:15,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb140275c8d3b7939b442 HTTP/1.1" 200 None 2026-03-12 05:51:15,283 - lava_callback - ERROR - Error processing callback for node 69afb140275c8d3b7939b442: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34664 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:52:35,281 - lava_callback - INFO - Received callback for node 69afb18e275c8d3b7939b44a INFO: 172.21.0.1:40790 - "POST /node/69afb18e275c8d3b7939b44a HTTP/1.0" 202 Accepted 2026-03-12 05:52:35,288 - lava_callback - INFO - Starting async job submit for node 69afb18e275c8d3b7939b44a 2026-03-12 05:52:35,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:52:35,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb18e275c8d3b7939b44a HTTP/1.1" 200 None 2026-03-12 05:52:35,304 - lava_callback - DEBUG - Processing node 69afb18e275c8d3b7939b44a: baseline-arm64-clabbe 2026-03-12 05:52:35,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb18e275c8d3b7939b44a 2026-03-12 05:52:35,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:52:35,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb18e275c8d3b7939b44a HTTP/1.1" 200 None 2026-03-12 05:52:35,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:52:35,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:52:35,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:52:35,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb18e275c8d3b7939b44a HTTP/1.1" 200 None 2026-03-12 05:52:35,356 - lava_callback - ERROR - Error processing callback for node 69afb18e275c8d3b7939b44a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:38:26,584 - lava_callback - INFO - Received callback for node 69afbc4f275c8d3b7939b4e3 INFO: 172.21.0.1:45958 - "POST /node/69afbc4f275c8d3b7939b4e3 HTTP/1.0" 202 Accepted 2026-03-12 06:38:26,590 - lava_callback - INFO - Starting async job submit for node 69afbc4f275c8d3b7939b4e3 2026-03-12 06:38:26,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:26,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc4f275c8d3b7939b4e3 HTTP/1.1" 200 None 2026-03-12 06:38:26,606 - lava_callback - DEBUG - Processing node 69afbc4f275c8d3b7939b4e3: baseline-arm-baylibre 2026-03-12 06:38:26,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbc4f275c8d3b7939b4e3 2026-03-12 06:38:26,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:26,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc4f275c8d3b7939b4e3 HTTP/1.1" 200 None 2026-03-12 06:38:26,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:26,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:38:26,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:26,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbc4f275c8d3b7939b4e3 HTTP/1.1" 200 None 2026-03-12 06:38:26,671 - lava_callback - ERROR - Error processing callback for node 69afbc4f275c8d3b7939b4e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:38:46,278 - lava_callback - INFO - Received callback for node 69afbc74275c8d3b7939b4f2 INFO: 172.21.0.1:60304 - "POST /node/69afbc74275c8d3b7939b4f2 HTTP/1.0" 202 Accepted 2026-03-12 06:38:46,284 - lava_callback - INFO - Starting async job submit for node 69afbc74275c8d3b7939b4f2 2026-03-12 06:38:46,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:46,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc74275c8d3b7939b4f2 HTTP/1.1" 200 None 2026-03-12 06:38:46,300 - lava_callback - DEBUG - Processing node 69afbc74275c8d3b7939b4f2: baseline-arm-baylibre 2026-03-12 06:38:46,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbc74275c8d3b7939b4f2 2026-03-12 06:38:46,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:46,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc74275c8d3b7939b4f2 HTTP/1.1" 200 None 2026-03-12 06:38:46,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:46,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:38:46,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:46,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbc74275c8d3b7939b4f2 HTTP/1.1" 200 None 2026-03-12 06:38:46,359 - lava_callback - ERROR - Error processing callback for node 69afbc74275c8d3b7939b4f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:39:26,304 - lava_callback - INFO - Received callback for node 69afbc98275c8d3b7939b4fb INFO: 172.21.0.1:47868 - "POST /node/69afbc98275c8d3b7939b4fb HTTP/1.0" 202 Accepted 2026-03-12 06:39:26,310 - lava_callback - INFO - Starting async job submit for node 69afbc98275c8d3b7939b4fb 2026-03-12 06:39:26,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:39:26,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc98275c8d3b7939b4fb HTTP/1.1" 200 None 2026-03-12 06:39:26,325 - lava_callback - DEBUG - Processing node 69afbc98275c8d3b7939b4fb: baseline-arm-baylibre 2026-03-12 06:39:26,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbc98275c8d3b7939b4fb 2026-03-12 06:39:26,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:39:26,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc98275c8d3b7939b4fb HTTP/1.1" 200 None 2026-03-12 06:39:26,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:39:26,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:39:26,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:39:26,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbc98275c8d3b7939b4fb HTTP/1.1" 200 None 2026-03-12 06:39:26,386 - lava_callback - ERROR - Error processing callback for node 69afbc98275c8d3b7939b4fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:40:06,424 - lava_callback - INFO - Received callback for node 69afbcbd275c8d3b7939b508 INFO: 172.21.0.1:38604 - "POST /node/69afbcbd275c8d3b7939b508 HTTP/1.0" 202 Accepted 2026-03-12 06:40:06,429 - lava_callback - INFO - Starting async job submit for node 69afbcbd275c8d3b7939b508 2026-03-12 06:40:06,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:06,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbcbd275c8d3b7939b508 HTTP/1.1" 200 None 2026-03-12 06:40:06,445 - lava_callback - DEBUG - Processing node 69afbcbd275c8d3b7939b508: baseline-arm-baylibre 2026-03-12 06:40:06,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbcbd275c8d3b7939b508 2026-03-12 06:40:06,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:06,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbcbd275c8d3b7939b508 HTTP/1.1" 200 None 2026-03-12 06:40:06,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:06,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:40:06,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:06,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbcbd275c8d3b7939b508 HTTP/1.1" 200 None 2026-03-12 06:40:06,497 - lava_callback - ERROR - Error processing callback for node 69afbcbd275c8d3b7939b508: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:40:46,405 - lava_callback - INFO - Received callback for node 69afbce2275c8d3b7939b511 INFO: 172.21.0.1:48268 - "POST /node/69afbce2275c8d3b7939b511 HTTP/1.0" 202 Accepted 2026-03-12 06:40:46,410 - lava_callback - INFO - Starting async job submit for node 69afbce2275c8d3b7939b511 2026-03-12 06:40:46,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:46,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbce2275c8d3b7939b511 HTTP/1.1" 200 None 2026-03-12 06:40:46,425 - lava_callback - DEBUG - Processing node 69afbce2275c8d3b7939b511: baseline-arm-baylibre 2026-03-12 06:40:46,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbce2275c8d3b7939b511 2026-03-12 06:40:46,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:46,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbce2275c8d3b7939b511 HTTP/1.1" 200 None 2026-03-12 06:40:46,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:46,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:40:46,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:46,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbce2275c8d3b7939b511 HTTP/1.1" 200 None 2026-03-12 06:40:46,499 - lava_callback - ERROR - Error processing callback for node 69afbce2275c8d3b7939b511: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:41:26,431 - lava_callback - INFO - Received callback for node 69afbd07275c8d3b7939b51c INFO: 172.21.0.1:53186 - "POST /node/69afbd07275c8d3b7939b51c HTTP/1.0" 202 Accepted 2026-03-12 06:41:26,437 - lava_callback - INFO - Starting async job submit for node 69afbd07275c8d3b7939b51c 2026-03-12 06:41:26,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:41:26,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd07275c8d3b7939b51c HTTP/1.1" 200 None 2026-03-12 06:41:26,481 - lava_callback - DEBUG - Processing node 69afbd07275c8d3b7939b51c: baseline-arm-baylibre 2026-03-12 06:41:26,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbd07275c8d3b7939b51c 2026-03-12 06:41:26,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:41:26,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd07275c8d3b7939b51c HTTP/1.1" 200 None 2026-03-12 06:41:26,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53192 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:41:26,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:41:26,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:41:26,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbd07275c8d3b7939b51c HTTP/1.1" 200 None 2026-03-12 06:41:26,545 - lava_callback - ERROR - Error processing callback for node 69afbd07275c8d3b7939b51c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:43:17,379 - lava_callback - INFO - Received callback for node 69afbd75275c8d3b7939b53f INFO: 172.21.0.1:59326 - "POST /node/69afbd75275c8d3b7939b53f HTTP/1.0" 202 Accepted 2026-03-12 06:43:17,384 - lava_callback - INFO - Starting async job submit for node 69afbd75275c8d3b7939b53f 2026-03-12 06:43:17,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:17,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd75275c8d3b7939b53f HTTP/1.1" 200 None 2026-03-12 06:43:17,400 - lava_callback - DEBUG - Processing node 69afbd75275c8d3b7939b53f: baseline-arm-clabbe 2026-03-12 06:43:17,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbd75275c8d3b7939b53f 2026-03-12 06:43:17,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:17,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd75275c8d3b7939b53f HTTP/1.1" 200 None 2026-03-12 06:43:17,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:17,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:43:17,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:17,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbd75275c8d3b7939b53f HTTP/1.1" 200 None 2026-03-12 06:43:17,458 - lava_callback - ERROR - Error processing callback for node 69afbd75275c8d3b7939b53f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:43:57,349 - lava_callback - INFO - Received callback for node 69afbd9a275c8d3b7939b546 INFO: 172.21.0.1:37234 - "POST /node/69afbd9a275c8d3b7939b546 HTTP/1.0" 202 Accepted 2026-03-12 06:43:57,354 - lava_callback - INFO - Starting async job submit for node 69afbd9a275c8d3b7939b546 2026-03-12 06:43:57,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:57,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd9a275c8d3b7939b546 HTTP/1.1" 200 None 2026-03-12 06:43:57,377 - lava_callback - DEBUG - Processing node 69afbd9a275c8d3b7939b546: baseline-arm-clabbe 2026-03-12 06:43:57,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbd9a275c8d3b7939b546 2026-03-12 06:43:57,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:57,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd9a275c8d3b7939b546 HTTP/1.1" 200 None 2026-03-12 06:43:57,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:57,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:43:57,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:57,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbd9a275c8d3b7939b546 HTTP/1.1" 200 None 2026-03-12 06:43:57,431 - lava_callback - ERROR - Error processing callback for node 69afbd9a275c8d3b7939b546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:44:37,409 - lava_callback - INFO - Received callback for node 69afbdbf275c8d3b7939b551 INFO: 172.21.0.1:35386 - "POST /node/69afbdbf275c8d3b7939b551 HTTP/1.0" 202 Accepted 2026-03-12 06:44:37,414 - lava_callback - INFO - Starting async job submit for node 69afbdbf275c8d3b7939b551 2026-03-12 06:44:37,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:37,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbdbf275c8d3b7939b551 HTTP/1.1" 200 None 2026-03-12 06:44:37,431 - lava_callback - DEBUG - Processing node 69afbdbf275c8d3b7939b551: baseline-arm-clabbe 2026-03-12 06:44:37,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbdbf275c8d3b7939b551 2026-03-12 06:44:37,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:37,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbdbf275c8d3b7939b551 HTTP/1.1" 200 None 2026-03-12 06:44:37,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:37,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:44:37,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:37,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbdbf275c8d3b7939b551 HTTP/1.1" 200 None 2026-03-12 06:44:37,487 - lava_callback - ERROR - Error processing callback for node 69afbdbf275c8d3b7939b551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:44:57,372 - lava_callback - INFO - Received callback for node 69afbde5275c8d3b7939b55c INFO: 172.21.0.1:42852 - "POST /node/69afbde5275c8d3b7939b55c HTTP/1.0" 202 Accepted 2026-03-12 06:44:57,378 - lava_callback - INFO - Starting async job submit for node 69afbde5275c8d3b7939b55c 2026-03-12 06:44:57,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:57,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbde5275c8d3b7939b55c HTTP/1.1" 200 None 2026-03-12 06:44:57,393 - lava_callback - DEBUG - Processing node 69afbde5275c8d3b7939b55c: baseline-arm-clabbe 2026-03-12 06:44:57,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbde5275c8d3b7939b55c 2026-03-12 06:44:57,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:57,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbde5275c8d3b7939b55c HTTP/1.1" 200 None 2026-03-12 06:44:57,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:57,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:44:57,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:57,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbde5275c8d3b7939b55c HTTP/1.1" 200 None 2026-03-12 06:44:57,452 - lava_callback - ERROR - Error processing callback for node 69afbde5275c8d3b7939b55c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:45:37,450 - lava_callback - INFO - Received callback for node 69afbe0a275c8d3b7939b56b INFO: 172.21.0.1:47520 - "POST /node/69afbe0a275c8d3b7939b56b HTTP/1.0" 202 Accepted 2026-03-12 06:45:37,455 - lava_callback - INFO - Starting async job submit for node 69afbe0a275c8d3b7939b56b 2026-03-12 06:45:37,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:45:37,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe0a275c8d3b7939b56b HTTP/1.1" 200 None 2026-03-12 06:45:37,489 - lava_callback - DEBUG - Processing node 69afbe0a275c8d3b7939b56b: baseline-arm-clabbe 2026-03-12 06:45:37,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbe0a275c8d3b7939b56b 2026-03-12 06:45:37,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:45:37,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe0a275c8d3b7939b56b HTTP/1.1" 200 None 2026-03-12 06:45:37,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:45:37,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:45:37,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:45:37,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbe0a275c8d3b7939b56b HTTP/1.1" 200 None 2026-03-12 06:45:37,563 - lava_callback - ERROR - Error processing callback for node 69afbe0a275c8d3b7939b56b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:47:37,532 - lava_callback - INFO - Received callback for node 69afbe7a275c8d3b7939b585 INFO: 172.21.0.1:44424 - "POST /node/69afbe7a275c8d3b7939b585 HTTP/1.0" 202 Accepted 2026-03-12 06:47:37,538 - lava_callback - INFO - Starting async job submit for node 69afbe7a275c8d3b7939b585 2026-03-12 06:47:37,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:47:37,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe7a275c8d3b7939b585 HTTP/1.1" 200 None 2026-03-12 06:47:37,553 - lava_callback - DEBUG - Processing node 69afbe7a275c8d3b7939b585: baseline-arm-clabbe 2026-03-12 06:47:37,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbe7a275c8d3b7939b585 2026-03-12 06:47:37,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:47:37,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe7a275c8d3b7939b585 HTTP/1.1" 200 None 2026-03-12 06:47:37,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:47:37,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:47:37,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:47:37,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbe7a275c8d3b7939b585 HTTP/1.1" 200 None 2026-03-12 06:47:37,603 - lava_callback - ERROR - Error processing callback for node 69afbe7a275c8d3b7939b585: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:48:17,524 - lava_callback - INFO - Received callback for node 69afbe9f275c8d3b7939b591 INFO: 172.21.0.1:39512 - "POST /node/69afbe9f275c8d3b7939b591 HTTP/1.0" 202 Accepted 2026-03-12 06:48:17,530 - lava_callback - INFO - Starting async job submit for node 69afbe9f275c8d3b7939b591 2026-03-12 06:48:17,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:17,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe9f275c8d3b7939b591 HTTP/1.1" 200 None 2026-03-12 06:48:17,546 - lava_callback - DEBUG - Processing node 69afbe9f275c8d3b7939b591: baseline-arm-clabbe 2026-03-12 06:48:17,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbe9f275c8d3b7939b591 2026-03-12 06:48:17,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:17,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe9f275c8d3b7939b591 HTTP/1.1" 200 None 2026-03-12 06:48:17,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:17,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:48:17,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:17,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbe9f275c8d3b7939b591 HTTP/1.1" 200 None 2026-03-12 06:48:17,612 - lava_callback - ERROR - Error processing callback for node 69afbe9f275c8d3b7939b591: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:48:57,574 - lava_callback - INFO - Received callback for node 69afbec4275c8d3b7939b599 INFO: 172.21.0.1:49468 - "POST /node/69afbec4275c8d3b7939b599 HTTP/1.0" 202 Accepted 2026-03-12 06:48:57,580 - lava_callback - INFO - Starting async job submit for node 69afbec4275c8d3b7939b599 2026-03-12 06:48:57,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:57,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbec4275c8d3b7939b599 HTTP/1.1" 200 None 2026-03-12 06:48:57,595 - lava_callback - DEBUG - Processing node 69afbec4275c8d3b7939b599: baseline-arm-clabbe 2026-03-12 06:48:57,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbec4275c8d3b7939b599 2026-03-12 06:48:57,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:57,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbec4275c8d3b7939b599 HTTP/1.1" 200 None 2026-03-12 06:48:57,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:57,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:48:57,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:57,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbec4275c8d3b7939b599 HTTP/1.1" 200 None 2026-03-12 06:48:57,657 - lava_callback - ERROR - Error processing callback for node 69afbec4275c8d3b7939b599: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46146 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:49:17,552 - lava_callback - INFO - Received callback for node 69afbee8275c8d3b7939b5a2 INFO: 172.21.0.1:46148 - "POST /node/69afbee8275c8d3b7939b5a2 HTTP/1.0" 202 Accepted 2026-03-12 06:49:17,558 - lava_callback - INFO - Starting async job submit for node 69afbee8275c8d3b7939b5a2 2026-03-12 06:49:17,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:17,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbee8275c8d3b7939b5a2 HTTP/1.1" 200 None 2026-03-12 06:49:17,575 - lava_callback - DEBUG - Processing node 69afbee8275c8d3b7939b5a2: baseline-arm-clabbe 2026-03-12 06:49:17,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbee8275c8d3b7939b5a2 2026-03-12 06:49:17,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:17,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbee8275c8d3b7939b5a2 HTTP/1.1" 200 None 2026-03-12 06:49:17,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:17,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:49:17,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:17,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbee8275c8d3b7939b5a2 HTTP/1.1" 200 None 2026-03-12 06:49:17,638 - lava_callback - ERROR - Error processing callback for node 69afbee8275c8d3b7939b5a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:49:57,619 - lava_callback - INFO - Received callback for node 69afbf0d275c8d3b7939b5ab INFO: 172.21.0.1:38106 - "POST /node/69afbf0d275c8d3b7939b5ab HTTP/1.0" 202 Accepted 2026-03-12 06:49:57,625 - lava_callback - INFO - Starting async job submit for node 69afbf0d275c8d3b7939b5ab 2026-03-12 06:49:57,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:57,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf0d275c8d3b7939b5ab HTTP/1.1" 200 None 2026-03-12 06:49:57,641 - lava_callback - DEBUG - Processing node 69afbf0d275c8d3b7939b5ab: baseline-arm-clabbe 2026-03-12 06:49:57,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbf0d275c8d3b7939b5ab 2026-03-12 06:49:57,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:57,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf0d275c8d3b7939b5ab HTTP/1.1" 200 None 2026-03-12 06:49:57,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:57,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:49:57,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:57,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbf0d275c8d3b7939b5ab HTTP/1.1" 200 None 2026-03-12 06:49:57,694 - lava_callback - ERROR - Error processing callback for node 69afbf0d275c8d3b7939b5ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:50:37,893 - lava_callback - INFO - Received callback for node 69afbf32275c8d3b7939b5b4 INFO: 172.21.0.1:51698 - "POST /node/69afbf32275c8d3b7939b5b4 HTTP/1.0" 202 Accepted 2026-03-12 06:50:37,899 - lava_callback - INFO - Starting async job submit for node 69afbf32275c8d3b7939b5b4 2026-03-12 06:50:37,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:50:37,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf32275c8d3b7939b5b4 HTTP/1.1" 200 None 2026-03-12 06:50:37,914 - lava_callback - DEBUG - Processing node 69afbf32275c8d3b7939b5b4: baseline-arm-clabbe 2026-03-12 06:50:37,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbf32275c8d3b7939b5b4 2026-03-12 06:50:37,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:50:37,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf32275c8d3b7939b5b4 HTTP/1.1" 200 None 2026-03-12 06:50:37,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:50:37,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:50:37,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:50:37,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbf32275c8d3b7939b5b4 HTTP/1.1" 200 None 2026-03-12 06:50:37,980 - lava_callback - ERROR - Error processing callback for node 69afbf32275c8d3b7939b5b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:51:17,669 - lava_callback - INFO - Received callback for node 69afbf57275c8d3b7939b5bf INFO: 172.21.0.1:58056 - "POST /node/69afbf57275c8d3b7939b5bf HTTP/1.0" 202 Accepted 2026-03-12 06:51:17,675 - lava_callback - INFO - Starting async job submit for node 69afbf57275c8d3b7939b5bf 2026-03-12 06:51:17,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:17,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf57275c8d3b7939b5bf HTTP/1.1" 200 None 2026-03-12 06:51:17,715 - lava_callback - DEBUG - Processing node 69afbf57275c8d3b7939b5bf: baseline-arm-clabbe 2026-03-12 06:51:17,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbf57275c8d3b7939b5bf 2026-03-12 06:51:17,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:17,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf57275c8d3b7939b5bf HTTP/1.1" 200 None 2026-03-12 06:51:17,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:17,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:51:17,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:17,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbf57275c8d3b7939b5bf HTTP/1.1" 200 None 2026-03-12 06:51:17,799 - lava_callback - ERROR - Error processing callback for node 69afbf57275c8d3b7939b5bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:51:57,616 - lava_callback - INFO - Received callback for node 69afbf7b275c8d3b7939b5c6 INFO: 172.21.0.1:40696 - "POST /node/69afbf7b275c8d3b7939b5c6 HTTP/1.0" 202 Accepted 2026-03-12 06:51:57,622 - lava_callback - INFO - Starting async job submit for node 69afbf7b275c8d3b7939b5c6 2026-03-12 06:51:57,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:57,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf7b275c8d3b7939b5c6 HTTP/1.1" 200 None 2026-03-12 06:51:57,641 - lava_callback - DEBUG - Processing node 69afbf7b275c8d3b7939b5c6: baseline-arm-clabbe 2026-03-12 06:51:57,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbf7b275c8d3b7939b5c6 2026-03-12 06:51:57,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:57,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf7b275c8d3b7939b5c6 HTTP/1.1" 200 None 2026-03-12 06:51:57,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:57,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:51:57,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:57,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbf7b275c8d3b7939b5c6 HTTP/1.1" 200 None 2026-03-12 06:51:57,706 - lava_callback - ERROR - Error processing callback for node 69afbf7b275c8d3b7939b5c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:53:37,720 - lava_callback - INFO - Received callback for node 69afbfed275c8d3b7939b5dd INFO: 172.21.0.1:38856 - "POST /node/69afbfed275c8d3b7939b5dd HTTP/1.0" 202 Accepted 2026-03-12 06:53:37,726 - lava_callback - INFO - Starting async job submit for node 69afbfed275c8d3b7939b5dd 2026-03-12 06:53:37,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:53:37,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbfed275c8d3b7939b5dd HTTP/1.1" 200 None 2026-03-12 06:53:37,742 - lava_callback - DEBUG - Processing node 69afbfed275c8d3b7939b5dd: baseline-arm-clabbe 2026-03-12 06:53:37,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbfed275c8d3b7939b5dd 2026-03-12 06:53:37,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:53:37,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbfed275c8d3b7939b5dd HTTP/1.1" 200 None 2026-03-12 06:53:37,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:53:37,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:53:37,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:53:37,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbfed275c8d3b7939b5dd HTTP/1.1" 200 None 2026-03-12 06:53:37,805 - lava_callback - ERROR - Error processing callback for node 69afbfed275c8d3b7939b5dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET /node/69aa29f98c4d487a0e751ed1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:59:07,521 - lava_callback - INFO - Received callback for node 69afc12d275c8d3b7939b639 INFO: 172.21.0.1:57828 - "POST /node/69afc12d275c8d3b7939b639 HTTP/1.0" 202 Accepted 2026-03-12 06:59:07,527 - lava_callback - INFO - Starting async job submit for node 69afc12d275c8d3b7939b639 2026-03-12 06:59:07,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:59:07,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc12d275c8d3b7939b639 HTTP/1.1" 200 None 2026-03-12 06:59:07,542 - lava_callback - DEBUG - Processing node 69afc12d275c8d3b7939b639: baseline-arm64-baylibre 2026-03-12 06:59:07,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc12d275c8d3b7939b639 2026-03-12 06:59:07,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:59:07,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc12d275c8d3b7939b639 HTTP/1.1" 200 None 2026-03-12 06:59:07,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:59:07,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 06:59:07,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:59:07,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc12d275c8d3b7939b639 HTTP/1.1" 200 None 2026-03-12 06:59:07,610 - lava_callback - ERROR - Error processing callback for node 69afc12d275c8d3b7939b639: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:00:27,478 - lava_callback - INFO - Received callback for node 69afc17d275c8d3b7939b64d INFO: 172.21.0.1:47842 - "POST /node/69afc17d275c8d3b7939b64d HTTP/1.0" 202 Accepted 2026-03-12 07:00:27,485 - lava_callback - INFO - Starting async job submit for node 69afc17d275c8d3b7939b64d 2026-03-12 07:00:27,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:00:27,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc17d275c8d3b7939b64d HTTP/1.1" 200 None 2026-03-12 07:00:27,514 - lava_callback - DEBUG - Processing node 69afc17d275c8d3b7939b64d: baseline-arm64-baylibre 2026-03-12 07:00:27,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc17d275c8d3b7939b64d 2026-03-12 07:00:27,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:00:27,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc17d275c8d3b7939b64d HTTP/1.1" 200 None 2026-03-12 07:00:27,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:00:27,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:00:27,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:00:27,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc17d275c8d3b7939b64d HTTP/1.1" 200 None 2026-03-12 07:00:27,583 - lava_callback - ERROR - Error processing callback for node 69afc17d275c8d3b7939b64d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:01:47,883 - lava_callback - INFO - Received callback for node 69afc1cd275c8d3b7939b657 INFO: 172.21.0.1:60214 - "POST /node/69afc1cd275c8d3b7939b657 HTTP/1.0" 202 Accepted 2026-03-12 07:01:47,888 - lava_callback - INFO - Starting async job submit for node 69afc1cd275c8d3b7939b657 2026-03-12 07:01:47,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:01:47,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc1cd275c8d3b7939b657 HTTP/1.1" 200 None 2026-03-12 07:01:47,907 - lava_callback - DEBUG - Processing node 69afc1cd275c8d3b7939b657: baseline-arm64-baylibre 2026-03-12 07:01:47,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc1cd275c8d3b7939b657 2026-03-12 07:01:47,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:01:47,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc1cd275c8d3b7939b657 HTTP/1.1" 200 None 2026-03-12 07:01:47,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:01:47,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:01:47,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:01:47,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc1cd275c8d3b7939b657 HTTP/1.1" 200 None 2026-03-12 07:01:47,966 - lava_callback - ERROR - Error processing callback for node 69afc1cd275c8d3b7939b657: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:03:07,653 - lava_callback - INFO - Received callback for node 69afc21e275c8d3b7939b65e INFO: 172.21.0.1:55716 - "POST /node/69afc21e275c8d3b7939b65e HTTP/1.0" 202 Accepted 2026-03-12 07:03:07,659 - lava_callback - INFO - Starting async job submit for node 69afc21e275c8d3b7939b65e 2026-03-12 07:03:07,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:03:07,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc21e275c8d3b7939b65e HTTP/1.1" 200 None 2026-03-12 07:03:07,694 - lava_callback - DEBUG - Processing node 69afc21e275c8d3b7939b65e: baseline-arm64-baylibre 2026-03-12 07:03:07,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc21e275c8d3b7939b65e 2026-03-12 07:03:07,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:03:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc21e275c8d3b7939b65e HTTP/1.1" 200 None 2026-03-12 07:03:07,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:03:07,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:03:07,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:03:07,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc21e275c8d3b7939b65e HTTP/1.1" 200 None 2026-03-12 07:03:07,751 - lava_callback - ERROR - Error processing callback for node 69afc21e275c8d3b7939b65e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:04:27,985 - lava_callback - INFO - Received callback for node 69afc26b275c8d3b7939b66c INFO: 172.21.0.1:57698 - "POST /node/69afc26b275c8d3b7939b66c HTTP/1.0" 202 Accepted 2026-03-12 07:04:27,991 - lava_callback - INFO - Starting async job submit for node 69afc26b275c8d3b7939b66c 2026-03-12 07:04:27,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:04:28,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc26b275c8d3b7939b66c HTTP/1.1" 200 None 2026-03-12 07:04:28,007 - lava_callback - DEBUG - Processing node 69afc26b275c8d3b7939b66c: baseline-arm64-baylibre 2026-03-12 07:04:28,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc26b275c8d3b7939b66c 2026-03-12 07:04:28,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:04:28,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc26b275c8d3b7939b66c HTTP/1.1" 200 None 2026-03-12 07:04:28,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:04:28,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:04:28,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:04:28,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc26b275c8d3b7939b66c HTTP/1.1" 200 None 2026-03-12 07:04:28,061 - lava_callback - ERROR - Error processing callback for node 69afc26b275c8d3b7939b66c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33304 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:05:38,243 - lava_callback - INFO - Received callback for node 69afc2bb275c8d3b7939b67c INFO: 172.21.0.1:33306 - "POST /node/69afc2bb275c8d3b7939b67c HTTP/1.0" 202 Accepted 2026-03-12 07:05:38,251 - lava_callback - INFO - Starting async job submit for node 69afc2bb275c8d3b7939b67c 2026-03-12 07:05:38,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:05:38,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc2bb275c8d3b7939b67c HTTP/1.1" 200 None 2026-03-12 07:05:38,268 - lava_callback - DEBUG - Processing node 69afc2bb275c8d3b7939b67c: baseline-arm64-clabbe 2026-03-12 07:05:38,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc2bb275c8d3b7939b67c 2026-03-12 07:05:38,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:05:38,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc2bb275c8d3b7939b67c HTTP/1.1" 200 None 2026-03-12 07:05:38,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:05:38,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:05:38,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:05:38,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc2bb275c8d3b7939b67c HTTP/1.1" 200 None 2026-03-12 07:05:38,321 - lava_callback - ERROR - Error processing callback for node 69afc2bb275c8d3b7939b67c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:06:58,334 - lava_callback - INFO - Received callback for node 69afc307275c8d3b7939b684 INFO: 172.21.0.1:45774 - "POST /node/69afc307275c8d3b7939b684 HTTP/1.0" 202 Accepted 2026-03-12 07:06:58,339 - lava_callback - INFO - Starting async job submit for node 69afc307275c8d3b7939b684 2026-03-12 07:06:58,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:06:58,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc307275c8d3b7939b684 HTTP/1.1" 200 None 2026-03-12 07:06:58,360 - lava_callback - DEBUG - Processing node 69afc307275c8d3b7939b684: baseline-arm64-clabbe 2026-03-12 07:06:58,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc307275c8d3b7939b684 2026-03-12 07:06:58,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:06:58,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc307275c8d3b7939b684 HTTP/1.1" 200 None 2026-03-12 07:06:58,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:06:58,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:06:58,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:06:58,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc307275c8d3b7939b684 HTTP/1.1" 200 None 2026-03-12 07:06:58,422 - lava_callback - ERROR - Error processing callback for node 69afc307275c8d3b7939b684: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:08:18,382 - lava_callback - INFO - Received callback for node 69afc358275c8d3b7939b690 INFO: 172.21.0.1:53878 - "POST /node/69afc358275c8d3b7939b690 HTTP/1.0" 202 Accepted 2026-03-12 07:08:18,388 - lava_callback - INFO - Starting async job submit for node 69afc358275c8d3b7939b690 2026-03-12 07:08:18,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:08:18,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc358275c8d3b7939b690 HTTP/1.1" 200 None 2026-03-12 07:08:18,403 - lava_callback - DEBUG - Processing node 69afc358275c8d3b7939b690: baseline-arm64-clabbe 2026-03-12 07:08:18,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc358275c8d3b7939b690 2026-03-12 07:08:18,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:08:18,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc358275c8d3b7939b690 HTTP/1.1" 200 None 2026-03-12 07:08:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:08:18,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:08:18,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:08:18,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc358275c8d3b7939b690 HTTP/1.1" 200 None 2026-03-12 07:08:18,463 - lava_callback - ERROR - Error processing callback for node 69afc358275c8d3b7939b690: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:09:38,420 - lava_callback - INFO - Received callback for node 69afc3a6275c8d3b7939b695 INFO: 172.21.0.1:53390 - "POST /node/69afc3a6275c8d3b7939b695 HTTP/1.0" 202 Accepted 2026-03-12 07:09:38,425 - lava_callback - INFO - Starting async job submit for node 69afc3a6275c8d3b7939b695 2026-03-12 07:09:38,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:09:38,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc3a6275c8d3b7939b695 HTTP/1.1" 200 None 2026-03-12 07:09:38,440 - lava_callback - DEBUG - Processing node 69afc3a6275c8d3b7939b695: baseline-arm64-clabbe 2026-03-12 07:09:38,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc3a6275c8d3b7939b695 2026-03-12 07:09:38,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:09:38,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc3a6275c8d3b7939b695 HTTP/1.1" 200 None 2026-03-12 07:09:38,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:09:38,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:09:38,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:09:38,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc3a6275c8d3b7939b695 HTTP/1.1" 200 None 2026-03-12 07:09:38,516 - lava_callback - ERROR - Error processing callback for node 69afc3a6275c8d3b7939b695: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:10:58,632 - lava_callback - INFO - Received callback for node 69afc3f5275c8d3b7939b69f INFO: 172.21.0.1:48436 - "POST /node/69afc3f5275c8d3b7939b69f HTTP/1.0" 202 Accepted 2026-03-12 07:10:58,637 - lava_callback - INFO - Starting async job submit for node 69afc3f5275c8d3b7939b69f 2026-03-12 07:10:58,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:10:58,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc3f5275c8d3b7939b69f HTTP/1.1" 200 None 2026-03-12 07:10:58,656 - lava_callback - DEBUG - Processing node 69afc3f5275c8d3b7939b69f: baseline-arm64-clabbe 2026-03-12 07:10:58,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc3f5275c8d3b7939b69f 2026-03-12 07:10:58,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:10:58,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc3f5275c8d3b7939b69f HTTP/1.1" 200 None 2026-03-12 07:10:58,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:10:58,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:10:58,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:10:58,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc3f5275c8d3b7939b69f HTTP/1.1" 200 None 2026-03-12 07:10:58,714 - lava_callback - ERROR - Error processing callback for node 69afc3f5275c8d3b7939b69f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:12:18,799 - lava_callback - INFO - Received callback for node 69afc443275c8d3b7939b6a8 INFO: 172.21.0.1:45118 - "POST /node/69afc443275c8d3b7939b6a8 HTTP/1.0" 202 Accepted 2026-03-12 07:12:18,805 - lava_callback - INFO - Starting async job submit for node 69afc443275c8d3b7939b6a8 2026-03-12 07:12:18,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:12:18,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc443275c8d3b7939b6a8 HTTP/1.1" 200 None 2026-03-12 07:12:18,820 - lava_callback - DEBUG - Processing node 69afc443275c8d3b7939b6a8: baseline-arm64-clabbe 2026-03-12 07:12:18,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc443275c8d3b7939b6a8 2026-03-12 07:12:18,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:12:18,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc443275c8d3b7939b6a8 HTTP/1.1" 200 None 2026-03-12 07:12:18,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:12:18,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:12:18,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:12:18,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc443275c8d3b7939b6a8 HTTP/1.1" 200 None 2026-03-12 07:12:18,881 - lava_callback - ERROR - Error processing callback for node 69afc443275c8d3b7939b6a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:13:18,611 - lava_callback - INFO - Received callback for node 69afc483275c8d3b7939b6b1 INFO: 172.21.0.1:33756 - "POST /node/69afc483275c8d3b7939b6b1 HTTP/1.0" 202 Accepted 2026-03-12 07:13:18,617 - lava_callback - INFO - Starting async job submit for node 69afc483275c8d3b7939b6b1 2026-03-12 07:13:18,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:18,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc483275c8d3b7939b6b1 HTTP/1.1" 200 None 2026-03-12 07:13:18,639 - lava_callback - DEBUG - Processing node 69afc483275c8d3b7939b6b1: baseline-arm-clabbe 2026-03-12 07:13:18,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc483275c8d3b7939b6b1 2026-03-12 07:13:18,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:18,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc483275c8d3b7939b6b1 HTTP/1.1" 200 None 2026-03-12 07:13:18,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:18,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:13:18,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:18,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc483275c8d3b7939b6b1 HTTP/1.1" 200 None 2026-03-12 07:13:18,695 - lava_callback - ERROR - Error processing callback for node 69afc483275c8d3b7939b6b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:13:58,587 - lava_callback - INFO - Received callback for node 69afc4a8275c8d3b7939b6bc INFO: 172.21.0.1:52092 - "POST /node/69afc4a8275c8d3b7939b6bc HTTP/1.0" 202 Accepted 2026-03-12 07:13:58,593 - lava_callback - INFO - Starting async job submit for node 69afc4a8275c8d3b7939b6bc 2026-03-12 07:13:58,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:58,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4a8275c8d3b7939b6bc HTTP/1.1" 200 None 2026-03-12 07:13:58,609 - lava_callback - DEBUG - Processing node 69afc4a8275c8d3b7939b6bc: baseline-arm-clabbe 2026-03-12 07:13:58,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc4a8275c8d3b7939b6bc 2026-03-12 07:13:58,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:58,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4a8275c8d3b7939b6bc HTTP/1.1" 200 None 2026-03-12 07:13:58,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:58,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:13:58,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:58,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc4a8275c8d3b7939b6bc HTTP/1.1" 200 None 2026-03-12 07:13:58,669 - lava_callback - ERROR - Error processing callback for node 69afc4a8275c8d3b7939b6bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:14:38,624 - lava_callback - INFO - Received callback for node 69afc4cd275c8d3b7939b6c5 INFO: 172.21.0.1:56478 - "POST /node/69afc4cd275c8d3b7939b6c5 HTTP/1.0" 202 Accepted 2026-03-12 07:14:38,629 - lava_callback - INFO - Starting async job submit for node 69afc4cd275c8d3b7939b6c5 2026-03-12 07:14:38,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:14:38,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4cd275c8d3b7939b6c5 HTTP/1.1" 200 None 2026-03-12 07:14:38,669 - lava_callback - DEBUG - Processing node 69afc4cd275c8d3b7939b6c5: baseline-arm-clabbe 2026-03-12 07:14:38,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc4cd275c8d3b7939b6c5 2026-03-12 07:14:38,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:14:38,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4cd275c8d3b7939b6c5 HTTP/1.1" 200 None 2026-03-12 07:14:38,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:14:38,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:14:38,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:14:38,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc4cd275c8d3b7939b6c5 HTTP/1.1" 200 None 2026-03-12 07:14:38,728 - lava_callback - ERROR - Error processing callback for node 69afc4cd275c8d3b7939b6c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:15:18,943 - lava_callback - INFO - Received callback for node 69afc4f3275c8d3b7939b6d1 INFO: 172.21.0.1:49964 - "POST /node/69afc4f3275c8d3b7939b6d1 HTTP/1.0" 202 Accepted 2026-03-12 07:15:18,950 - lava_callback - INFO - Starting async job submit for node 69afc4f3275c8d3b7939b6d1 2026-03-12 07:15:18,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:18,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4f3275c8d3b7939b6d1 HTTP/1.1" 200 None 2026-03-12 07:15:18,971 - lava_callback - DEBUG - Processing node 69afc4f3275c8d3b7939b6d1: baseline-arm-clabbe 2026-03-12 07:15:18,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc4f3275c8d3b7939b6d1 2026-03-12 07:15:18,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:18,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4f3275c8d3b7939b6d1 HTTP/1.1" 200 None 2026-03-12 07:15:18,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:19,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:15:19,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:19,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc4f3275c8d3b7939b6d1 HTTP/1.1" 200 None 2026-03-12 07:15:19,028 - lava_callback - ERROR - Error processing callback for node 69afc4f3275c8d3b7939b6d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:15:38,701 - lava_callback - INFO - Received callback for node 69afc518275c8d3b7939b6d8 INFO: 172.21.0.1:37840 - "POST /node/69afc518275c8d3b7939b6d8 HTTP/1.0" 202 Accepted 2026-03-12 07:15:38,706 - lava_callback - INFO - Starting async job submit for node 69afc518275c8d3b7939b6d8 2026-03-12 07:15:38,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc518275c8d3b7939b6d8 HTTP/1.1" 200 None 2026-03-12 07:15:38,725 - lava_callback - DEBUG - Processing node 69afc518275c8d3b7939b6d8: baseline-arm-clabbe 2026-03-12 07:15:38,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc518275c8d3b7939b6d8 2026-03-12 07:15:38,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:38,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc518275c8d3b7939b6d8 HTTP/1.1" 200 None 2026-03-12 07:15:38,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:38,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:15:38,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:38,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc518275c8d3b7939b6d8 HTTP/1.1" 200 None 2026-03-12 07:15:38,798 - lava_callback - ERROR - Error processing callback for node 69afc518275c8d3b7939b6d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:16:18,690 - lava_callback - INFO - Received callback for node 69afc53c275c8d3b7939b6e2 INFO: 172.21.0.1:55970 - "POST /node/69afc53c275c8d3b7939b6e2 HTTP/1.0" 202 Accepted 2026-03-12 07:16:18,696 - lava_callback - INFO - Starting async job submit for node 69afc53c275c8d3b7939b6e2 2026-03-12 07:16:18,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:16:18,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc53c275c8d3b7939b6e2 HTTP/1.1" 200 None 2026-03-12 07:16:18,712 - lava_callback - DEBUG - Processing node 69afc53c275c8d3b7939b6e2: baseline-arm-clabbe 2026-03-12 07:16:18,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc53c275c8d3b7939b6e2 2026-03-12 07:16:18,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:16:18,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc53c275c8d3b7939b6e2 HTTP/1.1" 200 None 2026-03-12 07:16:18,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:16:18,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:16:18,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:16:18,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc53c275c8d3b7939b6e2 HTTP/1.1" 200 None 2026-03-12 07:16:18,782 - lava_callback - ERROR - Error processing callback for node 69afc53c275c8d3b7939b6e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:17:08,479 - lava_callback - INFO - Received callback for node 69afc56b275c8d3b7939b6ee INFO: 172.21.0.1:43762 - "POST /node/69afc56b275c8d3b7939b6ee HTTP/1.0" 202 Accepted 2026-03-12 07:17:08,485 - lava_callback - INFO - Starting async job submit for node 69afc56b275c8d3b7939b6ee 2026-03-12 07:17:08,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:17:08,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc56b275c8d3b7939b6ee HTTP/1.1" 200 None 2026-03-12 07:17:08,507 - lava_callback - DEBUG - Processing node 69afc56b275c8d3b7939b6ee: baseline-arm64-baylibre 2026-03-12 07:17:08,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc56b275c8d3b7939b6ee 2026-03-12 07:17:08,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:17:08,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc56b275c8d3b7939b6ee HTTP/1.1" 200 None 2026-03-12 07:17:08,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:17:08,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:17:08,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:17:08,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc56b275c8d3b7939b6ee HTTP/1.1" 200 None 2026-03-12 07:17:08,572 - lava_callback - ERROR - Error processing callback for node 69afc56b275c8d3b7939b6ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:19:28,786 - lava_callback - INFO - Received callback for node 69afc5fa275c8d3b7939b6f8 INFO: 172.21.0.1:32788 - "POST /node/69afc5fa275c8d3b7939b6f8 HTTP/1.0" 202 Accepted 2026-03-12 07:19:28,792 - lava_callback - INFO - Starting async job submit for node 69afc5fa275c8d3b7939b6f8 2026-03-12 07:19:28,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:19:28,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc5fa275c8d3b7939b6f8 HTTP/1.1" 200 None 2026-03-12 07:19:28,810 - lava_callback - DEBUG - Processing node 69afc5fa275c8d3b7939b6f8: baseline-arm64-baylibre 2026-03-12 07:19:28,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc5fa275c8d3b7939b6f8 2026-03-12 07:19:28,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:19:28,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc5fa275c8d3b7939b6f8 HTTP/1.1" 200 None 2026-03-12 07:19:28,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:19:28,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:19:28,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:19:28,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc5fa275c8d3b7939b6f8 HTTP/1.1" 200 None 2026-03-12 07:19:28,871 - lava_callback - ERROR - Error processing callback for node 69afc5fa275c8d3b7939b6f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:22:19,045 - lava_callback - INFO - Received callback for node 69afc69b275c8d3b7939b713 INFO: 172.21.0.1:44630 - "POST /node/69afc69b275c8d3b7939b713 HTTP/1.0" 202 Accepted 2026-03-12 07:22:19,051 - lava_callback - INFO - Starting async job submit for node 69afc69b275c8d3b7939b713 2026-03-12 07:22:19,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:22:19,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc69b275c8d3b7939b713 HTTP/1.1" 200 None 2026-03-12 07:22:19,067 - lava_callback - DEBUG - Processing node 69afc69b275c8d3b7939b713: baseline-arm64-clabbe 2026-03-12 07:22:19,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc69b275c8d3b7939b713 2026-03-12 07:22:19,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:22:19,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc69b275c8d3b7939b713 HTTP/1.1" 200 None 2026-03-12 07:22:19,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:22:19,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:22:19,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:22:19,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc69b275c8d3b7939b713 HTTP/1.1" 200 None 2026-03-12 07:22:19,124 - lava_callback - ERROR - Error processing callback for node 69afc69b275c8d3b7939b713: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:23:39,104 - lava_callback - INFO - Received callback for node 69afc6e7275c8d3b7939b71b INFO: 172.21.0.1:55890 - "POST /node/69afc6e7275c8d3b7939b71b HTTP/1.0" 202 Accepted 2026-03-12 07:23:39,109 - lava_callback - INFO - Starting async job submit for node 69afc6e7275c8d3b7939b71b 2026-03-12 07:23:39,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:23:39,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc6e7275c8d3b7939b71b HTTP/1.1" 200 None 2026-03-12 07:23:39,125 - lava_callback - DEBUG - Processing node 69afc6e7275c8d3b7939b71b: baseline-arm64-clabbe 2026-03-12 07:23:39,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc6e7275c8d3b7939b71b 2026-03-12 07:23:39,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:23:39,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc6e7275c8d3b7939b71b HTTP/1.1" 200 None 2026-03-12 07:23:39,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:23:39,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:23:39,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:23:39,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc6e7275c8d3b7939b71b HTTP/1.1" 200 None 2026-03-12 07:23:39,191 - lava_callback - ERROR - Error processing callback for node 69afc6e7275c8d3b7939b71b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49654 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:24:39,182 - lava_callback - INFO - Received callback for node 69afc731275c8d3b7939b726 INFO: 172.21.0.1:49664 - "POST /node/69afc731275c8d3b7939b726 HTTP/1.0" 202 Accepted 2026-03-12 07:24:39,188 - lava_callback - INFO - Starting async job submit for node 69afc731275c8d3b7939b726 2026-03-12 07:24:39,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:24:39,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc731275c8d3b7939b726 HTTP/1.1" 200 None 2026-03-12 07:24:39,206 - lava_callback - DEBUG - Processing node 69afc731275c8d3b7939b726: baseline-arm64-clabbe 2026-03-12 07:24:39,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc731275c8d3b7939b726 2026-03-12 07:24:39,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:24:39,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc731275c8d3b7939b726 HTTP/1.1" 200 None 2026-03-12 07:24:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:24:39,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:24:39,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:24:39,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc731275c8d3b7939b726 HTTP/1.1" 200 None 2026-03-12 07:24:39,306 - lava_callback - ERROR - Error processing callback for node 69afc731275c8d3b7939b726: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:25:59,205 - lava_callback - INFO - Received callback for node 69afc77f275c8d3b7939b72c INFO: 172.21.0.1:51150 - "POST /node/69afc77f275c8d3b7939b72c HTTP/1.0" 202 Accepted 2026-03-12 07:25:59,211 - lava_callback - INFO - Starting async job submit for node 69afc77f275c8d3b7939b72c 2026-03-12 07:25:59,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:25:59,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc77f275c8d3b7939b72c HTTP/1.1" 200 None 2026-03-12 07:25:59,228 - lava_callback - DEBUG - Processing node 69afc77f275c8d3b7939b72c: baseline-arm64-clabbe 2026-03-12 07:25:59,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc77f275c8d3b7939b72c 2026-03-12 07:25:59,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:25:59,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc77f275c8d3b7939b72c HTTP/1.1" 200 None 2026-03-12 07:25:59,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:25:59,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:25:59,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:25:59,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc77f275c8d3b7939b72c HTTP/1.1" 200 None 2026-03-12 07:25:59,292 - lava_callback - ERROR - Error processing callback for node 69afc77f275c8d3b7939b72c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:29:49,255 - lava_callback - INFO - Received callback for node 69afc864275c8d3b7939b74a INFO: 172.21.0.1:36416 - "POST /node/69afc864275c8d3b7939b74a HTTP/1.0" 202 Accepted 2026-03-12 07:29:49,260 - lava_callback - INFO - Starting async job submit for node 69afc864275c8d3b7939b74a 2026-03-12 07:29:49,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:29:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc864275c8d3b7939b74a HTTP/1.1" 200 None 2026-03-12 07:29:49,277 - lava_callback - DEBUG - Processing node 69afc864275c8d3b7939b74a: baseline-arm64-baylibre 2026-03-12 07:29:49,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc864275c8d3b7939b74a 2026-03-12 07:29:49,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:29:49,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc864275c8d3b7939b74a HTTP/1.1" 200 None 2026-03-12 07:29:49,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:29:49,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:29:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:29:49,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc864275c8d3b7939b74a HTTP/1.1" 200 None 2026-03-12 07:29:49,339 - lava_callback - ERROR - Error processing callback for node 69afc864275c8d3b7939b74a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41196 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:31:09,103 - lava_callback - INFO - Received callback for node 69afc8b0275c8d3b7939b753 INFO: 172.21.0.1:41210 - "POST /node/69afc8b0275c8d3b7939b753 HTTP/1.0" 202 Accepted 2026-03-12 07:31:09,109 - lava_callback - INFO - Starting async job submit for node 69afc8b0275c8d3b7939b753 2026-03-12 07:31:09,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:31:09,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc8b0275c8d3b7939b753 HTTP/1.1" 200 None 2026-03-12 07:31:09,125 - lava_callback - DEBUG - Processing node 69afc8b0275c8d3b7939b753: baseline-arm64-baylibre 2026-03-12 07:31:09,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc8b0275c8d3b7939b753 2026-03-12 07:31:09,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:31:09,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc8b0275c8d3b7939b753 HTTP/1.1" 200 None 2026-03-12 07:31:09,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:31:09,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:31:09,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:31:09,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc8b0275c8d3b7939b753 HTTP/1.1" 200 None 2026-03-12 07:31:09,184 - lava_callback - ERROR - Error processing callback for node 69afc8b0275c8d3b7939b753: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:32:29,231 - lava_callback - INFO - Received callback for node 69afc8fd275c8d3b7939b763 INFO: 172.21.0.1:44880 - "POST /node/69afc8fd275c8d3b7939b763 HTTP/1.0" 202 Accepted 2026-03-12 07:32:29,237 - lava_callback - INFO - Starting async job submit for node 69afc8fd275c8d3b7939b763 2026-03-12 07:32:29,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:32:29,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc8fd275c8d3b7939b763 HTTP/1.1" 200 None 2026-03-12 07:32:29,255 - lava_callback - DEBUG - Processing node 69afc8fd275c8d3b7939b763: baseline-arm64-baylibre 2026-03-12 07:32:29,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc8fd275c8d3b7939b763 2026-03-12 07:32:29,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:32:29,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc8fd275c8d3b7939b763 HTTP/1.1" 200 None 2026-03-12 07:32:29,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:32:29,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:32:29,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:32:29,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc8fd275c8d3b7939b763 HTTP/1.1" 200 None 2026-03-12 07:32:29,326 - lava_callback - ERROR - Error processing callback for node 69afc8fd275c8d3b7939b763: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:33:49,224 - lava_callback - INFO - Received callback for node 69afc948275c8d3b7939b76b INFO: 172.21.0.1:59732 - "POST /node/69afc948275c8d3b7939b76b HTTP/1.0" 202 Accepted 2026-03-12 07:33:49,229 - lava_callback - INFO - Starting async job submit for node 69afc948275c8d3b7939b76b 2026-03-12 07:33:49,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:33:49,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc948275c8d3b7939b76b HTTP/1.1" 200 None 2026-03-12 07:33:49,246 - lava_callback - DEBUG - Processing node 69afc948275c8d3b7939b76b: baseline-arm64-baylibre 2026-03-12 07:33:49,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc948275c8d3b7939b76b 2026-03-12 07:33:49,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:33:49,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc948275c8d3b7939b76b HTTP/1.1" 200 None 2026-03-12 07:33:49,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:33:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:33:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:33:49,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc948275c8d3b7939b76b HTTP/1.1" 200 None 2026-03-12 07:33:49,303 - lava_callback - ERROR - Error processing callback for node 69afc948275c8d3b7939b76b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:36:19,620 - lava_callback - INFO - Received callback for node 69afc9e7275c8d3b7939b782 INFO: 172.21.0.1:44268 - "POST /node/69afc9e7275c8d3b7939b782 HTTP/1.0" 202 Accepted 2026-03-12 07:36:19,625 - lava_callback - INFO - Starting async job submit for node 69afc9e7275c8d3b7939b782 2026-03-12 07:36:19,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:36:19,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc9e7275c8d3b7939b782 HTTP/1.1" 200 None 2026-03-12 07:36:19,652 - lava_callback - DEBUG - Processing node 69afc9e7275c8d3b7939b782: baseline-arm64-clabbe 2026-03-12 07:36:19,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc9e7275c8d3b7939b782 2026-03-12 07:36:19,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:36:19,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc9e7275c8d3b7939b782 HTTP/1.1" 200 None 2026-03-12 07:36:19,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:36:19,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:36:19,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:36:19,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc9e7275c8d3b7939b782 HTTP/1.1" 200 None 2026-03-12 07:36:19,711 - lava_callback - ERROR - Error processing callback for node 69afc9e7275c8d3b7939b782: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:37:39,674 - lava_callback - INFO - Received callback for node 69afca37275c8d3b7939b788 INFO: 172.21.0.1:38316 - "POST /node/69afca37275c8d3b7939b788 HTTP/1.0" 202 Accepted 2026-03-12 07:37:39,680 - lava_callback - INFO - Starting async job submit for node 69afca37275c8d3b7939b788 2026-03-12 07:37:39,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:37:39,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afca37275c8d3b7939b788 HTTP/1.1" 200 None 2026-03-12 07:37:39,696 - lava_callback - DEBUG - Processing node 69afca37275c8d3b7939b788: baseline-arm64-clabbe 2026-03-12 07:37:39,696 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afca37275c8d3b7939b788 2026-03-12 07:37:39,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:37:39,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afca37275c8d3b7939b788 HTTP/1.1" 200 None 2026-03-12 07:37:39,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:37:39,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:37:39,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:37:39,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afca37275c8d3b7939b788 HTTP/1.1" 200 None 2026-03-12 07:37:39,761 - lava_callback - ERROR - Error processing callback for node 69afca37275c8d3b7939b788: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET /node/6991f92801ff1e8e0859e1c8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:49:30,396 - lava_callback - INFO - Received callback for node 69afccfc275c8d3b7939b7a1 INFO: 172.21.0.1:54328 - "POST /node/69afccfc275c8d3b7939b7a1 HTTP/1.0" 202 Accepted 2026-03-12 07:49:30,402 - lava_callback - INFO - Starting async job submit for node 69afccfc275c8d3b7939b7a1 2026-03-12 07:49:30,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:49:30,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afccfc275c8d3b7939b7a1 HTTP/1.1" 200 None 2026-03-12 07:49:30,418 - lava_callback - DEBUG - Processing node 69afccfc275c8d3b7939b7a1: baseline-arm64-baylibre 2026-03-12 07:49:30,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afccfc275c8d3b7939b7a1 2026-03-12 07:49:30,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:49:30,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afccfc275c8d3b7939b7a1 HTTP/1.1" 200 None 2026-03-12 07:49:30,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:49:30,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:49:30,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:49:30,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afccfc275c8d3b7939b7a1 HTTP/1.1" 200 None 2026-03-12 07:49:30,491 - lava_callback - ERROR - Error processing callback for node 69afccfc275c8d3b7939b7a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:51:40,317 - lava_callback - INFO - Received callback for node 69afcd79275c8d3b7939b7b2 INFO: 172.21.0.1:44368 - "POST /node/69afcd79275c8d3b7939b7b2 HTTP/1.0" 202 Accepted 2026-03-12 07:51:40,322 - lava_callback - INFO - Starting async job submit for node 69afcd79275c8d3b7939b7b2 2026-03-12 07:51:40,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:51:40,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afcd79275c8d3b7939b7b2 HTTP/1.1" 200 None 2026-03-12 07:51:40,339 - lava_callback - DEBUG - Processing node 69afcd79275c8d3b7939b7b2: baseline-arm64-clabbe 2026-03-12 07:51:40,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afcd79275c8d3b7939b7b2 2026-03-12 07:51:40,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:51:40,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afcd79275c8d3b7939b7b2 HTTP/1.1" 200 None 2026-03-12 07:51:40,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:51:40,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:51:40,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:51:40,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afcd79275c8d3b7939b7b2 HTTP/1.1" 200 None 2026-03-12 07:51:40,390 - lava_callback - ERROR - Error processing callback for node 69afcd79275c8d3b7939b7b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:55:40,414 - lava_callback - INFO - Received callback for node 69afce6a275c8d3b7939b7bd INFO: 172.21.0.1:54444 - "POST /node/69afce6a275c8d3b7939b7bd HTTP/1.0" 202 Accepted 2026-03-12 07:55:40,420 - lava_callback - INFO - Starting async job submit for node 69afce6a275c8d3b7939b7bd 2026-03-12 07:55:40,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:55:40,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afce6a275c8d3b7939b7bd HTTP/1.1" 200 None 2026-03-12 07:55:40,459 - lava_callback - DEBUG - Processing node 69afce6a275c8d3b7939b7bd: baseline-arm64-clabbe 2026-03-12 07:55:40,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afce6a275c8d3b7939b7bd 2026-03-12 07:55:40,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:55:40,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afce6a275c8d3b7939b7bd HTTP/1.1" 200 None 2026-03-12 07:55:40,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:55:40,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:55:40,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:55:40,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afce6a275c8d3b7939b7bd HTTP/1.1" 200 None 2026-03-12 07:55:40,530 - lava_callback - ERROR - Error processing callback for node 69afce6a275c8d3b7939b7bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:54740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:16:26,258 - lava_callback - INFO - Received callback for node 69b1339ba870a1dc3343c387 2026-03-12 00:16:26,268 - lava_callback - INFO - Starting async job submit for node 69b1339ba870a1dc3343c387 INFO: 172.21.0.1:57672 - "POST /node/69b1339ba870a1dc3343c387 HTTP/1.0" 202 Accepted 2026-03-12 00:16:26,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:26,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1339ba870a1dc3343c387 HTTP/1.1" 200 None 2026-03-12 00:16:26,342 - lava_callback - DEBUG - Processing node 69b1339ba870a1dc3343c387: baseline-x86 INFO: 172.21.0.1:57684 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:16:26,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:16:26,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:16:26,842 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1339ba870a1dc3343c387/log.txt.gz 2026-03-12 00:16:27,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:16:27,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:16:27,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1339ba870a1dc3343c387/lava-logs.yaml 2026-03-12 00:16:27,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:16:27,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:16:27,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1339ba870a1dc3343c387/lava_callback.json.gz 2026-03-12 00:16:27,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:27,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1339ba870a1dc3343c387 HTTP/1.1" 200 None 2026-03-12 00:16:27,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:27,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-12 00:16:27,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:27,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1339ba870a1dc3343c387 HTTP/1.1" 200 None 2026-03-12 00:16:27,531 - lava_callback - INFO - Completed processing callback for node 69b1339ba870a1dc3343c387 INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:16:57,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:16:57,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:20:28,483 - lava_callback - INFO - Received callback for node 69b1c019a26b422765ba3f9e INFO: 172.21.0.1:34404 - "POST /node/69b1c019a26b422765ba3f9e HTTP/1.0" 202 Accepted 2026-03-12 00:20:28,489 - lava_callback - INFO - Starting async job submit for node 69b1c019a26b422765ba3f9e 2026-03-12 00:20:28,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:28,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c019a26b422765ba3f9e HTTP/1.1" 200 None 2026-03-12 00:20:28,551 - lava_callback - DEBUG - Processing node 69b1c019a26b422765ba3f9e: baseline-arm64-broonie 2026-03-12 00:20:28,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:20:29,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:20:29,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c019a26b422765ba3f9e/log.txt.gz 2026-03-12 00:20:29,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:20:29,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:20:29,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c019a26b422765ba3f9e/lava-logs.yaml 2026-03-12 00:20:29,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:20:29,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:20:29,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c019a26b422765ba3f9e/lava_callback.json.gz 2026-03-12 00:20:29,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:29,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c019a26b422765ba3f9e HTTP/1.1" 200 None 2026-03-12 00:20:29,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:29,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 00:20:29,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:29,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c019a26b422765ba3f9e HTTP/1.1" 200 None 2026-03-12 00:20:29,690 - lava_callback - INFO - Completed processing callback for node 69b1c019a26b422765ba3f9e INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:20:57,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:20:57,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:21:39,080 - lava_callback - INFO - Received callback for node 69b18c24a870a1dc3343d182 INFO: 172.21.0.1:55130 - "POST /node/69b18c24a870a1dc3343d182 HTTP/1.0" 202 Accepted 2026-03-12 00:21:39,086 - lava_callback - INFO - Starting async job submit for node 69b18c24a870a1dc3343d182 2026-03-12 00:21:39,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:39,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18c24a870a1dc3343d182 HTTP/1.1" 200 None 2026-03-12 00:21:39,137 - lava_callback - DEBUG - Processing node 69b18c24a870a1dc3343d182: baseline-x86 2026-03-12 00:21:39,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:21:39,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:21:39,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b18c24a870a1dc3343d182/log.txt.gz 2026-03-12 00:21:39,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:21:40,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:21:40,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b18c24a870a1dc3343d182/lava-logs.yaml 2026-03-12 00:21:40,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:21:40,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:21:40,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b18c24a870a1dc3343d182/lava_callback.json.gz 2026-03-12 00:21:40,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:40,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b18c24a870a1dc3343d182 HTTP/1.1" 200 None 2026-03-12 00:21:40,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:40,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-12 00:21:40,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:40,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b18c24a870a1dc3343d182 HTTP/1.1" 200 None 2026-03-12 00:21:40,488 - lava_callback - INFO - Completed processing callback for node 69b18c24a870a1dc3343d182 INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:21:57,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:21:57,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:25:05,484 - lava_callback - INFO - Received callback for node 69b1bec6a26b422765ba3e9a INFO: 172.21.0.1:59832 - "POST /node/69b1bec6a26b422765ba3e9a HTTP/1.0" 202 Accepted 2026-03-12 00:25:05,490 - lava_callback - INFO - Starting async job submit for node 69b1bec6a26b422765ba3e9a 2026-03-12 00:25:05,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:25:05,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec6a26b422765ba3e9a HTTP/1.1" 200 None 2026-03-12 00:25:05,526 - lava_callback - DEBUG - Processing node 69b1bec6a26b422765ba3e9a: baseline-x86 2026-03-12 00:25:05,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:25:05,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:25:05,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec6a26b422765ba3e9a/log.txt.gz 2026-03-12 00:25:06,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:25:06,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:25:06,357 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec6a26b422765ba3e9a/lava-logs.yaml 2026-03-12 00:25:06,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:25:06,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:25:06,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec6a26b422765ba3e9a/lava_callback.json.gz 2026-03-12 00:25:06,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:25:06,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec6a26b422765ba3e9a HTTP/1.1" 200 None 2026-03-12 00:25:06,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:25:06,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19625a26b422765ba3731 HTTP/1.1" 200 None 2026-03-12 00:25:06,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:25:06,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bec6a26b422765ba3e9a HTTP/1.1" 200 None 2026-03-12 00:25:06,579 - lava_callback - INFO - Completed processing callback for node 69b1bec6a26b422765ba3e9a INFO: 172.21.0.1:44902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:25:27,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:25:27,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:26:35,238 - lava_callback - INFO - Received callback for node 69b1e0e0a26b422765ba4841 INFO: 172.21.0.1:55818 - "POST /node/69b1e0e0a26b422765ba4841 HTTP/1.0" 202 Accepted 2026-03-12 00:26:35,244 - lava_callback - INFO - Starting async job submit for node 69b1e0e0a26b422765ba4841 2026-03-12 00:26:35,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:35,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e0e0a26b422765ba4841 HTTP/1.1" 200 None 2026-03-12 00:26:35,306 - lava_callback - DEBUG - Processing node 69b1e0e0a26b422765ba4841: baseline-x86 2026-03-12 00:26:35,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:26:35,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:26:35,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1e0e0a26b422765ba4841/log.txt.gz 2026-03-12 00:26:35,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:26:36,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:26:36,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1e0e0a26b422765ba4841/lava-logs.yaml 2026-03-12 00:26:36,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:26:36,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:26:36,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1e0e0a26b422765ba4841/lava_callback.json.gz 2026-03-12 00:26:36,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1e0e0a26b422765ba4841 HTTP/1.1" 200 None 2026-03-12 00:26:36,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:36,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-12 00:26:36,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:36,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1e0e0a26b422765ba4841 HTTP/1.1" 200 None 2026-03-12 00:26:36,484 - lava_callback - INFO - Completed processing callback for node 69b1e0e0a26b422765ba4841 INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:26:57,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:26:57,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:32:48,884 - lava_callback - INFO - Received callback for node 69b20930b0f5558b5d7cc9dd INFO: 172.21.0.1:49746 - "POST /node/69b20930b0f5558b5d7cc9dd HTTP/1.0" 202 Accepted 2026-03-12 00:32:48,890 - lava_callback - INFO - Starting async job submit for node 69b20930b0f5558b5d7cc9dd 2026-03-12 00:32:48,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:48,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20930b0f5558b5d7cc9dd HTTP/1.1" 200 None 2026-03-12 00:32:48,959 - lava_callback - DEBUG - Processing node 69b20930b0f5558b5d7cc9dd: baseline-arm 2026-03-12 00:32:49,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:32:49,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:32:49,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20930b0f5558b5d7cc9dd/log.txt.gz 2026-03-12 00:32:49,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:32:49,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:32:49,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20930b0f5558b5d7cc9dd/lava-logs.yaml 2026-03-12 00:32:49,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:32:49,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:32:49,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20930b0f5558b5d7cc9dd/lava_callback.json.gz 2026-03-12 00:32:49,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:49,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20930b0f5558b5d7cc9dd HTTP/1.1" 200 None 2026-03-12 00:32:49,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:49,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 00:32:49,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:49,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20930b0f5558b5d7cc9dd HTTP/1.1" 200 None 2026-03-12 00:32:49,902 - lava_callback - INFO - Completed processing callback for node 69b20930b0f5558b5d7cc9dd INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:32:57,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:32:57,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:36:46,848 - lava_callback - INFO - Received callback for node 69af678e275c8d3b79399e26 INFO: 172.21.0.1:52836 - "POST /node/69af678e275c8d3b79399e26 HTTP/1.0" 202 Accepted 2026-03-12 00:36:46,855 - lava_callback - INFO - Starting async job submit for node 69af678e275c8d3b79399e26 2026-03-12 00:36:46,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:46,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af678e275c8d3b79399e26 HTTP/1.1" 200 None 2026-03-12 00:36:46,929 - lava_callback - DEBUG - Processing node 69af678e275c8d3b79399e26: baseline-arm-baylibre 2026-03-12 00:36:46,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af678e275c8d3b79399e26 2026-03-12 00:36:46,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:46,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af678e275c8d3b79399e26 HTTP/1.1" 200 None 2026-03-12 00:36:46,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:46,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:46,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:46,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af678e275c8d3b79399e26 HTTP/1.1" 200 None 2026-03-12 00:36:47,001 - lava_callback - ERROR - Error processing callback for node 69af678e275c8d3b79399e26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:47,523 - lava_callback - INFO - Received callback for node 69af678f275c8d3b79399e29 INFO: 172.21.0.1:52838 - "POST /node/69af678f275c8d3b79399e29 HTTP/1.0" 202 Accepted 2026-03-12 00:36:47,529 - lava_callback - INFO - Starting async job submit for node 69af678f275c8d3b79399e29 2026-03-12 00:36:47,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:47,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af678f275c8d3b79399e29 HTTP/1.1" 200 None 2026-03-12 00:36:47,545 - lava_callback - DEBUG - Processing node 69af678f275c8d3b79399e29: baseline-arm-baylibre 2026-03-12 00:36:47,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af678f275c8d3b79399e29 2026-03-12 00:36:47,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:47,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af678f275c8d3b79399e29 HTTP/1.1" 200 None 2026-03-12 00:36:47,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:47,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:47,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:47,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af678f275c8d3b79399e29 HTTP/1.1" 200 None 2026-03-12 00:36:47,604 - lava_callback - ERROR - Error processing callback for node 69af678f275c8d3b79399e29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:48,194 - lava_callback - INFO - Received callback for node 69af6790275c8d3b79399e2c INFO: 172.21.0.1:52852 - "POST /node/69af6790275c8d3b79399e2c HTTP/1.0" 202 Accepted 2026-03-12 00:36:48,199 - lava_callback - INFO - Starting async job submit for node 69af6790275c8d3b79399e2c 2026-03-12 00:36:48,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6790275c8d3b79399e2c HTTP/1.1" 200 None 2026-03-12 00:36:48,215 - lava_callback - DEBUG - Processing node 69af6790275c8d3b79399e2c: baseline-arm-baylibre 2026-03-12 00:36:48,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6790275c8d3b79399e2c 2026-03-12 00:36:48,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6790275c8d3b79399e2c HTTP/1.1" 200 None 2026-03-12 00:36:48,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:48,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6790275c8d3b79399e2c HTTP/1.1" 200 None 2026-03-12 00:36:48,272 - lava_callback - ERROR - Error processing callback for node 69af6790275c8d3b79399e2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:48,860 - lava_callback - INFO - Received callback for node 69af6792275c8d3b79399e2f INFO: 172.21.0.1:52868 - "POST /node/69af6792275c8d3b79399e2f HTTP/1.0" 202 Accepted 2026-03-12 00:36:48,866 - lava_callback - INFO - Starting async job submit for node 69af6792275c8d3b79399e2f 2026-03-12 00:36:48,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6792275c8d3b79399e2f HTTP/1.1" 200 None 2026-03-12 00:36:48,882 - lava_callback - DEBUG - Processing node 69af6792275c8d3b79399e2f: baseline-arm-baylibre 2026-03-12 00:36:48,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6792275c8d3b79399e2f 2026-03-12 00:36:48,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6792275c8d3b79399e2f HTTP/1.1" 200 None 2026-03-12 00:36:48,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:48,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:48,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6792275c8d3b79399e2f HTTP/1.1" 200 None 2026-03-12 00:36:48,945 - lava_callback - ERROR - Error processing callback for node 69af6792275c8d3b79399e2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:49,548 - lava_callback - INFO - Received callback for node 69af6794275c8d3b79399e3f INFO: 172.21.0.1:52870 - "POST /node/69af6794275c8d3b79399e3f HTTP/1.0" 202 Accepted 2026-03-12 00:36:49,554 - lava_callback - INFO - Starting async job submit for node 69af6794275c8d3b79399e3f 2026-03-12 00:36:49,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:49,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6794275c8d3b79399e3f HTTP/1.1" 200 None 2026-03-12 00:36:49,570 - lava_callback - DEBUG - Processing node 69af6794275c8d3b79399e3f: baseline-arm-baylibre 2026-03-12 00:36:49,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6794275c8d3b79399e3f 2026-03-12 00:36:49,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:49,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6794275c8d3b79399e3f HTTP/1.1" 200 None 2026-03-12 00:36:49,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:49,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:49,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:49,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6794275c8d3b79399e3f HTTP/1.1" 200 None 2026-03-12 00:36:49,631 - lava_callback - ERROR - Error processing callback for node 69af6794275c8d3b79399e3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:36:50,210 - lava_callback - INFO - Received callback for node 69af6796275c8d3b79399e42 INFO: 172.21.0.1:52222 - "POST /node/69af6796275c8d3b79399e42 HTTP/1.0" 202 Accepted 2026-03-12 00:36:50,215 - lava_callback - INFO - Starting async job submit for node 69af6796275c8d3b79399e42 2026-03-12 00:36:50,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:50,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6796275c8d3b79399e42 HTTP/1.1" 200 None 2026-03-12 00:36:50,231 - lava_callback - DEBUG - Processing node 69af6796275c8d3b79399e42: baseline-arm-baylibre 2026-03-12 00:36:50,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6796275c8d3b79399e42 2026-03-12 00:36:50,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:50,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6796275c8d3b79399e42 HTTP/1.1" 200 None 2026-03-12 00:36:50,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:50,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:36:50,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:36:50,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6796275c8d3b79399e42 HTTP/1.1" 200 None 2026-03-12 00:36:50,307 - lava_callback - ERROR - Error processing callback for node 69af6796275c8d3b79399e42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:37:01,990 - lava_callback - INFO - Received callback for node 69af679f275c8d3b79399e72 INFO: 172.21.0.1:47322 - "POST /node/69af679f275c8d3b79399e72 HTTP/1.0" 202 Accepted 2026-03-12 00:37:01,995 - lava_callback - INFO - Starting async job submit for node 69af679f275c8d3b79399e72 2026-03-12 00:37:01,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af679f275c8d3b79399e72 HTTP/1.1" 200 None 2026-03-12 00:37:02,012 - lava_callback - DEBUG - Processing node 69af679f275c8d3b79399e72: baseline-arm-clabbe 2026-03-12 00:37:02,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af679f275c8d3b79399e72 2026-03-12 00:37:02,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af679f275c8d3b79399e72 HTTP/1.1" 200 None 2026-03-12 00:37:02,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:02,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af679f275c8d3b79399e72 HTTP/1.1" 200 None 2026-03-12 00:37:02,063 - lava_callback - ERROR - Error processing callback for node 69af679f275c8d3b79399e72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:37:02,651 - lava_callback - INFO - Received callback for node 69af67a3275c8d3b79399e80 INFO: 172.21.0.1:47332 - "POST /node/69af67a3275c8d3b79399e80 HTTP/1.0" 202 Accepted 2026-03-12 00:37:02,656 - lava_callback - INFO - Starting async job submit for node 69af67a3275c8d3b79399e80 2026-03-12 00:37:02,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a3275c8d3b79399e80 HTTP/1.1" 200 None 2026-03-12 00:37:02,672 - lava_callback - DEBUG - Processing node 69af67a3275c8d3b79399e80: baseline-arm-clabbe 2026-03-12 00:37:02,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af67a3275c8d3b79399e80 2026-03-12 00:37:02,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a3275c8d3b79399e80 HTTP/1.1" 200 None 2026-03-12 00:37:02,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:02,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:02,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af67a3275c8d3b79399e80 HTTP/1.1" 200 None 2026-03-12 00:37:02,723 - lava_callback - ERROR - Error processing callback for node 69af67a3275c8d3b79399e80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:37:03,310 - lava_callback - INFO - Received callback for node 69af67a4275c8d3b79399e83 INFO: 172.21.0.1:47342 - "POST /node/69af67a4275c8d3b79399e83 HTTP/1.0" 202 Accepted 2026-03-12 00:37:03,316 - lava_callback - INFO - Starting async job submit for node 69af67a4275c8d3b79399e83 2026-03-12 00:37:03,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a4275c8d3b79399e83 HTTP/1.1" 200 None 2026-03-12 00:37:03,333 - lava_callback - DEBUG - Processing node 69af67a4275c8d3b79399e83: baseline-arm-clabbe 2026-03-12 00:37:03,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af67a4275c8d3b79399e83 2026-03-12 00:37:03,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a4275c8d3b79399e83 HTTP/1.1" 200 None 2026-03-12 00:37:03,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:03,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af67a4275c8d3b79399e83 HTTP/1.1" 200 None 2026-03-12 00:37:03,394 - lava_callback - ERROR - Error processing callback for node 69af67a4275c8d3b79399e83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:37:03,968 - lava_callback - INFO - Received callback for node 69af67a5275c8d3b79399e86 INFO: 172.21.0.1:47352 - "POST /node/69af67a5275c8d3b79399e86 HTTP/1.0" 202 Accepted 2026-03-12 00:37:03,973 - lava_callback - INFO - Starting async job submit for node 69af67a5275c8d3b79399e86 2026-03-12 00:37:03,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:03,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a5275c8d3b79399e86 HTTP/1.1" 200 None 2026-03-12 00:37:03,989 - lava_callback - DEBUG - Processing node 69af67a5275c8d3b79399e86: baseline-arm-clabbe 2026-03-12 00:37:03,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af67a5275c8d3b79399e86 2026-03-12 00:37:03,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a5275c8d3b79399e86 HTTP/1.1" 200 None 2026-03-12 00:37:04,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:04,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af67a5275c8d3b79399e86 HTTP/1.1" 200 None 2026-03-12 00:37:04,045 - lava_callback - ERROR - Error processing callback for node 69af67a5275c8d3b79399e86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:37:04,636 - lava_callback - INFO - Received callback for node 69af67a8275c8d3b79399e8f INFO: 172.21.0.1:47362 - "POST /node/69af67a8275c8d3b79399e8f HTTP/1.0" 202 Accepted 2026-03-12 00:37:04,641 - lava_callback - INFO - Starting async job submit for node 69af67a8275c8d3b79399e8f 2026-03-12 00:37:04,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a8275c8d3b79399e8f HTTP/1.1" 200 None 2026-03-12 00:37:04,661 - lava_callback - DEBUG - Processing node 69af67a8275c8d3b79399e8f: baseline-arm-clabbe 2026-03-12 00:37:04,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af67a8275c8d3b79399e8f 2026-03-12 00:37:04,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af67a8275c8d3b79399e8f HTTP/1.1" 200 None 2026-03-12 00:37:04,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 00:37:04,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:37:04,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af67a8275c8d3b79399e8f HTTP/1.1" 200 None 2026-03-12 00:37:04,714 - lava_callback - ERROR - Error processing callback for node 69af67a8275c8d3b79399e8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46408 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:43:42,187 - lava_callback - INFO - Received callback for node 69af6930275c8d3b79399fe7 INFO: 172.21.0.1:44188 - "POST /node/69af6930275c8d3b79399fe7 HTTP/1.0" 202 Accepted 2026-03-12 00:43:42,193 - lava_callback - INFO - Starting async job submit for node 69af6930275c8d3b79399fe7 2026-03-12 00:43:42,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:43:42,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6930275c8d3b79399fe7 HTTP/1.1" 200 None 2026-03-12 00:43:42,217 - lava_callback - DEBUG - Processing node 69af6930275c8d3b79399fe7: baseline-arm-clabbe 2026-03-12 00:43:42,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6930275c8d3b79399fe7 2026-03-12 00:43:42,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:43:42,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6930275c8d3b79399fe7 HTTP/1.1" 200 None 2026-03-12 00:43:42,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:43:42,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 00:43:42,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:43:42,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6930275c8d3b79399fe7 HTTP/1.1" 200 None 2026-03-12 00:43:42,276 - lava_callback - ERROR - Error processing callback for node 69af6930275c8d3b79399fe7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:45:02,176 - lava_callback - INFO - Received callback for node 69af6983275c8d3b7939a003 INFO: 172.21.0.1:60764 - "POST /node/69af6983275c8d3b7939a003 HTTP/1.0" 202 Accepted 2026-03-12 00:45:02,182 - lava_callback - INFO - Starting async job submit for node 69af6983275c8d3b7939a003 2026-03-12 00:45:02,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:45:02,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6983275c8d3b7939a003 HTTP/1.1" 200 None 2026-03-12 00:45:02,207 - lava_callback - DEBUG - Processing node 69af6983275c8d3b7939a003: baseline-arm-clabbe 2026-03-12 00:45:02,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6983275c8d3b7939a003 2026-03-12 00:45:02,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:45:02,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6983275c8d3b7939a003 HTTP/1.1" 200 None 2026-03-12 00:45:02,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:45:02,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 00:45:02,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:45:02,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6983275c8d3b7939a003 HTTP/1.1" 200 None 2026-03-12 00:45:02,297 - lava_callback - ERROR - Error processing callback for node 69af6983275c8d3b7939a003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:46:22,324 - lava_callback - INFO - Received callback for node 69af69d5275c8d3b7939a3bd INFO: 172.21.0.1:44390 - "POST /node/69af69d5275c8d3b7939a3bd HTTP/1.0" 202 Accepted 2026-03-12 00:46:22,330 - lava_callback - INFO - Starting async job submit for node 69af69d5275c8d3b7939a3bd 2026-03-12 00:46:22,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:46:22,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af69d5275c8d3b7939a3bd HTTP/1.1" 200 None 2026-03-12 00:46:22,347 - lava_callback - DEBUG - Processing node 69af69d5275c8d3b7939a3bd: baseline-arm-clabbe 2026-03-12 00:46:22,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af69d5275c8d3b7939a3bd 2026-03-12 00:46:22,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:46:22,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af69d5275c8d3b7939a3bd HTTP/1.1" 200 None 2026-03-12 00:46:22,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:46:22,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 00:46:22,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:46:22,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af69d5275c8d3b7939a3bd HTTP/1.1" 200 None 2026-03-12 00:46:22,399 - lava_callback - ERROR - Error processing callback for node 69af69d5275c8d3b7939a3bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:50:37,273 - lava_callback - INFO - Received callback for node 69b20dc9b0f5558b5d7ccab5 INFO: 172.21.0.1:60460 - "POST /node/69b20dc9b0f5558b5d7ccab5 HTTP/1.0" 202 Accepted 2026-03-12 00:50:37,279 - lava_callback - INFO - Starting async job submit for node 69b20dc9b0f5558b5d7ccab5 2026-03-12 00:50:37,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:37,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc9b0f5558b5d7ccab5 HTTP/1.1" 200 None 2026-03-12 00:50:37,297 - lava_callback - DEBUG - Processing node 69b20dc9b0f5558b5d7ccab5: baseline-arm 2026-03-12 00:50:37,302 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:50:37,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:37,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:37,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc9b0f5558b5d7ccab5/lava-logs.yaml 2026-03-12 00:50:37,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:37,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:37,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc9b0f5558b5d7ccab5/lava_callback.json.gz 2026-03-12 00:50:37,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:37,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc9b0f5558b5d7ccab5 HTTP/1.1" 200 None 2026-03-12 00:50:37,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:37,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:50:37,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:37,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dc9b0f5558b5d7ccab5 HTTP/1.1" 200 None 2026-03-12 00:50:37,621 - lava_callback - INFO - Completed processing callback for node 69b20dc9b0f5558b5d7ccab5 INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38542 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:50:47,082 - lava_callback - INFO - Received callback for node 69b20dc8b0f5558b5d7ccab2 INFO: 172.21.0.1:38554 - "POST /node/69b20dc8b0f5558b5d7ccab2 HTTP/1.0" 202 Accepted 2026-03-12 00:50:47,088 - lava_callback - INFO - Starting async job submit for node 69b20dc8b0f5558b5d7ccab2 2026-03-12 00:50:47,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:47,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc8b0f5558b5d7ccab2 HTTP/1.1" 200 None 2026-03-12 00:50:47,110 - lava_callback - DEBUG - Processing node 69b20dc8b0f5558b5d7ccab2: baseline-arm 2026-03-12 00:50:47,115 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:50:47,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:47,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:47,240 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc8b0f5558b5d7ccab2/lava-logs.yaml 2026-03-12 00:50:47,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:47,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:47,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc8b0f5558b5d7ccab2/lava_callback.json.gz 2026-03-12 00:50:47,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:47,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc8b0f5558b5d7ccab2 HTTP/1.1" 200 None 2026-03-12 00:50:47,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:47,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:50:47,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:47,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dc8b0f5558b5d7ccab2 HTTP/1.1" 200 None 2026-03-12 00:50:47,468 - lava_callback - INFO - Completed processing callback for node 69b20dc8b0f5558b5d7ccab2 2026-03-12 00:50:50,518 - lava_callback - INFO - Received callback for node 69b20932b0f5558b5d7cc9e0 INFO: 172.21.0.1:43212 - "POST /node/69b20932b0f5558b5d7cc9e0 HTTP/1.0" 202 Accepted 2026-03-12 00:50:50,525 - lava_callback - INFO - Starting async job submit for node 69b20932b0f5558b5d7cc9e0 2026-03-12 00:50:50,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:50,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20932b0f5558b5d7cc9e0 HTTP/1.1" 200 None 2026-03-12 00:50:50,647 - lava_callback - DEBUG - Processing node 69b20932b0f5558b5d7cc9e0: ltp-smoke 2026-03-12 00:50:51,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:51,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:51,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20932b0f5558b5d7cc9e0/log.txt.gz 2026-03-12 00:50:51,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:51,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:51,873 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20932b0f5558b5d7cc9e0/lava-logs.yaml 2026-03-12 00:50:51,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:50:52,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:50:52,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20932b0f5558b5d7cc9e0/lava_callback.json.gz 2026-03-12 00:50:52,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:52,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20932b0f5558b5d7cc9e0 HTTP/1.1" 200 None 2026-03-12 00:50:52,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:52,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 00:50:52,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:52,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20932b0f5558b5d7cc9e0 HTTP/1.1" 200 None 2026-03-12 00:50:52,499 - lava_callback - INFO - Completed processing callback for node 69b20932b0f5558b5d7cc9e0 INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:50:57,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:50:57,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:07,954 - lava_callback - INFO - Received callback for node 69af6af2275c8d3b7939a412 INFO: 172.21.0.1:58704 - "POST /node/69af6af2275c8d3b7939a412 HTTP/1.0" 202 Accepted 2026-03-12 00:51:07,959 - lava_callback - INFO - Starting async job submit for node 69af6af2275c8d3b7939a412 2026-03-12 00:51:07,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:07,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6af2275c8d3b7939a412 HTTP/1.1" 200 None 2026-03-12 00:51:07,976 - lava_callback - DEBUG - Processing node 69af6af2275c8d3b7939a412: baseline-arm-baylibre 2026-03-12 00:51:07,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6af2275c8d3b7939a412 2026-03-12 00:51:07,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6af2275c8d3b7939a412 HTTP/1.1" 200 None 2026-03-12 00:51:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:08,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:51:08,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:08,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6af2275c8d3b7939a412 HTTP/1.1" 200 None 2026-03-12 00:51:08,034 - lava_callback - ERROR - Error processing callback for node 69af6af2275c8d3b7939a412: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:51:10,277 - lava_callback - INFO - Received callback for node 69b20dccb0f5558b5d7ccabe INFO: 172.21.0.1:60340 - "POST /node/69b20dccb0f5558b5d7ccabe HTTP/1.0" 202 Accepted 2026-03-12 00:51:10,326 - lava_callback - INFO - Starting async job submit for node 69b20dccb0f5558b5d7ccabe 2026-03-12 00:51:10,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:10,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dccb0f5558b5d7ccabe HTTP/1.1" 200 None 2026-03-12 00:51:10,359 - lava_callback - DEBUG - Processing node 69b20dccb0f5558b5d7ccabe: baseline-arm 2026-03-12 00:51:10,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:10,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:10,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dccb0f5558b5d7ccabe/log.txt.gz 2026-03-12 00:51:10,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:10,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:10,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dccb0f5558b5d7ccabe/lava-logs.yaml 2026-03-12 00:51:10,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:10,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:10,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dccb0f5558b5d7ccabe/lava_callback.json.gz 2026-03-12 00:51:11,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:11,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dccb0f5558b5d7ccabe HTTP/1.1" 200 None 2026-03-12 00:51:11,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:11,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:51:11,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:11,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dccb0f5558b5d7ccabe HTTP/1.1" 200 None 2026-03-12 00:51:11,122 - lava_callback - INFO - Completed processing callback for node 69b20dccb0f5558b5d7ccabe INFO: 172.21.0.1:60352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:27,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:40,866 - lava_callback - INFO - Received callback for node 69b20dcbb0f5558b5d7ccabb INFO: 172.21.0.1:56466 - "POST /node/69b20dcbb0f5558b5d7ccabb HTTP/1.0" 202 Accepted 2026-03-12 00:51:40,872 - lava_callback - INFO - Starting async job submit for node 69b20dcbb0f5558b5d7ccabb 2026-03-12 00:51:40,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:40,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcbb0f5558b5d7ccabb HTTP/1.1" 200 None 2026-03-12 00:51:40,908 - lava_callback - DEBUG - Processing node 69b20dcbb0f5558b5d7ccabb: baseline-arm 2026-03-12 00:51:41,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:41,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:41,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcbb0f5558b5d7ccabb/log.txt.gz 2026-03-12 00:51:41,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:41,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:41,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcbb0f5558b5d7ccabb/lava-logs.yaml 2026-03-12 00:51:41,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:41,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:41,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcbb0f5558b5d7ccabb/lava_callback.json.gz 2026-03-12 00:51:41,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:41,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcbb0f5558b5d7ccabb HTTP/1.1" 200 None 2026-03-12 00:51:41,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:41,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:51:41,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:41,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dcbb0f5558b5d7ccabb HTTP/1.1" 200 None 2026-03-12 00:51:41,911 - lava_callback - INFO - Completed processing callback for node 69b20dcbb0f5558b5d7ccabb INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:50,339 - lava_callback - INFO - Received callback for node 69b20dc7b0f5558b5d7ccaaf INFO: 172.21.0.1:42662 - "POST /node/69b20dc7b0f5558b5d7ccaaf HTTP/1.0" 202 Accepted 2026-03-12 00:51:50,346 - lava_callback - INFO - Starting async job submit for node 69b20dc7b0f5558b5d7ccaaf 2026-03-12 00:51:50,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:50,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc7b0f5558b5d7ccaaf HTTP/1.1" 200 None 2026-03-12 00:51:50,443 - lava_callback - DEBUG - Processing node 69b20dc7b0f5558b5d7ccaaf: baseline-arm 2026-03-12 00:51:50,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:50,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:50,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc7b0f5558b5d7ccaaf/log.txt.gz 2026-03-12 00:51:50,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:51,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:51,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc7b0f5558b5d7ccaaf/lava-logs.yaml 2026-03-12 00:51:51,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:51:51,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:51:51,321 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dc7b0f5558b5d7ccaaf/lava_callback.json.gz 2026-03-12 00:51:51,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:51,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dc7b0f5558b5d7ccaaf HTTP/1.1" 200 None 2026-03-12 00:51:51,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:51,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:51:51,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:51,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dc7b0f5558b5d7ccaaf HTTP/1.1" 200 None 2026-03-12 00:51:51,463 - lava_callback - INFO - Completed processing callback for node 69b20dc7b0f5558b5d7ccaaf INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:51:57,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:51:57,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:52:03,683 - lava_callback - INFO - Received callback for node 69b20df0b0f5558b5d7ccb4e INFO: 172.21.0.1:38972 - "POST /node/69b20df0b0f5558b5d7ccb4e HTTP/1.0" 202 Accepted 2026-03-12 00:52:03,729 - lava_callback - INFO - Starting async job submit for node 69b20df0b0f5558b5d7ccb4e 2026-03-12 00:52:03,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:03,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20df0b0f5558b5d7ccb4e HTTP/1.1" 200 None 2026-03-12 00:52:03,768 - lava_callback - DEBUG - Processing node 69b20df0b0f5558b5d7ccb4e: baseline-arm-pengutronix 2026-03-12 00:52:03,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:04,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:04,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20df0b0f5558b5d7ccb4e/log.txt.gz 2026-03-12 00:52:04,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:04,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:04,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20df0b0f5558b5d7ccb4e/lava-logs.yaml 2026-03-12 00:52:04,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:04,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:04,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20df0b0f5558b5d7ccb4e/lava_callback.json.gz 2026-03-12 00:52:04,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:04,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20df0b0f5558b5d7ccb4e HTTP/1.1" 200 None 2026-03-12 00:52:04,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:04,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:04,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:04,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20df0b0f5558b5d7ccb4e HTTP/1.1" 200 None 2026-03-12 00:52:04,562 - lava_callback - INFO - Completed processing callback for node 69b20df0b0f5558b5d7ccb4e INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:08,773 - lava_callback - INFO - Received callback for node 69b20dedb0f5558b5d7ccb48 INFO: 172.21.0.1:38996 - "POST /node/69b20dedb0f5558b5d7ccb48 HTTP/1.0" 202 Accepted 2026-03-12 00:52:08,780 - lava_callback - INFO - Starting async job submit for node 69b20dedb0f5558b5d7ccb48 2026-03-12 00:52:08,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:08,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dedb0f5558b5d7ccb48 HTTP/1.1" 200 None 2026-03-12 00:52:08,822 - lava_callback - DEBUG - Processing node 69b20dedb0f5558b5d7ccb48: baseline-arm-pengutronix 2026-03-12 00:52:08,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:09,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:09,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20dedb0f5558b5d7ccb48/log.txt.gz 2026-03-12 00:52:09,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:09,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:09,536 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20dedb0f5558b5d7ccb48/lava-logs.yaml 2026-03-12 00:52:09,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:09,680 - lava_callback - INFO - Received callback for node 69b20ddcb0f5558b5d7ccae7 2026-03-12 00:52:09,691 - lava_callback - INFO - Starting async job submit for node 69b20ddcb0f5558b5d7ccae7 INFO: 172.21.0.1:39006 - "POST /node/69b20ddcb0f5558b5d7ccae7 HTTP/1.0" 202 Accepted 2026-03-12 00:52:09,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:09,757 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20dedb0f5558b5d7ccb48/lava_callback.json.gz 2026-03-12 00:52:09,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:09,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:09,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddcb0f5558b5d7ccae7 HTTP/1.1" 200 None 2026-03-12 00:52:09,884 - lava_callback - DEBUG - Processing node 69b20ddcb0f5558b5d7ccae7: baseline-arm-broonie 2026-03-12 00:52:09,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dedb0f5558b5d7ccb48 HTTP/1.1" 200 None 2026-03-12 00:52:09,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:10,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:10,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dedb0f5558b5d7ccb48 HTTP/1.1" 200 None 2026-03-12 00:52:10,210 - lava_callback - INFO - Completed processing callback for node 69b20dedb0f5558b5d7ccb48 2026-03-12 00:52:10,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:10,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:10,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddcb0f5558b5d7ccae7/log.txt.gz 2026-03-12 00:52:10,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:11,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:11,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddcb0f5558b5d7ccae7/lava-logs.yaml 2026-03-12 00:52:11,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:11,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:11,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddcb0f5558b5d7ccae7/lava_callback.json.gz 2026-03-12 00:52:11,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:11,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddcb0f5558b5d7ccae7 HTTP/1.1" 200 None 2026-03-12 00:52:11,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:11,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:11,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:11,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ddcb0f5558b5d7ccae7 HTTP/1.1" 200 None 2026-03-12 00:52:11,409 - lava_callback - INFO - Completed processing callback for node 69b20ddcb0f5558b5d7ccae7 2026-03-12 00:52:14,830 - lava_callback - INFO - Received callback for node 69b20ddeb0f5558b5d7ccaec INFO: 172.21.0.1:39146 - "POST /node/69b20ddeb0f5558b5d7ccaec HTTP/1.0" 202 Accepted 2026-03-12 00:52:14,838 - lava_callback - INFO - Starting async job submit for node 69b20ddeb0f5558b5d7ccaec 2026-03-12 00:52:14,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:14,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddeb0f5558b5d7ccaec HTTP/1.1" 200 None 2026-03-12 00:52:14,889 - lava_callback - DEBUG - Processing node 69b20ddeb0f5558b5d7ccaec: baseline-arm-broonie INFO: 172.21.0.1:39160 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 00:52:15,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:15,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:15,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddeb0f5558b5d7ccaec/log.txt.gz 2026-03-12 00:52:15,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:15,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:15,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddeb0f5558b5d7ccaec/lava-logs.yaml 2026-03-12 00:52:15,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:16,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:16,025 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddeb0f5558b5d7ccaec/lava_callback.json.gz 2026-03-12 00:52:16,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:16,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddeb0f5558b5d7ccaec HTTP/1.1" 200 None 2026-03-12 00:52:16,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:16,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:16,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:16,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ddeb0f5558b5d7ccaec HTTP/1.1" 200 None 2026-03-12 00:52:16,143 - lava_callback - INFO - Completed processing callback for node 69b20ddeb0f5558b5d7ccaec INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:25,149 - lava_callback - INFO - Received callback for node 69b20e37b0f5558b5d7ccc44 INFO: 172.21.0.1:58530 - "POST /node/69b20e37b0f5558b5d7ccc44 HTTP/1.0" 202 Accepted 2026-03-12 00:52:25,155 - lava_callback - INFO - Starting async job submit for node 69b20e37b0f5558b5d7ccc44 2026-03-12 00:52:25,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:25,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e37b0f5558b5d7ccc44 HTTP/1.1" 200 None 2026-03-12 00:52:25,172 - lava_callback - DEBUG - Processing node 69b20e37b0f5558b5d7ccc44: baseline-nfs-arm64 2026-03-12 00:52:25,174 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:52:25,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:25,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:25,393 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e37b0f5558b5d7ccc44/lava-logs.yaml 2026-03-12 00:52:25,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:25,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:25,526 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e37b0f5558b5d7ccc44/lava_callback.json.gz 2026-03-12 00:52:25,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:25,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e37b0f5558b5d7ccc44 HTTP/1.1" 200 None 2026-03-12 00:52:25,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:25,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:25,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:25,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e37b0f5558b5d7ccc44 HTTP/1.1" 200 None 2026-03-12 00:52:25,604 - lava_callback - INFO - Completed processing callback for node 69b20e37b0f5558b5d7ccc44 INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:27,621 - lava_callback - INFO - Received callback for node 69af6b42275c8d3b7939a42d INFO: 172.21.0.1:58550 - "POST /node/69af6b42275c8d3b7939a42d HTTP/1.0" 202 Accepted 2026-03-12 00:52:27,630 - lava_callback - INFO - Starting async job submit for node 69af6b42275c8d3b7939a42d 2026-03-12 00:52:27,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6b42275c8d3b7939a42d HTTP/1.1" 200 None 2026-03-12 00:52:27,657 - lava_callback - DEBUG - Processing node 69af6b42275c8d3b7939a42d: baseline-arm-baylibre 2026-03-12 00:52:27,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6b42275c8d3b7939a42d 2026-03-12 00:52:27,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6b42275c8d3b7939a42d HTTP/1.1" 200 None 2026-03-12 00:52:27,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:52:27,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6b42275c8d3b7939a42d HTTP/1.1" 200 None 2026-03-12 00:52:27,724 - lava_callback - ERROR - Error processing callback for node 69af6b42275c8d3b7939a42d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:52:27,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:27,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:52:30,043 - lava_callback - INFO - Received callback for node 69b20ddbb0f5558b5d7ccae4 INFO: 172.21.0.1:55676 - "POST /node/69b20ddbb0f5558b5d7ccae4 HTTP/1.0" 202 Accepted 2026-03-12 00:52:30,049 - lava_callback - INFO - Starting async job submit for node 69b20ddbb0f5558b5d7ccae4 2026-03-12 00:52:30,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:30,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddbb0f5558b5d7ccae4 HTTP/1.1" 200 None 2026-03-12 00:52:30,098 - lava_callback - DEBUG - Processing node 69b20ddbb0f5558b5d7ccae4: baseline-arm-broonie 2026-03-12 00:52:30,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:30,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:30,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddbb0f5558b5d7ccae4/log.txt.gz 2026-03-12 00:52:30,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:30,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:30,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddbb0f5558b5d7ccae4/lava-logs.yaml 2026-03-12 00:52:30,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:31,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:31,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddbb0f5558b5d7ccae4/lava_callback.json.gz 2026-03-12 00:52:31,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:31,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddbb0f5558b5d7ccae4 HTTP/1.1" 200 None 2026-03-12 00:52:31,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:31,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:31,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:31,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ddbb0f5558b5d7ccae4 HTTP/1.1" 200 None 2026-03-12 00:52:31,157 - lava_callback - INFO - Completed processing callback for node 69b20ddbb0f5558b5d7ccae4 2026-03-12 00:52:32,691 - lava_callback - INFO - Received callback for node 69b20de2b0f5558b5d7ccb1d INFO: 172.21.0.1:55678 - "POST /node/69b20de2b0f5558b5d7ccb1d HTTP/1.0" 202 Accepted 2026-03-12 00:52:32,697 - lava_callback - INFO - Starting async job submit for node 69b20de2b0f5558b5d7ccb1d 2026-03-12 00:52:32,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:32,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de2b0f5558b5d7ccb1d HTTP/1.1" 200 None 2026-03-12 00:52:32,743 - lava_callback - DEBUG - Processing node 69b20de2b0f5558b5d7ccb1d: baseline-arm-clabbe 2026-03-12 00:52:33,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:33,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:33,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de2b0f5558b5d7ccb1d/log.txt.gz 2026-03-12 00:52:33,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:33,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:33,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de2b0f5558b5d7ccb1d/lava-logs.yaml 2026-03-12 00:52:33,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:33,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:33,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de2b0f5558b5d7ccb1d/lava_callback.json.gz 2026-03-12 00:52:33,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:33,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de2b0f5558b5d7ccb1d HTTP/1.1" 200 None 2026-03-12 00:52:33,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:33,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:33,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:33,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de2b0f5558b5d7ccb1d HTTP/1.1" 200 None 2026-03-12 00:52:33,899 - lava_callback - INFO - Completed processing callback for node 69b20de2b0f5558b5d7ccb1d 2026-03-12 00:52:35,064 - lava_callback - INFO - Received callback for node 69b20ddab0f5558b5d7ccadd INFO: 172.21.0.1:55684 - "POST /node/69b20ddab0f5558b5d7ccadd HTTP/1.0" 202 Accepted 2026-03-12 00:52:35,070 - lava_callback - INFO - Starting async job submit for node 69b20ddab0f5558b5d7ccadd 2026-03-12 00:52:35,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:35,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddab0f5558b5d7ccadd HTTP/1.1" 200 None 2026-03-12 00:52:35,110 - lava_callback - DEBUG - Processing node 69b20ddab0f5558b5d7ccadd: baseline-arm-broonie 2026-03-12 00:52:35,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:35,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:35,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddab0f5558b5d7ccadd/log.txt.gz 2026-03-12 00:52:35,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:35,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:35,827 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddab0f5558b5d7ccadd/lava-logs.yaml 2026-03-12 00:52:35,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:36,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:36,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b20ddab0f5558b5d7ccadd/lava_callback.json.gz 2026-03-12 00:52:36,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:36,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20ddab0f5558b5d7ccadd HTTP/1.1" 200 None 2026-03-12 00:52:36,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:36,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:36,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:36,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20ddab0f5558b5d7ccadd HTTP/1.1" 200 None 2026-03-12 00:52:36,119 - lava_callback - INFO - Completed processing callback for node 69b20ddab0f5558b5d7ccadd INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:38,454 - lava_callback - INFO - Received callback for node 69b20deab0f5558b5d7ccb38 INFO: 172.21.0.1:55716 - "POST /node/69b20deab0f5558b5d7ccb38 HTTP/1.0" 202 Accepted 2026-03-12 00:52:38,461 - lava_callback - INFO - Starting async job submit for node 69b20deab0f5558b5d7ccb38 2026-03-12 00:52:38,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:38,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20deab0f5558b5d7ccb38 HTTP/1.1" 200 None 2026-03-12 00:52:38,504 - lava_callback - DEBUG - Processing node 69b20deab0f5558b5d7ccb38: baseline-arm-kontron 2026-03-12 00:52:38,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:38,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:38,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b20deab0f5558b5d7ccb38/log.txt.gz 2026-03-12 00:52:38,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:39,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:39,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b20deab0f5558b5d7ccb38/lava-logs.yaml 2026-03-12 00:52:39,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:39,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:39,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b20deab0f5558b5d7ccb38/lava_callback.json.gz 2026-03-12 00:52:39,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:39,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20deab0f5558b5d7ccb38 HTTP/1.1" 200 None 2026-03-12 00:52:39,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:39,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:52:39,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:39,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20deab0f5558b5d7ccb38 HTTP/1.1" 200 None 2026-03-12 00:52:39,988 - lava_callback - INFO - Completed processing callback for node 69b20deab0f5558b5d7ccb38 2026-03-12 00:52:40,022 - lava_callback - INFO - Received callback for node 69b20e1ab0f5558b5d7ccbc8 INFO: 172.21.0.1:50776 - "POST /node/69b20e1ab0f5558b5d7ccbc8 HTTP/1.0" 202 Accepted 2026-03-12 00:52:40,034 - lava_callback - INFO - Starting async job submit for node 69b20e1ab0f5558b5d7ccbc8 2026-03-12 00:52:40,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:40,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1ab0f5558b5d7ccbc8 HTTP/1.1" 200 None 2026-03-12 00:52:40,110 - lava_callback - DEBUG - Processing node 69b20e1ab0f5558b5d7ccbc8: baseline-arm64 2026-03-12 00:52:40,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:40,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:40,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1ab0f5558b5d7ccbc8/log.txt.gz 2026-03-12 00:52:40,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:41,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:41,017 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1ab0f5558b5d7ccbc8/lava-logs.yaml 2026-03-12 00:52:41,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:41,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:41,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1ab0f5558b5d7ccbc8/lava_callback.json.gz 2026-03-12 00:52:41,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:41,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1ab0f5558b5d7ccbc8 HTTP/1.1" 200 None 2026-03-12 00:52:41,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:41,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:41,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:41,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1ab0f5558b5d7ccbc8 HTTP/1.1" 200 None 2026-03-12 00:52:41,339 - lava_callback - INFO - Completed processing callback for node 69b20e1ab0f5558b5d7ccbc8 2026-03-12 00:52:42,608 - lava_callback - INFO - Received callback for node 69b20e26b0f5558b5d7ccc0f INFO: 172.21.0.1:50782 - "POST /node/69b20e26b0f5558b5d7ccc0f HTTP/1.0" 202 Accepted 2026-03-12 00:52:42,615 - lava_callback - INFO - Starting async job submit for node 69b20e26b0f5558b5d7ccc0f 2026-03-12 00:52:42,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:42,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e26b0f5558b5d7ccc0f HTTP/1.1" 200 None 2026-03-12 00:52:42,648 - lava_callback - DEBUG - Processing node 69b20e26b0f5558b5d7ccc0f: baseline-arm64 2026-03-12 00:52:42,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:42,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:42,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e26b0f5558b5d7ccc0f/log.txt.gz 2026-03-12 00:52:43,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:43,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:43,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e26b0f5558b5d7ccc0f/lava-logs.yaml 2026-03-12 00:52:43,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:43,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:43,343 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e26b0f5558b5d7ccc0f/lava_callback.json.gz 2026-03-12 00:52:43,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:43,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e26b0f5558b5d7ccc0f HTTP/1.1" 200 None 2026-03-12 00:52:43,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:43,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:43,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:43,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e26b0f5558b5d7ccc0f HTTP/1.1" 200 None 2026-03-12 00:52:43,481 - lava_callback - INFO - Completed processing callback for node 69b20e26b0f5558b5d7ccc0f INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:50,393 - lava_callback - INFO - Received callback for node 69b20e23b0f5558b5d7ccc02 INFO: 172.21.0.1:59208 - "POST /node/69b20e23b0f5558b5d7ccc02 HTTP/1.0" 202 Accepted 2026-03-12 00:52:50,405 - lava_callback - INFO - Starting async job submit for node 69b20e23b0f5558b5d7ccc02 2026-03-12 00:52:50,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:50,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e23b0f5558b5d7ccc02 HTTP/1.1" 200 None 2026-03-12 00:52:50,470 - lava_callback - DEBUG - Processing node 69b20e23b0f5558b5d7ccc02: baseline-arm64 2026-03-12 00:52:50,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:51,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:51,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e23b0f5558b5d7ccc02/log.txt.gz 2026-03-12 00:52:51,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:51,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:51,602 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e23b0f5558b5d7ccc02/lava-logs.yaml 2026-03-12 00:52:51,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:51,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:51,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e23b0f5558b5d7ccc02/lava_callback.json.gz 2026-03-12 00:52:51,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:51,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e23b0f5558b5d7ccc02 HTTP/1.1" 200 None 2026-03-12 00:52:51,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:51,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:51,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:51,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e23b0f5558b5d7ccc02 HTTP/1.1" 200 None 2026-03-12 00:52:51,843 - lava_callback - INFO - Completed processing callback for node 69b20e23b0f5558b5d7ccc02 2026-03-12 00:52:56,482 - lava_callback - INFO - Received callback for node 69b20e1fb0f5558b5d7ccbf9 INFO: 172.21.0.1:59214 - "POST /node/69b20e1fb0f5558b5d7ccbf9 HTTP/1.0" 202 Accepted 2026-03-12 00:52:56,490 - lava_callback - INFO - Starting async job submit for node 69b20e1fb0f5558b5d7ccbf9 2026-03-12 00:52:56,511 - lava_callback - INFO - Received callback for node 69b20e1cb0f5558b5d7ccbce INFO: 172.21.0.1:59230 - "POST /node/69b20e1cb0f5558b5d7ccbce HTTP/1.0" 202 Accepted INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:52:56,533 - lava_callback - INFO - Starting async job submit for node 69b20e1cb0f5558b5d7ccbce 2026-03-12 00:52:56,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:56,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:56,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1fb0f5558b5d7ccbf9 HTTP/1.1" 200 None 2026-03-12 00:52:56,586 - lava_callback - DEBUG - Processing node 69b20e1fb0f5558b5d7ccbf9: baseline-arm64 2026-03-12 00:52:56,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1cb0f5558b5d7ccbce HTTP/1.1" 200 None 2026-03-12 00:52:56,608 - lava_callback - DEBUG - Processing node 69b20e1cb0f5558b5d7ccbce: baseline-arm64 2026-03-12 00:52:56,946 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:52:57,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:57,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1fb0f5558b5d7ccbf9/lava-logs.yaml 2026-03-12 00:52:57,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:57,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbce/log.txt.gz 2026-03-12 00:52:57,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:57,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1fb0f5558b5d7ccbf9/lava_callback.json.gz 2026-03-12 00:52:57,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:57,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1fb0f5558b5d7ccbf9 HTTP/1.1" 200 None 2026-03-12 00:52:57,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:57,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:57,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:57,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1fb0f5558b5d7ccbf9 HTTP/1.1" 200 None 2026-03-12 00:52:57,763 - lava_callback - INFO - Completed processing callback for node 69b20e1fb0f5558b5d7ccbf9 2026-03-12 00:52:57,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:57,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbce/lava-logs.yaml 2026-03-12 00:52:57,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:57,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:57,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:52:58,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:58,079 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbce/lava_callback.json.gz 2026-03-12 00:52:58,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:58,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1cb0f5558b5d7ccbce HTTP/1.1" 200 None 2026-03-12 00:52:58,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:58,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:58,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:58,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1cb0f5558b5d7ccbce HTTP/1.1" 200 None 2026-03-12 00:52:58,196 - lava_callback - INFO - Completed processing callback for node 69b20e1cb0f5558b5d7ccbce 2026-03-12 00:52:58,577 - lava_callback - INFO - Received callback for node 69b20e24b0f5558b5d7ccc05 INFO: 172.21.0.1:59250 - "POST /node/69b20e24b0f5558b5d7ccc05 HTTP/1.0" 202 Accepted 2026-03-12 00:52:58,589 - lava_callback - INFO - Starting async job submit for node 69b20e24b0f5558b5d7ccc05 2026-03-12 00:52:58,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:58,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e24b0f5558b5d7ccc05 HTTP/1.1" 200 None 2026-03-12 00:52:58,653 - lava_callback - DEBUG - Processing node 69b20e24b0f5558b5d7ccc05: baseline-arm64 2026-03-12 00:52:59,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:59,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:59,162 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e24b0f5558b5d7ccc05/log.txt.gz 2026-03-12 00:52:59,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:59,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:59,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e24b0f5558b5d7ccc05/lava-logs.yaml 2026-03-12 00:52:59,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:52:59,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:52:59,732 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e24b0f5558b5d7ccc05/lava_callback.json.gz 2026-03-12 00:52:59,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:59,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e24b0f5558b5d7ccc05 HTTP/1.1" 200 None 2026-03-12 00:52:59,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:59,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:52:59,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:52:59,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e24b0f5558b5d7ccc05 HTTP/1.1" 200 None 2026-03-12 00:52:59,837 - lava_callback - INFO - Completed processing callback for node 69b20e24b0f5558b5d7ccc05 2026-03-12 00:53:00,424 - lava_callback - INFO - Received callback for node 69b20e46b0f5558b5d7ccc96 INFO: 172.21.0.1:40378 - "POST /node/69b20e46b0f5558b5d7ccc96 HTTP/1.0" 202 Accepted 2026-03-12 00:53:00,477 - lava_callback - INFO - Starting async job submit for node 69b20e46b0f5558b5d7ccc96 2026-03-12 00:53:00,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:00,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e46b0f5558b5d7ccc96 HTTP/1.1" 200 None 2026-03-12 00:53:00,524 - lava_callback - DEBUG - Processing node 69b20e46b0f5558b5d7ccc96: baseline-arm 2026-03-12 00:53:00,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:00,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:00,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e46b0f5558b5d7ccc96/log.txt.gz 2026-03-12 00:53:00,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:01,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:01,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e46b0f5558b5d7ccc96/lava-logs.yaml 2026-03-12 00:53:01,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:01,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:01,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e46b0f5558b5d7ccc96/lava_callback.json.gz 2026-03-12 00:53:01,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:01,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e46b0f5558b5d7ccc96 HTTP/1.1" 200 None 2026-03-12 00:53:01,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:01,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:53:01,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:01,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e46b0f5558b5d7ccc96 HTTP/1.1" 200 None 2026-03-12 00:53:01,285 - lava_callback - INFO - Completed processing callback for node 69b20e46b0f5558b5d7ccc96 2026-03-12 00:53:03,404 - lava_callback - INFO - Received callback for node 69b20e21b0f5558b5d7ccbff INFO: 172.21.0.1:40382 - "POST /node/69b20e21b0f5558b5d7ccbff HTTP/1.0" 202 Accepted 2026-03-12 00:53:03,410 - lava_callback - INFO - Starting async job submit for node 69b20e21b0f5558b5d7ccbff 2026-03-12 00:53:03,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:03,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e21b0f5558b5d7ccbff HTTP/1.1" 200 None 2026-03-12 00:53:03,450 - lava_callback - DEBUG - Processing node 69b20e21b0f5558b5d7ccbff: baseline-arm64 2026-03-12 00:53:03,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:03,760 - lava_callback - INFO - Received callback for node 69b20e25b0f5558b5d7ccc08 INFO: 172.21.0.1:40398 - "POST /node/69b20e25b0f5558b5d7ccc08 HTTP/1.0" 202 Accepted 2026-03-12 00:53:03,770 - lava_callback - INFO - Starting async job submit for node 69b20e25b0f5558b5d7ccc08 2026-03-12 00:53:03,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:03,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e25b0f5558b5d7ccc08 HTTP/1.1" 200 None 2026-03-12 00:53:03,809 - lava_callback - DEBUG - Processing node 69b20e25b0f5558b5d7ccc08: baseline-arm64 2026-03-12 00:53:03,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:03,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e21b0f5558b5d7ccbff/log.txt.gz 2026-03-12 00:53:04,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:04,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:04,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:04,729 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e21b0f5558b5d7ccbff/lava-logs.yaml 2026-03-12 00:53:04,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:04,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:04,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e25b0f5558b5d7ccc08/log.txt.gz 2026-03-12 00:53:04,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:04,929 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e21b0f5558b5d7ccbff/lava_callback.json.gz 2026-03-12 00:53:05,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e21b0f5558b5d7ccbff HTTP/1.1" 200 None 2026-03-12 00:53:05,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:05,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:05,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e21b0f5558b5d7ccbff HTTP/1.1" 200 None 2026-03-12 00:53:05,266 - lava_callback - INFO - Completed processing callback for node 69b20e21b0f5558b5d7ccbff 2026-03-12 00:53:05,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:05,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e25b0f5558b5d7ccc08/lava-logs.yaml 2026-03-12 00:53:05,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:05,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:05,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e25b0f5558b5d7ccc08/lava_callback.json.gz 2026-03-12 00:53:05,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e25b0f5558b5d7ccc08 HTTP/1.1" 200 None 2026-03-12 00:53:05,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:05,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:05,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e25b0f5558b5d7ccc08 HTTP/1.1" 200 None 2026-03-12 00:53:05,863 - lava_callback - INFO - Completed processing callback for node 69b20e25b0f5558b5d7ccc08 INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:07,387 - lava_callback - INFO - Received callback for node 69b20e1eb0f5558b5d7ccbf6 INFO: 172.21.0.1:40410 - "POST /node/69b20e1eb0f5558b5d7ccbf6 HTTP/1.0" 202 Accepted 2026-03-12 00:53:07,394 - lava_callback - INFO - Starting async job submit for node 69b20e1eb0f5558b5d7ccbf6 2026-03-12 00:53:07,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:07,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1eb0f5558b5d7ccbf6 HTTP/1.1" 200 None 2026-03-12 00:53:07,446 - lava_callback - DEBUG - Processing node 69b20e1eb0f5558b5d7ccbf6: baseline-arm64 2026-03-12 00:53:07,587 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:53:07,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:07,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:07,814 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1eb0f5558b5d7ccbf6/lava-logs.yaml 2026-03-12 00:53:07,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:07,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:07,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1eb0f5558b5d7ccbf6/lava_callback.json.gz 2026-03-12 00:53:07,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:07,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1eb0f5558b5d7ccbf6 HTTP/1.1" 200 None 2026-03-12 00:53:07,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:08,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:08,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:08,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1eb0f5558b5d7ccbf6 HTTP/1.1" 200 None 2026-03-12 00:53:08,096 - lava_callback - INFO - Completed processing callback for node 69b20e1eb0f5558b5d7ccbf6 2026-03-12 00:53:09,811 - lava_callback - INFO - Received callback for node 69b20e48b0f5558b5d7ccc9c INFO: 172.21.0.1:46296 - "POST /node/69b20e48b0f5558b5d7ccc9c HTTP/1.0" 202 Accepted 2026-03-12 00:53:09,858 - lava_callback - INFO - Starting async job submit for node 69b20e48b0f5558b5d7ccc9c 2026-03-12 00:53:09,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:09,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e48b0f5558b5d7ccc9c HTTP/1.1" 200 None 2026-03-12 00:53:09,906 - lava_callback - DEBUG - Processing node 69b20e48b0f5558b5d7ccc9c: baseline-arm 2026-03-12 00:53:10,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:10,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:10,204 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e48b0f5558b5d7ccc9c/log.txt.gz 2026-03-12 00:53:10,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:10,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:10,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e48b0f5558b5d7ccc9c/lava-logs.yaml 2026-03-12 00:53:10,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:10,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:10,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e48b0f5558b5d7ccc9c/lava_callback.json.gz 2026-03-12 00:53:10,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:10,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e48b0f5558b5d7ccc9c HTTP/1.1" 200 None 2026-03-12 00:53:10,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:10,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:53:10,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:10,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e48b0f5558b5d7ccc9c HTTP/1.1" 200 None 2026-03-12 00:53:10,675 - lava_callback - INFO - Completed processing callback for node 69b20e48b0f5558b5d7ccc9c 2026-03-12 00:53:12,468 - lava_callback - INFO - Received callback for node 69b20e06b0f5558b5d7ccb8e INFO: 172.21.0.1:46312 - "POST /node/69b20e06b0f5558b5d7ccb8e HTTP/1.0" 202 Accepted 2026-03-12 00:53:12,475 - lava_callback - INFO - Starting async job submit for node 69b20e06b0f5558b5d7ccb8e 2026-03-12 00:53:12,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:12,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e06b0f5558b5d7ccb8e HTTP/1.1" 200 None 2026-03-12 00:53:12,521 - lava_callback - DEBUG - Processing node 69b20e06b0f5558b5d7ccb8e: ltp-dio 2026-03-12 00:53:12,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:13,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:13,148 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b20e06b0f5558b5d7ccb8e/log.txt.gz 2026-03-12 00:53:13,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:13,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:13,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b20e06b0f5558b5d7ccb8e/lava-logs.yaml 2026-03-12 00:53:13,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:13,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:13,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b20e06b0f5558b5d7ccb8e/lava_callback.json.gz 2026-03-12 00:53:13,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:13,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e06b0f5558b5d7ccb8e HTTP/1.1" 200 None 2026-03-12 00:53:13,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:13,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:53:13,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:13,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e06b0f5558b5d7ccb8e HTTP/1.1" 200 None 2026-03-12 00:53:13,924 - lava_callback - INFO - Completed processing callback for node 69b20e06b0f5558b5d7ccb8e INFO: 172.21.0.1:46320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:18,337 - lava_callback - INFO - Received callback for node 69b20e34b0f5558b5d7ccc3e INFO: 172.21.0.1:46338 - "POST /node/69b20e34b0f5558b5d7ccc3e HTTP/1.0" 202 Accepted 2026-03-12 00:53:18,348 - lava_callback - INFO - Starting async job submit for node 69b20e34b0f5558b5d7ccc3e 2026-03-12 00:53:18,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:18,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e34b0f5558b5d7ccc3e HTTP/1.1" 200 None 2026-03-12 00:53:18,419 - lava_callback - DEBUG - Processing node 69b20e34b0f5558b5d7ccc3e: baseline-nfs-arm64 2026-03-12 00:53:19,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:19,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:19,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e34b0f5558b5d7ccc3e/log.txt.gz 2026-03-12 00:53:19,710 - lava_callback - INFO - Received callback for node 69b20e2bb0f5558b5d7ccc1f INFO: 172.21.0.1:53160 - "POST /node/69b20e2bb0f5558b5d7ccc1f HTTP/1.0" 202 Accepted 2026-03-12 00:53:19,742 - lava_callback - INFO - Starting async job submit for node 69b20e2bb0f5558b5d7ccc1f 2026-03-12 00:53:19,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:19,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2bb0f5558b5d7ccc1f HTTP/1.1" 200 None 2026-03-12 00:53:19,914 - lava_callback - DEBUG - Processing node 69b20e2bb0f5558b5d7ccc1f: baseline-arm64 2026-03-12 00:53:20,375 - lava_callback - INFO - Received callback for node 69b20e36b0f5558b5d7ccc41 2026-03-12 00:53:20,435 - lava_callback - INFO - Starting async job submit for node 69b20e36b0f5558b5d7ccc41 INFO: 172.21.0.1:53164 - "POST /node/69b20e36b0f5558b5d7ccc41 HTTP/1.0" 202 Accepted 2026-03-12 00:53:20,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:20,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e36b0f5558b5d7ccc41 HTTP/1.1" 200 None 2026-03-12 00:53:20,673 - lava_callback - DEBUG - Processing node 69b20e36b0f5558b5d7ccc41: baseline-nfs-arm64 2026-03-12 00:53:20,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:20,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:21,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:21,261 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2bb0f5558b5d7ccc1f/log.txt.gz 2026-03-12 00:53:21,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:21,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e34b0f5558b5d7ccc3e/lava-logs.yaml 2026-03-12 00:53:21,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:21,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:22,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:22,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e34b0f5558b5d7ccc3e/lava_callback.json.gz 2026-03-12 00:53:22,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:22,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:22,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e34b0f5558b5d7ccc3e HTTP/1.1" 200 None 2026-03-12 00:53:22,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:22,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:22,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:22,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e34b0f5558b5d7ccc3e HTTP/1.1" 200 None 2026-03-12 00:53:22,359 - lava_callback - INFO - Completed processing callback for node 69b20e34b0f5558b5d7ccc3e 2026-03-12 00:53:22,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:22,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2bb0f5558b5d7ccc1f/lava-logs.yaml 2026-03-12 00:53:22,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:22,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:22,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e36b0f5558b5d7ccc41/log.txt.gz 2026-03-12 00:53:22,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:22,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2bb0f5558b5d7ccc1f/lava_callback.json.gz 2026-03-12 00:53:23,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:23,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2bb0f5558b5d7ccc1f HTTP/1.1" 200 None 2026-03-12 00:53:23,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:23,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:23,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:23,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2bb0f5558b5d7ccc1f HTTP/1.1" 200 None 2026-03-12 00:53:23,293 - lava_callback - INFO - Completed processing callback for node 69b20e2bb0f5558b5d7ccc1f 2026-03-12 00:53:23,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:24,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:24,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e36b0f5558b5d7ccc41/lava-logs.yaml 2026-03-12 00:53:24,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:24,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:24,980 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e36b0f5558b5d7ccc41/lava_callback.json.gz 2026-03-12 00:53:25,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:25,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e36b0f5558b5d7ccc41 HTTP/1.1" 200 None 2026-03-12 00:53:25,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:25,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:25,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:25,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e36b0f5558b5d7ccc41 HTTP/1.1" 200 None 2026-03-12 00:53:25,139 - lava_callback - INFO - Completed processing callback for node 69b20e36b0f5558b5d7ccc41 2026-03-12 00:53:25,772 - lava_callback - INFO - Received callback for node 69b20e1bb0f5558b5d7ccbcb INFO: 172.21.0.1:53176 - "POST /node/69b20e1bb0f5558b5d7ccbcb HTTP/1.0" 202 Accepted 2026-03-12 00:53:25,781 - lava_callback - INFO - Starting async job submit for node 69b20e1bb0f5558b5d7ccbcb 2026-03-12 00:53:25,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:25,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1bb0f5558b5d7ccbcb HTTP/1.1" 200 None 2026-03-12 00:53:25,851 - lava_callback - DEBUG - Processing node 69b20e1bb0f5558b5d7ccbcb: baseline-arm64 2026-03-12 00:53:26,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:26,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:26,540 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1bb0f5558b5d7ccbcb/log.txt.gz INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:26,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:27,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:27,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1bb0f5558b5d7ccbcb/lava-logs.yaml 2026-03-12 00:53:27,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:27,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:27,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1bb0f5558b5d7ccbcb/lava_callback.json.gz 2026-03-12 00:53:27,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:27,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:27,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1bb0f5558b5d7ccbcb HTTP/1.1" 200 None 2026-03-12 00:53:27,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:27,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:53:27,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:27,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:28,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1bb0f5558b5d7ccbcb HTTP/1.1" 200 None 2026-03-12 00:53:28,026 - lava_callback - INFO - Completed processing callback for node 69b20e1bb0f5558b5d7ccbcb 2026-03-12 00:53:33,119 - lava_callback - INFO - Received callback for node 69b20e27b0f5558b5d7ccc16 INFO: 172.21.0.1:33622 - "POST /node/69b20e27b0f5558b5d7ccc16 HTTP/1.0" 202 Accepted 2026-03-12 00:53:33,131 - lava_callback - INFO - Starting async job submit for node 69b20e27b0f5558b5d7ccc16 2026-03-12 00:53:33,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:33,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e27b0f5558b5d7ccc16 HTTP/1.1" 200 None 2026-03-12 00:53:33,206 - lava_callback - DEBUG - Processing node 69b20e27b0f5558b5d7ccc16: baseline-arm64 2026-03-12 00:53:33,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:33,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:33,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e27b0f5558b5d7ccc16/log.txt.gz 2026-03-12 00:53:34,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:34,305 - lava_callback - INFO - Received callback for node 69b20e3cb0f5558b5d7ccc7b INFO: 172.21.0.1:33634 - "POST /node/69b20e3cb0f5558b5d7ccc7b HTTP/1.0" 202 Accepted 2026-03-12 00:53:34,315 - lava_callback - INFO - Starting async job submit for node 69b20e3cb0f5558b5d7ccc7b 2026-03-12 00:53:34,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:34,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3cb0f5558b5d7ccc7b HTTP/1.1" 200 None 2026-03-12 00:53:34,428 - lava_callback - DEBUG - Processing node 69b20e3cb0f5558b5d7ccc7b: baseline-nfs-arm64 2026-03-12 00:53:34,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:34,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e27b0f5558b5d7ccc16/lava-logs.yaml 2026-03-12 00:53:34,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:35,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:35,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:35,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e27b0f5558b5d7ccc16/lava_callback.json.gz 2026-03-12 00:53:35,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:35,483 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3cb0f5558b5d7ccc7b/log.txt.gz 2026-03-12 00:53:35,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:35,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e27b0f5558b5d7ccc16 HTTP/1.1" 200 None 2026-03-12 00:53:35,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:35,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:35,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:35,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e27b0f5558b5d7ccc16 HTTP/1.1" 200 None 2026-03-12 00:53:35,744 - lava_callback - INFO - Completed processing callback for node 69b20e27b0f5558b5d7ccc16 2026-03-12 00:53:35,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:36,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:36,819 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3cb0f5558b5d7ccc7b/lava-logs.yaml 2026-03-12 00:53:36,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:37,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:37,293 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3cb0f5558b5d7ccc7b/lava_callback.json.gz 2026-03-12 00:53:37,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:37,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3cb0f5558b5d7ccc7b HTTP/1.1" 200 None 2026-03-12 00:53:37,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:37,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:37,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:37,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e3cb0f5558b5d7ccc7b HTTP/1.1" 200 None 2026-03-12 00:53:37,455 - lava_callback - INFO - Completed processing callback for node 69b20e3cb0f5558b5d7ccc7b 2026-03-12 00:53:45,512 - lava_callback - INFO - Received callback for node 69b20e2ab0f5558b5d7ccc1c INFO: 172.21.0.1:43210 - "POST /node/69b20e2ab0f5558b5d7ccc1c HTTP/1.0" 202 Accepted 2026-03-12 00:53:45,524 - lava_callback - INFO - Starting async job submit for node 69b20e2ab0f5558b5d7ccc1c 2026-03-12 00:53:45,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:45,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2ab0f5558b5d7ccc1c HTTP/1.1" 200 None 2026-03-12 00:53:45,593 - lava_callback - DEBUG - Processing node 69b20e2ab0f5558b5d7ccc1c: baseline-arm64 2026-03-12 00:53:45,811 - lava_callback - INFO - Received callback for node 69b20e61b0f5558b5d7ccd1c INFO: 172.21.0.1:43214 - "POST /node/69b20e61b0f5558b5d7ccd1c HTTP/1.0" 202 Accepted 2026-03-12 00:53:45,837 - lava_callback - INFO - Starting async job submit for node 69b20e61b0f5558b5d7ccd1c 2026-03-12 00:53:45,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:45,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e61b0f5558b5d7ccd1c HTTP/1.1" 200 None 2026-03-12 00:53:45,968 - lava_callback - DEBUG - Processing node 69b20e61b0f5558b5d7ccd1c: baseline-arm64-pengutronix 2026-03-12 00:53:46,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:46,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:46,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:46,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2ab0f5558b5d7ccc1c/log.txt.gz 2026-03-12 00:53:46,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:46,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e61b0f5558b5d7ccd1c/log.txt.gz 2026-03-12 00:53:47,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:47,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:47,682 - lava_callback - INFO - Received callback for node 69af6b98275c8d3b7939a440 INFO: 172.21.0.1:43240 - "POST /node/69af6b98275c8d3b7939a440 HTTP/1.0" 202 Accepted 2026-03-12 00:53:47,692 - lava_callback - INFO - Starting async job submit for node 69af6b98275c8d3b7939a440 2026-03-12 00:53:47,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:47,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6b98275c8d3b7939a440 HTTP/1.1" 200 None 2026-03-12 00:53:47,729 - lava_callback - DEBUG - Processing node 69af6b98275c8d3b7939a440: baseline-arm-baylibre 2026-03-12 00:53:47,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6b98275c8d3b7939a440 2026-03-12 00:53:47,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:47,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6b98275c8d3b7939a440 HTTP/1.1" 200 None 2026-03-12 00:53:47,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:47,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:53:47,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:47,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6b98275c8d3b7939a440 HTTP/1.1" 200 None 2026-03-12 00:53:47,853 - lava_callback - ERROR - Error processing callback for node 69af6b98275c8d3b7939a440: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:53:48,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:48,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e61b0f5558b5d7ccd1c/lava-logs.yaml 2026-03-12 00:53:48,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:48,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:48,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2ab0f5558b5d7ccc1c/lava-logs.yaml 2026-03-12 00:53:48,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:48,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:48,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e61b0f5558b5d7ccd1c/lava_callback.json.gz 2026-03-12 00:53:48,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:48,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2ab0f5558b5d7ccc1c/lava_callback.json.gz 2026-03-12 00:53:48,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e61b0f5558b5d7ccd1c HTTP/1.1" 200 None 2026-03-12 00:53:48,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2ab0f5558b5d7ccc1c HTTP/1.1" 200 None 2026-03-12 00:53:48,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:48,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:48,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e61b0f5558b5d7ccd1c HTTP/1.1" 200 None 2026-03-12 00:53:48,896 - lava_callback - INFO - Completed processing callback for node 69b20e61b0f5558b5d7ccd1c 2026-03-12 00:53:48,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2ab0f5558b5d7ccc1c HTTP/1.1" 200 None 2026-03-12 00:53:48,992 - lava_callback - INFO - Completed processing callback for node 69b20e2ab0f5558b5d7ccc1c 2026-03-12 00:53:50,756 - lava_callback - INFO - Received callback for node 69b20e4ab0f5558b5d7ccca5 INFO: 172.21.0.1:35306 - "POST /node/69b20e4ab0f5558b5d7ccca5 HTTP/1.0" 202 Accepted 2026-03-12 00:53:50,768 - lava_callback - INFO - Starting async job submit for node 69b20e4ab0f5558b5d7ccca5 2026-03-12 00:53:50,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:50,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4ab0f5558b5d7ccca5 HTTP/1.1" 200 None 2026-03-12 00:53:50,842 - lava_callback - DEBUG - Processing node 69b20e4ab0f5558b5d7ccca5: baseline-arm64-broonie 2026-03-12 00:53:51,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:51,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:51,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4ab0f5558b5d7ccca5/log.txt.gz 2026-03-12 00:53:51,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:52,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:52,631 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4ab0f5558b5d7ccca5/lava-logs.yaml 2026-03-12 00:53:52,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:53,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:53,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4ab0f5558b5d7ccca5/lava_callback.json.gz 2026-03-12 00:53:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:53,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4ab0f5558b5d7ccca5 HTTP/1.1" 200 None 2026-03-12 00:53:53,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:53,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:53:53,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:53,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e4ab0f5558b5d7ccca5 HTTP/1.1" 200 None 2026-03-12 00:53:53,247 - lava_callback - INFO - Completed processing callback for node 69b20e4ab0f5558b5d7ccca5 INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:53:57,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:58,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:53:58,830 - lava_callback - INFO - Received callback for node 69b20e65b0f5558b5d7ccd29 INFO: 172.21.0.1:35326 - "POST /node/69b20e65b0f5558b5d7ccd29 HTTP/1.0" 202 Accepted 2026-03-12 00:53:58,839 - lava_callback - INFO - Starting async job submit for node 69b20e65b0f5558b5d7ccd29 2026-03-12 00:53:58,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:58,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e65b0f5558b5d7ccd29 HTTP/1.1" 200 None 2026-03-12 00:53:58,912 - lava_callback - DEBUG - Processing node 69b20e65b0f5558b5d7ccd29: baseline-arm64-foundriesio 2026-03-12 00:53:58,961 - lava_callback - INFO - Received callback for node 69b20e92b0f5558b5d7ccdbf INFO: 172.21.0.1:35342 - "POST /node/69b20e92b0f5558b5d7ccdbf HTTP/1.0" 202 Accepted 2026-03-12 00:53:58,990 - lava_callback - INFO - Starting async job submit for node 69b20e92b0f5558b5d7ccdbf 2026-03-12 00:53:58,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:59,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e92b0f5558b5d7ccdbf HTTP/1.1" 200 None 2026-03-12 00:53:59,062 - lava_callback - DEBUG - Processing node 69b20e92b0f5558b5d7ccdbf: baseline-arm 2026-03-12 00:53:59,070 - lava_callback - WARNING - Failed to upload log 2026-03-12 00:53:59,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:59,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:59,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:59,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e92b0f5558b5d7ccdbf/lava-logs.yaml 2026-03-12 00:53:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:59,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:59,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e65b0f5558b5d7ccd29/log.txt.gz 2026-03-12 00:53:59,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:53:59,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:53:59,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20e92b0f5558b5d7ccdbf/lava_callback.json.gz 2026-03-12 00:53:59,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:53:59,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e92b0f5558b5d7ccdbf HTTP/1.1" 200 None 2026-03-12 00:53:59,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:00,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:54:00,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:00,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e92b0f5558b5d7ccdbf HTTP/1.1" 200 None 2026-03-12 00:54:00,075 - lava_callback - INFO - Completed processing callback for node 69b20e92b0f5558b5d7ccdbf 2026-03-12 00:54:00,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:00,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e65b0f5558b5d7ccd29/lava-logs.yaml 2026-03-12 00:54:00,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:00,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:00,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e65b0f5558b5d7ccd29/lava_callback.json.gz 2026-03-12 00:54:00,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:00,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e65b0f5558b5d7ccd29 HTTP/1.1" 200 None 2026-03-12 00:54:00,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:01,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:01,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:01,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e65b0f5558b5d7ccd29 HTTP/1.1" 200 None 2026-03-12 00:54:01,085 - lava_callback - INFO - Completed processing callback for node 69b20e65b0f5558b5d7ccd29 2026-03-12 00:54:03,240 - lava_callback - INFO - Received callback for node 69b20e2cb0f5558b5d7ccc22 INFO: 172.21.0.1:34164 - "POST /node/69b20e2cb0f5558b5d7ccc22 HTTP/1.0" 202 Accepted 2026-03-12 00:54:03,251 - lava_callback - INFO - Starting async job submit for node 69b20e2cb0f5558b5d7ccc22 2026-03-12 00:54:03,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:03,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2cb0f5558b5d7ccc22 HTTP/1.1" 200 None 2026-03-12 00:54:03,320 - lava_callback - DEBUG - Processing node 69b20e2cb0f5558b5d7ccc22: baseline-arm64 2026-03-12 00:54:03,854 - lava_callback - INFO - Received callback for node 69b20e63b0f5558b5d7ccd1f INFO: 172.21.0.1:34174 - "POST /node/69b20e63b0f5558b5d7ccd1f HTTP/1.0" 202 Accepted 2026-03-12 00:54:03,868 - lava_callback - INFO - Starting async job submit for node 69b20e63b0f5558b5d7ccd1f 2026-03-12 00:54:03,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:03,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:03,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e63b0f5558b5d7ccd1f HTTP/1.1" 200 None 2026-03-12 00:54:03,939 - lava_callback - DEBUG - Processing node 69b20e63b0f5558b5d7ccd1f: baseline-arm64-pengutronix 2026-03-12 00:54:04,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:04,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:04,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2cb0f5558b5d7ccc22/log.txt.gz 2026-03-12 00:54:04,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:04,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e63b0f5558b5d7ccd1f/log.txt.gz 2026-03-12 00:54:04,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:04,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:05,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:05,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2cb0f5558b5d7ccc22/lava-logs.yaml 2026-03-12 00:54:05,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:05,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:05,456 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e63b0f5558b5d7ccd1f/lava-logs.yaml 2026-03-12 00:54:05,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:05,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:05,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2cb0f5558b5d7ccc22/lava_callback.json.gz 2026-03-12 00:54:05,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:05,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e63b0f5558b5d7ccd1f/lava_callback.json.gz 2026-03-12 00:54:05,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:05,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2cb0f5558b5d7ccc22 HTTP/1.1" 200 None 2026-03-12 00:54:06,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e63b0f5558b5d7ccd1f HTTP/1.1" 200 None 2026-03-12 00:54:06,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:06,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:06,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:06,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e63b0f5558b5d7ccd1f HTTP/1.1" 200 None 2026-03-12 00:54:06,141 - lava_callback - INFO - Completed processing callback for node 69b20e63b0f5558b5d7ccd1f 2026-03-12 00:54:06,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2cb0f5558b5d7ccc22 HTTP/1.1" 200 None 2026-03-12 00:54:06,146 - lava_callback - INFO - Completed processing callback for node 69b20e2cb0f5558b5d7ccc22 INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:08,498 - lava_callback - INFO - Received callback for node 69b20e32b0f5558b5d7ccc34 INFO: 172.21.0.1:34188 - "POST /node/69b20e32b0f5558b5d7ccc34 HTTP/1.0" 202 Accepted 2026-03-12 00:54:08,509 - lava_callback - INFO - Starting async job submit for node 69b20e32b0f5558b5d7ccc34 2026-03-12 00:54:08,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:08,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e32b0f5558b5d7ccc34 HTTP/1.1" 200 None 2026-03-12 00:54:08,603 - lava_callback - DEBUG - Processing node 69b20e32b0f5558b5d7ccc34: baseline-nfs-arm64 2026-03-12 00:54:09,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:09,375 - lava_callback - INFO - Received callback for node 69b20e3eb0f5558b5d7ccc7e INFO: 172.21.0.1:34196 - "POST /node/69b20e3eb0f5558b5d7ccc7e HTTP/1.0" 202 Accepted 2026-03-12 00:54:09,393 - lava_callback - INFO - Starting async job submit for node 69b20e3eb0f5558b5d7ccc7e 2026-03-12 00:54:09,394 - lava_callback - INFO - Received callback for node 69b20e1cb0f5558b5d7ccbef INFO: 172.21.0.1:34208 - "POST /node/69b20e1cb0f5558b5d7ccbef HTTP/1.0" 202 Accepted 2026-03-12 00:54:09,410 - lava_callback - INFO - Starting async job submit for node 69b20e1cb0f5558b5d7ccbef 2026-03-12 00:54:09,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:09,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:09,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3eb0f5558b5d7ccc7e HTTP/1.1" 200 None 2026-03-12 00:54:09,543 - lava_callback - DEBUG - Processing node 69b20e3eb0f5558b5d7ccc7e: baseline-nfs-arm64 2026-03-12 00:54:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1cb0f5558b5d7ccbef HTTP/1.1" 200 None 2026-03-12 00:54:09,558 - lava_callback - DEBUG - Processing node 69b20e1cb0f5558b5d7ccbef: baseline-arm64 2026-03-12 00:54:09,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:09,705 - lava_callback - INFO - Received callback for node 69b20e53b0f5558b5d7ccccd 2026-03-12 00:54:09,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e32b0f5558b5d7ccc34/log.txt.gz 2026-03-12 00:54:09,737 - lava_callback - INFO - Starting async job submit for node 69b20e53b0f5558b5d7ccccd INFO: 172.21.0.1:56526 - "POST /node/69b20e53b0f5558b5d7ccccd HTTP/1.0" 202 Accepted 2026-03-12 00:54:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:10,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e53b0f5558b5d7ccccd HTTP/1.1" 200 None 2026-03-12 00:54:10,053 - lava_callback - DEBUG - Processing node 69b20e53b0f5558b5d7ccccd: baseline-arm64-broonie 2026-03-12 00:54:11,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:11,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:11,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:11,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:11,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:11,869 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbef/log.txt.gz 2026-03-12 00:54:11,942 - lava_callback - INFO - Received callback for node 69b20e3bb0f5558b5d7ccc74 2026-03-12 00:54:11,983 - lava_callback - INFO - Starting async job submit for node 69b20e3bb0f5558b5d7ccc74 INFO: 172.21.0.1:56540 - "POST /node/69b20e3bb0f5558b5d7ccc74 HTTP/1.0" 202 Accepted 2026-03-12 00:54:12,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:12,093 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e53b0f5558b5d7ccccd/log.txt.gz 2026-03-12 00:54:12,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:12,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:12,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e32b0f5558b5d7ccc34/lava-logs.yaml 2026-03-12 00:54:12,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:12,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3eb0f5558b5d7ccc7e/log.txt.gz 2026-03-12 00:54:12,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:12,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3bb0f5558b5d7ccc74 HTTP/1.1" 200 None 2026-03-12 00:54:12,368 - lava_callback - DEBUG - Processing node 69b20e3bb0f5558b5d7ccc74: baseline-nfs-arm64 2026-03-12 00:54:12,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:12,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:12,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e32b0f5558b5d7ccc34/lava_callback.json.gz 2026-03-12 00:54:13,116 - lava_callback - INFO - Received callback for node 69b20e64b0f5558b5d7ccd26 2026-03-12 00:54:13,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:13,158 - lava_callback - INFO - Starting async job submit for node 69b20e64b0f5558b5d7ccd26 INFO: 172.21.0.1:56550 - "POST /node/69b20e64b0f5558b5d7ccd26 HTTP/1.0" 202 Accepted 2026-03-12 00:54:13,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:13,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:13,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:13,313 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbef/lava-logs.yaml 2026-03-12 00:54:13,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e32b0f5558b5d7ccc34 HTTP/1.1" 200 None 2026-03-12 00:54:13,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:13,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:13,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e64b0f5558b5d7ccd26 HTTP/1.1" 200 None 2026-03-12 00:54:13,431 - lava_callback - DEBUG - Processing node 69b20e64b0f5558b5d7ccd26: baseline-arm64-pengutronix 2026-03-12 00:54:13,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:13,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:13,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e32b0f5558b5d7ccc34 HTTP/1.1" 200 None 2026-03-12 00:54:13,658 - lava_callback - INFO - Completed processing callback for node 69b20e32b0f5558b5d7ccc34 2026-03-12 00:54:13,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:14,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:14,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e1cb0f5558b5d7ccbef/lava_callback.json.gz 2026-03-12 00:54:14,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:14,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e53b0f5558b5d7ccccd/lava-logs.yaml 2026-03-12 00:54:14,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:14,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:14,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:14,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e1cb0f5558b5d7ccbef HTTP/1.1" 200 None 2026-03-12 00:54:14,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:14,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:14,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:14,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:14,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e1cb0f5558b5d7ccbef HTTP/1.1" 200 None 2026-03-12 00:54:14,536 - lava_callback - INFO - Completed processing callback for node 69b20e1cb0f5558b5d7ccbef 2026-03-12 00:54:14,964 - lava_callback - INFO - Received callback for node 69b20e57b0f5558b5d7cccd8 2026-03-12 00:54:14,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:14,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e53b0f5558b5d7ccccd/lava_callback.json.gz INFO: 172.21.0.1:56560 - "POST /node/69b20e57b0f5558b5d7cccd8 HTTP/1.0" 202 Accepted 2026-03-12 00:54:15,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:15,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:15,010 - lava_callback - INFO - Starting async job submit for node 69b20e57b0f5558b5d7cccd8 2026-03-12 00:54:15,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:15,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3eb0f5558b5d7ccc7e/lava-logs.yaml 2026-03-12 00:54:15,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3bb0f5558b5d7ccc74/log.txt.gz 2026-03-12 00:54:15,067 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e64b0f5558b5d7ccd26/log.txt.gz 2026-03-12 00:54:15,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56564 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 00:54:15,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:15,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:15,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e57b0f5558b5d7cccd8 HTTP/1.1" 200 None 2026-03-12 00:54:15,501 - lava_callback - DEBUG - Processing node 69b20e57b0f5558b5d7cccd8: baseline-arm64-broonie 2026-03-12 00:54:15,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e53b0f5558b5d7ccccd HTTP/1.1" 200 None 2026-03-12 00:54:15,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:15,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:15,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:15,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:15,860 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3eb0f5558b5d7ccc7e/lava_callback.json.gz 2026-03-12 00:54:15,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e53b0f5558b5d7ccccd HTTP/1.1" 200 None 2026-03-12 00:54:15,868 - lava_callback - INFO - Completed processing callback for node 69b20e53b0f5558b5d7ccccd 2026-03-12 00:54:15,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:16,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:16,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3eb0f5558b5d7ccc7e HTTP/1.1" 200 None 2026-03-12 00:54:16,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:16,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:16,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:16,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:16,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e3eb0f5558b5d7ccc7e HTTP/1.1" 200 None 2026-03-12 00:54:16,338 - lava_callback - INFO - Completed processing callback for node 69b20e3eb0f5558b5d7ccc7e INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:16,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:16,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:16,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e64b0f5558b5d7ccd26/lava-logs.yaml 2026-03-12 00:54:16,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:17,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,002 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e57b0f5558b5d7cccd8/log.txt.gz 2026-03-12 00:54:17,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3bb0f5558b5d7ccc74/lava-logs.yaml 2026-03-12 00:54:17,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:17,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b20e64b0f5558b5d7ccd26/lava_callback.json.gz 2026-03-12 00:54:17,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:17,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e64b0f5558b5d7ccd26 HTTP/1.1" 200 None 2026-03-12 00:54:17,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:17,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e64b0f5558b5d7ccd26 HTTP/1.1" 200 None 2026-03-12 00:54:17,481 - lava_callback - INFO - Completed processing callback for node 69b20e64b0f5558b5d7ccd26 2026-03-12 00:54:17,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e3bb0f5558b5d7ccc74/lava_callback.json.gz 2026-03-12 00:54:17,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e3bb0f5558b5d7ccc74 HTTP/1.1" 200 None 2026-03-12 00:54:17,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:17,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:17,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:17,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e57b0f5558b5d7cccd8/lava-logs.yaml 2026-03-12 00:54:17,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:17,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e3bb0f5558b5d7ccc74 HTTP/1.1" 200 None 2026-03-12 00:54:17,954 - lava_callback - INFO - Completed processing callback for node 69b20e3bb0f5558b5d7ccc74 2026-03-12 00:54:18,135 - lava_callback - INFO - Received callback for node 69b20e29b0f5558b5d7ccc19 INFO: 172.21.0.1:56576 - "POST /node/69b20e29b0f5558b5d7ccc19 HTTP/1.0" 202 Accepted 2026-03-12 00:54:18,150 - lava_callback - INFO - Starting async job submit for node 69b20e29b0f5558b5d7ccc19 2026-03-12 00:54:18,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:18,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e29b0f5558b5d7ccc19 HTTP/1.1" 200 None 2026-03-12 00:54:18,253 - lava_callback - DEBUG - Processing node 69b20e29b0f5558b5d7ccc19: baseline-arm64 2026-03-12 00:54:18,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:18,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e57b0f5558b5d7cccd8/lava_callback.json.gz 2026-03-12 00:54:18,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:18,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e57b0f5558b5d7cccd8 HTTP/1.1" 200 None 2026-03-12 00:54:18,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:18,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:18,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:18,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e57b0f5558b5d7cccd8 HTTP/1.1" 200 None 2026-03-12 00:54:18,770 - lava_callback - INFO - Completed processing callback for node 69b20e57b0f5558b5d7cccd8 2026-03-12 00:54:19,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:19,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:19,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e29b0f5558b5d7ccc19/log.txt.gz 2026-03-12 00:54:20,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:21,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:21,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e29b0f5558b5d7ccc19/lava-logs.yaml 2026-03-12 00:54:21,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:21,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:21,703 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e29b0f5558b5d7ccc19/lava_callback.json.gz 2026-03-12 00:54:21,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:21,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e29b0f5558b5d7ccc19 HTTP/1.1" 200 None 2026-03-12 00:54:21,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:21,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:21,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:21,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e29b0f5558b5d7ccc19 HTTP/1.1" 200 None 2026-03-12 00:54:21,863 - lava_callback - INFO - Completed processing callback for node 69b20e29b0f5558b5d7ccc19 2026-03-12 00:54:23,792 - lava_callback - INFO - Received callback for node 69b20de3b0f5558b5d7ccb21 INFO: 172.21.0.1:34796 - "POST /node/69b20de3b0f5558b5d7ccb21 HTTP/1.0" 202 Accepted 2026-03-12 00:54:23,801 - lava_callback - INFO - Starting async job submit for node 69b20de3b0f5558b5d7ccb21 2026-03-12 00:54:23,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:23,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de3b0f5558b5d7ccb21 HTTP/1.1" 200 None 2026-03-12 00:54:23,875 - lava_callback - DEBUG - Processing node 69b20de3b0f5558b5d7ccb21: baseline-arm-clabbe 2026-03-12 00:54:23,882 - lava_callback - INFO - Received callback for node 69b20e38b0f5558b5d7ccc47 INFO: 172.21.0.1:34800 - "POST /node/69b20e38b0f5558b5d7ccc47 HTTP/1.0" 202 Accepted 2026-03-12 00:54:23,902 - lava_callback - INFO - Starting async job submit for node 69b20e38b0f5558b5d7ccc47 2026-03-12 00:54:23,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:24,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e38b0f5558b5d7ccc47 HTTP/1.1" 200 None 2026-03-12 00:54:24,053 - lava_callback - DEBUG - Processing node 69b20e38b0f5558b5d7ccc47: baseline-nfs-arm64 2026-03-12 00:54:24,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:24,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:25,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:25,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de3b0f5558b5d7ccb21/log.txt.gz 2026-03-12 00:54:25,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:25,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e38b0f5558b5d7ccc47/log.txt.gz 2026-03-12 00:54:25,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:25,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:26,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:26,087 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de3b0f5558b5d7ccb21/lava-logs.yaml 2026-03-12 00:54:26,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:26,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:26,358 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e38b0f5558b5d7ccc47/lava-logs.yaml 2026-03-12 00:54:26,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:26,469 - lava_callback - INFO - Received callback for node 69b20e67b0f5558b5d7ccd2c INFO: 172.21.0.1:34810 - "POST /node/69b20e67b0f5558b5d7ccd2c HTTP/1.0" 202 Accepted 2026-03-12 00:54:26,482 - lava_callback - INFO - Starting async job submit for node 69b20e67b0f5558b5d7ccd2c 2026-03-12 00:54:26,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:26,535 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de3b0f5558b5d7ccb21/lava_callback.json.gz 2026-03-12 00:54:26,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:26,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:26,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e67b0f5558b5d7ccd2c HTTP/1.1" 200 None 2026-03-12 00:54:26,609 - lava_callback - DEBUG - Processing node 69b20e67b0f5558b5d7ccd2c: baseline-arm64-foundriesio 2026-03-12 00:54:26,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de3b0f5558b5d7ccb21 HTTP/1.1" 200 None 2026-03-12 00:54:26,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:26,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:54:26,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:26,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de3b0f5558b5d7ccb21 HTTP/1.1" 200 None 2026-03-12 00:54:26,766 - lava_callback - INFO - Completed processing callback for node 69b20de3b0f5558b5d7ccb21 2026-03-12 00:54:27,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:27,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e38b0f5558b5d7ccc47/lava_callback.json.gz 2026-03-12 00:54:27,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:27,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e38b0f5558b5d7ccc47 HTTP/1.1" 200 None 2026-03-12 00:54:27,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:27,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:27,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:27,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e38b0f5558b5d7ccc47 HTTP/1.1" 200 None 2026-03-12 00:54:27,394 - lava_callback - INFO - Completed processing callback for node 69b20e38b0f5558b5d7ccc47 2026-03-12 00:54:27,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:27,836 - lava_callback - INFO - Received callback for node 69b20e2fb0f5558b5d7ccc2e INFO: 172.21.0.1:34828 - "POST /node/69b20e2fb0f5558b5d7ccc2e HTTP/1.0" 202 Accepted 2026-03-12 00:54:27,860 - lava_callback - INFO - Starting async job submit for node 69b20e2fb0f5558b5d7ccc2e 2026-03-12 00:54:27,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:27,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2fb0f5558b5d7ccc2e HTTP/1.1" 200 None 2026-03-12 00:54:27,962 - lava_callback - DEBUG - Processing node 69b20e2fb0f5558b5d7ccc2e: baseline-nfs-arm64 2026-03-12 00:54:28,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:28,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-12 00:54:28,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:28,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e67b0f5558b5d7ccd2c/log.txt.gz 2026-03-12 00:54:28,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:29,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:29,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e2fb0f5558b5d7ccc2e/log.txt.gz 2026-03-12 00:54:29,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:29,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:29,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e67b0f5558b5d7ccd2c/lava-logs.yaml 2026-03-12 00:54:29,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:30,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:30,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e2fb0f5558b5d7ccc2e/lava-logs.yaml 2026-03-12 00:54:30,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:30,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:30,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b20e67b0f5558b5d7ccd2c/lava_callback.json.gz 2026-03-12 00:54:30,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:30,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e67b0f5558b5d7ccd2c HTTP/1.1" 200 None 2026-03-12 00:54:30,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:30,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:30,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:30,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e67b0f5558b5d7ccd2c HTTP/1.1" 200 None 2026-03-12 00:54:30,647 - lava_callback - INFO - Completed processing callback for node 69b20e67b0f5558b5d7ccd2c 2026-03-12 00:54:31,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:31,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e2fb0f5558b5d7ccc2e/lava_callback.json.gz 2026-03-12 00:54:31,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:31,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2fb0f5558b5d7ccc2e HTTP/1.1" 200 None 2026-03-12 00:54:31,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:31,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:31,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:31,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2fb0f5558b5d7ccc2e HTTP/1.1" 200 None 2026-03-12 00:54:31,226 - lava_callback - INFO - Completed processing callback for node 69b20e2fb0f5558b5d7ccc2e 2026-03-12 00:54:34,900 - lava_callback - INFO - Received callback for node 69b20e51b0f5558b5d7cccc3 INFO: 172.21.0.1:48798 - "POST /node/69b20e51b0f5558b5d7cccc3 HTTP/1.0" 202 Accepted 2026-03-12 00:54:34,910 - lava_callback - INFO - Starting async job submit for node 69b20e51b0f5558b5d7cccc3 2026-03-12 00:54:34,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:35,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e51b0f5558b5d7cccc3 HTTP/1.1" 200 None 2026-03-12 00:54:35,001 - lava_callback - DEBUG - Processing node 69b20e51b0f5558b5d7cccc3: baseline-arm64-broonie 2026-03-12 00:54:35,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:35,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:35,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e51b0f5558b5d7cccc3/log.txt.gz 2026-03-12 00:54:36,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:36,387 - lava_callback - INFO - Received callback for node 69b20e55b0f5558b5d7cccd4 INFO: 172.21.0.1:48814 - "POST /node/69b20e55b0f5558b5d7cccd4 HTTP/1.0" 202 Accepted 2026-03-12 00:54:36,398 - lava_callback - INFO - Starting async job submit for node 69b20e55b0f5558b5d7cccd4 2026-03-12 00:54:36,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:36,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e55b0f5558b5d7cccd4 HTTP/1.1" 200 None 2026-03-12 00:54:36,467 - lava_callback - DEBUG - Processing node 69b20e55b0f5558b5d7cccd4: baseline-arm64-broonie INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:36,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:36,826 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e51b0f5558b5d7cccc3/lava-logs.yaml 2026-03-12 00:54:36,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:36,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:37,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:37,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e51b0f5558b5d7cccc3/lava_callback.json.gz 2026-03-12 00:54:37,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:37,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e55b0f5558b5d7cccd4/log.txt.gz 2026-03-12 00:54:37,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:37,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e51b0f5558b5d7cccc3 HTTP/1.1" 200 None 2026-03-12 00:54:37,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:37,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:37,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:37,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e51b0f5558b5d7cccc3 HTTP/1.1" 200 None 2026-03-12 00:54:37,645 - lava_callback - INFO - Completed processing callback for node 69b20e51b0f5558b5d7cccc3 2026-03-12 00:54:37,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:38,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:38,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e55b0f5558b5d7cccd4/lava-logs.yaml 2026-03-12 00:54:38,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:38,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:38,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e55b0f5558b5d7cccd4/lava_callback.json.gz 2026-03-12 00:54:38,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:38,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e55b0f5558b5d7cccd4 HTTP/1.1" 200 None 2026-03-12 00:54:38,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:38,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:38,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:38,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e55b0f5558b5d7cccd4 HTTP/1.1" 200 None 2026-03-12 00:54:38,949 - lava_callback - INFO - Completed processing callback for node 69b20e55b0f5558b5d7cccd4 2026-03-12 00:54:45,018 - lava_callback - INFO - Received callback for node 69b20e39b0f5558b5d7ccc4a INFO: 172.21.0.1:43210 - "POST /node/69b20e39b0f5558b5d7ccc4a HTTP/1.0" 202 Accepted 2026-03-12 00:54:45,031 - lava_callback - INFO - Starting async job submit for node 69b20e39b0f5558b5d7ccc4a 2026-03-12 00:54:45,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:45,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e39b0f5558b5d7ccc4a HTTP/1.1" 200 None 2026-03-12 00:54:45,099 - lava_callback - DEBUG - Processing node 69b20e39b0f5558b5d7ccc4a: baseline-nfs-arm64 2026-03-12 00:54:46,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:46,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:46,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e39b0f5558b5d7ccc4a/log.txt.gz 2026-03-12 00:54:47,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:47,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:47,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e39b0f5558b5d7ccc4a/lava-logs.yaml 2026-03-12 00:54:47,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:47,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:47,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e39b0f5558b5d7ccc4a/lava_callback.json.gz 2026-03-12 00:54:47,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:47,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e39b0f5558b5d7ccc4a HTTP/1.1" 200 None 2026-03-12 00:54:47,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:47,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:47,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:47,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e39b0f5558b5d7ccc4a HTTP/1.1" 200 None 2026-03-12 00:54:47,762 - lava_callback - INFO - Completed processing callback for node 69b20e39b0f5558b5d7ccc4a 2026-03-12 00:54:49,660 - lava_callback - INFO - Received callback for node 69b20e58b0f5558b5d7cccdf INFO: 172.21.0.1:43236 - "POST /node/69b20e58b0f5558b5d7cccdf HTTP/1.0" 202 Accepted 2026-03-12 00:54:49,666 - lava_callback - INFO - Starting async job submit for node 69b20e58b0f5558b5d7cccdf 2026-03-12 00:54:49,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:49,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e58b0f5558b5d7cccdf HTTP/1.1" 200 None 2026-03-12 00:54:49,707 - lava_callback - DEBUG - Processing node 69b20e58b0f5558b5d7cccdf: baseline-arm64-broonie 2026-03-12 00:54:49,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:50,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:50,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e58b0f5558b5d7cccdf/log.txt.gz 2026-03-12 00:54:50,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:50,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:50,461 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e58b0f5558b5d7cccdf/lava-logs.yaml 2026-03-12 00:54:50,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:54:50,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:54:50,611 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e58b0f5558b5d7cccdf/lava_callback.json.gz 2026-03-12 00:54:50,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:50,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e58b0f5558b5d7cccdf HTTP/1.1" 200 None 2026-03-12 00:54:50,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:50,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:54:50,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:50,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e58b0f5558b5d7cccdf HTTP/1.1" 200 None 2026-03-12 00:54:50,694 - lava_callback - INFO - Completed processing callback for node 69b20e58b0f5558b5d7cccdf INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:54:58,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:54:58,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:10,038 - lava_callback - INFO - Received callback for node 69b20e4cb0f5558b5d7cccb6 INFO: 172.21.0.1:57634 - "POST /node/69b20e4cb0f5558b5d7cccb6 HTTP/1.0" 202 Accepted 2026-03-12 00:55:10,044 - lava_callback - INFO - Starting async job submit for node 69b20e4cb0f5558b5d7cccb6 2026-03-12 00:55:10,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:10,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4cb0f5558b5d7cccb6 HTTP/1.1" 200 None 2026-03-12 00:55:10,082 - lava_callback - DEBUG - Processing node 69b20e4cb0f5558b5d7cccb6: baseline-arm64-broonie 2026-03-12 00:55:10,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:10,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:10,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4cb0f5558b5d7cccb6/log.txt.gz 2026-03-12 00:55:10,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:10,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:10,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4cb0f5558b5d7cccb6/lava-logs.yaml 2026-03-12 00:55:10,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:10,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:10,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4cb0f5558b5d7cccb6/lava_callback.json.gz 2026-03-12 00:55:10,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:11,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4cb0f5558b5d7cccb6 HTTP/1.1" 200 None 2026-03-12 00:55:11,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:11,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:55:11,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:11,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e4cb0f5558b5d7cccb6 HTTP/1.1" 200 None 2026-03-12 00:55:11,061 - lava_callback - INFO - Completed processing callback for node 69b20e4cb0f5558b5d7cccb6 2026-03-12 00:55:15,131 - lava_callback - INFO - Received callback for node 69b20e05b0f5558b5d7ccb8b INFO: 172.21.0.1:57638 - "POST /node/69b20e05b0f5558b5d7ccb8b HTTP/1.0" 202 Accepted 2026-03-12 00:55:15,142 - lava_callback - INFO - Starting async job submit for node 69b20e05b0f5558b5d7ccb8b INFO: 172.21.0.1:57650 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 00:55:15,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:15,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e05b0f5558b5d7ccb8b HTTP/1.1" 200 None 2026-03-12 00:55:15,230 - lava_callback - DEBUG - Processing node 69b20e05b0f5558b5d7ccb8b: ltp-cve 2026-03-12 00:55:15,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:15,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:15,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b20e05b0f5558b5d7ccb8b/log.txt.gz 2026-03-12 00:55:16,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:16,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:16,221 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b20e05b0f5558b5d7ccb8b/lava-logs.yaml 2026-03-12 00:55:16,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:16,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:16,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b20e05b0f5558b5d7ccb8b/lava_callback.json.gz 2026-03-12 00:55:16,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:16,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e05b0f5558b5d7ccb8b HTTP/1.1" 200 None 2026-03-12 00:55:16,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:16,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:55:16,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:16,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e05b0f5558b5d7ccb8b HTTP/1.1" 200 None 2026-03-12 00:55:16,530 - lava_callback - INFO - Completed processing callback for node 69b20e05b0f5558b5d7ccb8b INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:27,745 - lava_callback - INFO - Received callback for node 69af6bee275c8d3b7939a4e0 INFO: 172.21.0.1:40390 - "POST /node/69af6bee275c8d3b7939a4e0 HTTP/1.0" 202 Accepted 2026-03-12 00:55:27,751 - lava_callback - INFO - Starting async job submit for node 69af6bee275c8d3b7939a4e0 2026-03-12 00:55:27,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:27,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bee275c8d3b7939a4e0 HTTP/1.1" 200 None 2026-03-12 00:55:27,767 - lava_callback - DEBUG - Processing node 69af6bee275c8d3b7939a4e0: baseline-arm-baylibre 2026-03-12 00:55:27,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bee275c8d3b7939a4e0 2026-03-12 00:55:27,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:27,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bee275c8d3b7939a4e0 HTTP/1.1" 200 None 2026-03-12 00:55:27,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:27,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:55:27,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:27,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bee275c8d3b7939a4e0 HTTP/1.1" 200 None 2026-03-12 00:55:27,824 - lava_callback - ERROR - Error processing callback for node 69af6bee275c8d3b7939a4e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:28,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:55:28,408 - lava_callback - INFO - Received callback for node 69af6bf3275c8d3b7939a4ef INFO: 172.21.0.1:40402 - "POST /node/69af6bf3275c8d3b7939a4ef HTTP/1.0" 202 Accepted 2026-03-12 00:55:28,414 - lava_callback - INFO - Starting async job submit for node 69af6bf3275c8d3b7939a4ef 2026-03-12 00:55:28,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf3275c8d3b7939a4ef HTTP/1.1" 200 None 2026-03-12 00:55:28,431 - lava_callback - DEBUG - Processing node 69af6bf3275c8d3b7939a4ef: baseline-arm64-baylibre 2026-03-12 00:55:28,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bf3275c8d3b7939a4ef 2026-03-12 00:55:28,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf3275c8d3b7939a4ef HTTP/1.1" 200 None 2026-03-12 00:55:28,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:28,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:28,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bf3275c8d3b7939a4ef HTTP/1.1" 200 None 2026-03-12 00:55:28,510 - lava_callback - ERROR - Error processing callback for node 69af6bf3275c8d3b7939a4ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:29,055 - lava_callback - INFO - Received callback for node 69af6bf5275c8d3b7939a509 INFO: 172.21.0.1:40412 - "POST /node/69af6bf5275c8d3b7939a509 HTTP/1.0" 202 Accepted 2026-03-12 00:55:29,066 - lava_callback - INFO - Starting async job submit for node 69af6bf5275c8d3b7939a509 2026-03-12 00:55:29,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf5275c8d3b7939a509 HTTP/1.1" 200 None 2026-03-12 00:55:29,101 - lava_callback - DEBUG - Processing node 69af6bf5275c8d3b7939a509: baseline-arm64-baylibre 2026-03-12 00:55:29,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bf5275c8d3b7939a509 2026-03-12 00:55:29,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf5275c8d3b7939a509 HTTP/1.1" 200 None 2026-03-12 00:55:29,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:29,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bf5275c8d3b7939a509 HTTP/1.1" 200 None 2026-03-12 00:55:29,193 - lava_callback - ERROR - Error processing callback for node 69af6bf5275c8d3b7939a509: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:29,759 - lava_callback - INFO - Received callback for node 69af6bf7275c8d3b7939a50c INFO: 172.21.0.1:43724 - "POST /node/69af6bf7275c8d3b7939a50c HTTP/1.0" 202 Accepted 2026-03-12 00:55:29,768 - lava_callback - INFO - Starting async job submit for node 69af6bf7275c8d3b7939a50c 2026-03-12 00:55:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf7275c8d3b7939a50c HTTP/1.1" 200 None 2026-03-12 00:55:29,801 - lava_callback - DEBUG - Processing node 69af6bf7275c8d3b7939a50c: baseline-arm64-baylibre 2026-03-12 00:55:29,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bf7275c8d3b7939a50c 2026-03-12 00:55:29,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf7275c8d3b7939a50c HTTP/1.1" 200 None 2026-03-12 00:55:29,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:29,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:29,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bf7275c8d3b7939a50c HTTP/1.1" 200 None 2026-03-12 00:55:29,895 - lava_callback - ERROR - Error processing callback for node 69af6bf7275c8d3b7939a50c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:30,176 - lava_callback - INFO - Received callback for node 69b20e00b0f5558b5d7ccb7d INFO: 172.21.0.1:43730 - "POST /node/69b20e00b0f5558b5d7ccb7d HTTP/1.0" 202 Accepted 2026-03-12 00:55:30,194 - lava_callback - INFO - Starting async job submit for node 69b20e00b0f5558b5d7ccb7d 2026-03-12 00:55:30,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e00b0f5558b5d7ccb7d HTTP/1.1" 200 None 2026-03-12 00:55:30,286 - lava_callback - DEBUG - Processing node 69b20e00b0f5558b5d7ccb7d: ltp-cap_bounds 2026-03-12 00:55:30,426 - lava_callback - INFO - Received callback for node 69af6bf9275c8d3b7939a517 INFO: 172.21.0.1:43746 - "POST /node/69af6bf9275c8d3b7939a517 HTTP/1.0" 202 Accepted 2026-03-12 00:55:30,441 - lava_callback - INFO - Starting async job submit for node 69af6bf9275c8d3b7939a517 2026-03-12 00:55:30,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf9275c8d3b7939a517 HTTP/1.1" 200 None 2026-03-12 00:55:30,535 - lava_callback - DEBUG - Processing node 69af6bf9275c8d3b7939a517: baseline-arm64-baylibre 2026-03-12 00:55:30,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bf9275c8d3b7939a517 2026-03-12 00:55:30,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bf9275c8d3b7939a517 HTTP/1.1" 200 None 2026-03-12 00:55:30,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:30,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:30,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bf9275c8d3b7939a517 HTTP/1.1" 200 None 2026-03-12 00:55:30,780 - lava_callback - ERROR - Error processing callback for node 69af6bf9275c8d3b7939a517: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:31,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:31,105 - lava_callback - INFO - Received callback for node 69af6bfc275c8d3b7939a51a INFO: 172.21.0.1:43754 - "POST /node/69af6bfc275c8d3b7939a51a HTTP/1.0" 202 Accepted 2026-03-12 00:55:31,119 - lava_callback - INFO - Starting async job submit for node 69af6bfc275c8d3b7939a51a 2026-03-12 00:55:31,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:31,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bfc275c8d3b7939a51a HTTP/1.1" 200 None 2026-03-12 00:55:31,154 - lava_callback - DEBUG - Processing node 69af6bfc275c8d3b7939a51a: baseline-arm64-baylibre 2026-03-12 00:55:31,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6bfc275c8d3b7939a51a 2026-03-12 00:55:31,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:31,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6bfc275c8d3b7939a51a HTTP/1.1" 200 None 2026-03-12 00:55:31,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:31,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:55:31,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6bfc275c8d3b7939a51a HTTP/1.1" 200 None 2026-03-12 00:55:31,261 - lava_callback - ERROR - Error processing callback for node 69af6bfc275c8d3b7939a51a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:55:31,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:31,382 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b20e00b0f5558b5d7ccb7d/log.txt.gz 2026-03-12 00:55:31,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:32,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:32,216 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b20e00b0f5558b5d7ccb7d/lava-logs.yaml 2026-03-12 00:55:32,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:32,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:32,509 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b20e00b0f5558b5d7ccb7d/lava_callback.json.gz 2026-03-12 00:55:32,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:32,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e00b0f5558b5d7ccb7d HTTP/1.1" 200 None 2026-03-12 00:55:32,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:32,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:55:32,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:32,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e00b0f5558b5d7ccb7d HTTP/1.1" 200 None 2026-03-12 00:55:32,662 - lava_callback - INFO - Completed processing callback for node 69b20e00b0f5558b5d7ccb7d 2026-03-12 00:55:35,350 - lava_callback - INFO - Received callback for node 69b20e12b0f5558b5d7ccba9 INFO: 172.21.0.1:43760 - "POST /node/69b20e12b0f5558b5d7ccba9 HTTP/1.0" 202 Accepted 2026-03-12 00:55:35,362 - lava_callback - INFO - Starting async job submit for node 69b20e12b0f5558b5d7ccba9 2026-03-12 00:55:35,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:35,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e12b0f5558b5d7ccba9 HTTP/1.1" 200 None 2026-03-12 00:55:35,458 - lava_callback - DEBUG - Processing node 69b20e12b0f5558b5d7ccba9: ltp-syscalls INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:36,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:36,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:36,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b20e12b0f5558b5d7ccba9/log.txt.gz 2026-03-12 00:55:37,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:38,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:38,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b20e12b0f5558b5d7ccba9/lava-logs.yaml 2026-03-12 00:55:38,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:38,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:38,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b20e12b0f5558b5d7ccba9/lava_callback.json.gz 2026-03-12 00:55:38,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e12b0f5558b5d7ccba9 HTTP/1.1" 200 None 2026-03-12 00:55:38,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:38,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:55:38,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:38,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e12b0f5558b5d7ccba9 HTTP/1.1" 200 None 2026-03-12 00:55:38,828 - lava_callback - INFO - Completed processing callback for node 69b20e12b0f5558b5d7ccba9 INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:55,160 - lava_callback - INFO - Received callback for node 69b20e01b0f5558b5d7ccb81 INFO: 172.21.0.1:51052 - "POST /node/69b20e01b0f5558b5d7ccb81 HTTP/1.0" 202 Accepted 2026-03-12 00:55:55,170 - lava_callback - INFO - Starting async job submit for node 69b20e01b0f5558b5d7ccb81 2026-03-12 00:55:55,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:55,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e01b0f5558b5d7ccb81 HTTP/1.1" 200 None 2026-03-12 00:55:55,279 - lava_callback - DEBUG - Processing node 69b20e01b0f5558b5d7ccb81: ltp-containers 2026-03-12 00:55:55,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:56,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:56,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b20e01b0f5558b5d7ccb81/log.txt.gz INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:55:56,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:57,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:57,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b20e01b0f5558b5d7ccb81/lava-logs.yaml 2026-03-12 00:55:57,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:55:57,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:55:57,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b20e01b0f5558b5d7ccb81/lava_callback.json.gz 2026-03-12 00:55:57,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:57,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e01b0f5558b5d7ccb81 HTTP/1.1" 200 None 2026-03-12 00:55:57,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:57,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:55:57,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:57,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e01b0f5558b5d7ccb81 HTTP/1.1" 200 None 2026-03-12 00:55:57,766 - lava_callback - INFO - Completed processing callback for node 69b20e01b0f5558b5d7ccb81 2026-03-12 00:55:58,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:55:58,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:56:02,750 - lava_callback - INFO - Received callback for node 69af6c0e275c8d3b7939a54e INFO: 172.21.0.1:58598 - "POST /node/69af6c0e275c8d3b7939a54e HTTP/1.0" 202 Accepted 2026-03-12 00:56:02,758 - lava_callback - INFO - Starting async job submit for node 69af6c0e275c8d3b7939a54e 2026-03-12 00:56:02,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:02,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c0e275c8d3b7939a54e HTTP/1.1" 200 None 2026-03-12 00:56:02,783 - lava_callback - DEBUG - Processing node 69af6c0e275c8d3b7939a54e: baseline-arm64-clabbe 2026-03-12 00:56:02,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c0e275c8d3b7939a54e 2026-03-12 00:56:02,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:02,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c0e275c8d3b7939a54e HTTP/1.1" 200 None 2026-03-12 00:56:02,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:02,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:02,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:02,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c0e275c8d3b7939a54e HTTP/1.1" 200 None 2026-03-12 00:56:02,873 - lava_callback - ERROR - Error processing callback for node 69af6c0e275c8d3b7939a54e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:03,079 - lava_callback - INFO - Received callback for node 69b20e20b0f5558b5d7ccbfc INFO: 172.21.0.1:58614 - "POST /node/69b20e20b0f5558b5d7ccbfc HTTP/1.0" 202 Accepted 2026-03-12 00:56:03,089 - lava_callback - INFO - Starting async job submit for node 69b20e20b0f5558b5d7ccbfc 2026-03-12 00:56:03,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e20b0f5558b5d7ccbfc HTTP/1.1" 200 None 2026-03-12 00:56:03,181 - lava_callback - DEBUG - Processing node 69b20e20b0f5558b5d7ccbfc: baseline-arm64 2026-03-12 00:56:03,410 - lava_callback - INFO - Received callback for node 69af6c10275c8d3b7939a551 INFO: 172.21.0.1:58630 - "POST /node/69af6c10275c8d3b7939a551 HTTP/1.0" 202 Accepted 2026-03-12 00:56:03,429 - lava_callback - INFO - Starting async job submit for node 69af6c10275c8d3b7939a551 2026-03-12 00:56:03,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c10275c8d3b7939a551 HTTP/1.1" 200 None 2026-03-12 00:56:03,519 - lava_callback - DEBUG - Processing node 69af6c10275c8d3b7939a551: baseline-arm64-clabbe 2026-03-12 00:56:03,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c10275c8d3b7939a551 2026-03-12 00:56:03,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c10275c8d3b7939a551 HTTP/1.1" 200 None 2026-03-12 00:56:03,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:03,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:03,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:03,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c10275c8d3b7939a551 HTTP/1.1" 200 None 2026-03-12 00:56:03,735 - lava_callback - ERROR - Error processing callback for node 69af6c10275c8d3b7939a551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:04,049 - lava_callback - INFO - Received callback for node 69af6c10275c8d3b7939a554 INFO: 172.21.0.1:58640 - "POST /node/69af6c10275c8d3b7939a554 HTTP/1.0" 202 Accepted 2026-03-12 00:56:04,057 - lava_callback - INFO - Starting async job submit for node 69af6c10275c8d3b7939a554 2026-03-12 00:56:04,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c10275c8d3b7939a554 HTTP/1.1" 200 None 2026-03-12 00:56:04,085 - lava_callback - DEBUG - Processing node 69af6c10275c8d3b7939a554: baseline-arm64-clabbe 2026-03-12 00:56:04,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c10275c8d3b7939a554 2026-03-12 00:56:04,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c10275c8d3b7939a554 HTTP/1.1" 200 None 2026-03-12 00:56:04,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:04,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c10275c8d3b7939a554 HTTP/1.1" 200 None 2026-03-12 00:56:04,170 - lava_callback - ERROR - Error processing callback for node 69af6c10275c8d3b7939a554: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:04,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:04,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e20b0f5558b5d7ccbfc/log.txt.gz 2026-03-12 00:56:04,695 - lava_callback - INFO - Received callback for node 69af6c11275c8d3b7939a558 INFO: 172.21.0.1:58642 - "POST /node/69af6c11275c8d3b7939a558 HTTP/1.0" 202 Accepted 2026-03-12 00:56:04,720 - lava_callback - INFO - Starting async job submit for node 69af6c11275c8d3b7939a558 2026-03-12 00:56:04,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:04,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c11275c8d3b7939a558 HTTP/1.1" 200 None 2026-03-12 00:56:04,765 - lava_callback - DEBUG - Processing node 69af6c11275c8d3b7939a558: baseline-arm64-clabbe 2026-03-12 00:56:04,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c11275c8d3b7939a558 2026-03-12 00:56:04,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c11275c8d3b7939a558 HTTP/1.1" 200 None 2026-03-12 00:56:04,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:04,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:04,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c11275c8d3b7939a558 HTTP/1.1" 200 None 2026-03-12 00:56:04,850 - lava_callback - ERROR - Error processing callback for node 69af6c11275c8d3b7939a558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:05,457 - lava_callback - INFO - Received callback for node 69af6c14275c8d3b7939a578 INFO: 172.21.0.1:58652 - "POST /node/69af6c14275c8d3b7939a578 HTTP/1.0" 202 Accepted 2026-03-12 00:56:05,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:05,467 - lava_callback - INFO - Starting async job submit for node 69af6c14275c8d3b7939a578 2026-03-12 00:56:05,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e20b0f5558b5d7ccbfc/lava-logs.yaml 2026-03-12 00:56:05,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:05,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:05,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c14275c8d3b7939a578 HTTP/1.1" 200 None 2026-03-12 00:56:05,502 - lava_callback - DEBUG - Processing node 69af6c14275c8d3b7939a578: baseline-arm64-clabbe 2026-03-12 00:56:05,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c14275c8d3b7939a578 2026-03-12 00:56:05,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:05,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c14275c8d3b7939a578 HTTP/1.1" 200 None 2026-03-12 00:56:05,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:05,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:05,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:05,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c14275c8d3b7939a578 HTTP/1.1" 200 None 2026-03-12 00:56:05,579 - lava_callback - ERROR - Error processing callback for node 69af6c14275c8d3b7939a578: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:56:06,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:06,083 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e20b0f5558b5d7ccbfc/lava_callback.json.gz 2026-03-12 00:56:06,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e20b0f5558b5d7ccbfc HTTP/1.1" 200 None 2026-03-12 00:56:06,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,151 - lava_callback - INFO - Received callback for node 69af6c13275c8d3b7939a575 INFO: 172.21.0.1:58658 - "POST /node/69af6c13275c8d3b7939a575 HTTP/1.0" 202 Accepted 2026-03-12 00:56:06,160 - lava_callback - INFO - Starting async job submit for node 69af6c13275c8d3b7939a575 2026-03-12 00:56:06,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:56:06,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c13275c8d3b7939a575 HTTP/1.1" 200 None 2026-03-12 00:56:06,192 - lava_callback - DEBUG - Processing node 69af6c13275c8d3b7939a575: baseline-arm64-clabbe 2026-03-12 00:56:06,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c13275c8d3b7939a575 2026-03-12 00:56:06,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e20b0f5558b5d7ccbfc HTTP/1.1" 200 None 2026-03-12 00:56:06,214 - lava_callback - INFO - Completed processing callback for node 69b20e20b0f5558b5d7ccbfc 2026-03-12 00:56:06,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c13275c8d3b7939a575 HTTP/1.1" 200 None 2026-03-12 00:56:06,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 00:56:06,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:06,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c13275c8d3b7939a575 HTTP/1.1" 200 None 2026-03-12 00:56:06,377 - lava_callback - ERROR - Error processing callback for node 69af6c13275c8d3b7939a575: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:07,743 - lava_callback - INFO - Received callback for node 69af6c1b275c8d3b7939a593 INFO: 172.21.0.1:58676 - "POST /node/69af6c1b275c8d3b7939a593 HTTP/1.0" 202 Accepted 2026-03-12 00:56:07,750 - lava_callback - INFO - Starting async job submit for node 69af6c1b275c8d3b7939a593 2026-03-12 00:56:07,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:07,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c1b275c8d3b7939a593 HTTP/1.1" 200 None 2026-03-12 00:56:07,779 - lava_callback - DEBUG - Processing node 69af6c1b275c8d3b7939a593: baseline-arm-baylibre 2026-03-12 00:56:07,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c1b275c8d3b7939a593 2026-03-12 00:56:07,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:07,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c1b275c8d3b7939a593 HTTP/1.1" 200 None 2026-03-12 00:56:07,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:07,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:56:07,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:07,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c1b275c8d3b7939a593 HTTP/1.1" 200 None 2026-03-12 00:56:07,866 - lava_callback - ERROR - Error processing callback for node 69af6c1b275c8d3b7939a593: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:20,959 - lava_callback - INFO - Received callback for node 69b20e30b0f5558b5d7ccc31 INFO: 172.21.0.1:60248 - "POST /node/69b20e30b0f5558b5d7ccc31 HTTP/1.0" 202 Accepted 2026-03-12 00:56:20,969 - lava_callback - INFO - Starting async job submit for node 69b20e30b0f5558b5d7ccc31 2026-03-12 00:56:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:21,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e30b0f5558b5d7ccc31 HTTP/1.1" 200 None 2026-03-12 00:56:21,024 - lava_callback - DEBUG - Processing node 69b20e30b0f5558b5d7ccc31: baseline-nfs-arm64 2026-03-12 00:56:21,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:22,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:22,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e30b0f5558b5d7ccc31/log.txt.gz 2026-03-12 00:56:22,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:23,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:23,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e30b0f5558b5d7ccc31/lava-logs.yaml 2026-03-12 00:56:23,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:23,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:23,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e30b0f5558b5d7ccc31/lava_callback.json.gz 2026-03-12 00:56:23,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:23,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e30b0f5558b5d7ccc31 HTTP/1.1" 200 None 2026-03-12 00:56:23,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:23,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:56:23,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:23,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e30b0f5558b5d7ccc31 HTTP/1.1" 200 None 2026-03-12 00:56:23,724 - lava_callback - INFO - Completed processing callback for node 69b20e30b0f5558b5d7ccc31 INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:26,953 - lava_callback - INFO - Received callback for node 69b20e5eb0f5558b5d7ccd13 INFO: 172.21.0.1:60278 - "POST /node/69b20e5eb0f5558b5d7ccd13 HTTP/1.0" 202 Accepted 2026-03-12 00:56:26,962 - lava_callback - INFO - Starting async job submit for node 69b20e5eb0f5558b5d7ccd13 2026-03-12 00:56:26,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:27,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5eb0f5558b5d7ccd13 HTTP/1.1" 200 None 2026-03-12 00:56:27,021 - lava_callback - DEBUG - Processing node 69b20e5eb0f5558b5d7ccd13: baseline-arm64-clabbe 2026-03-12 00:56:27,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:27,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:27,806 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b20e5eb0f5558b5d7ccd13/log.txt.gz 2026-03-12 00:56:27,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:28,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:28,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:56:28,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:28,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b20e5eb0f5558b5d7ccd13/lava-logs.yaml 2026-03-12 00:56:28,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:29,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:29,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b20e5eb0f5558b5d7ccd13/lava_callback.json.gz 2026-03-12 00:56:29,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e5eb0f5558b5d7ccd13 HTTP/1.1" 200 None 2026-03-12 00:56:29,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:29,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:56:29,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:29,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e5eb0f5558b5d7ccd13 HTTP/1.1" 200 None 2026-03-12 00:56:29,131 - lava_callback - INFO - Completed processing callback for node 69b20e5eb0f5558b5d7ccd13 2026-03-12 00:56:29,713 - lava_callback - INFO - Received callback for node 69b20e52b0f5558b5d7cccca INFO: 172.21.0.1:33342 - "POST /node/69b20e52b0f5558b5d7cccca HTTP/1.0" 202 Accepted 2026-03-12 00:56:29,723 - lava_callback - INFO - Starting async job submit for node 69b20e52b0f5558b5d7cccca 2026-03-12 00:56:29,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:29,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e52b0f5558b5d7cccca HTTP/1.1" 200 None 2026-03-12 00:56:29,782 - lava_callback - DEBUG - Processing node 69b20e52b0f5558b5d7cccca: baseline-arm64-broonie 2026-03-12 00:56:30,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:30,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:30,668 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e52b0f5558b5d7cccca/log.txt.gz 2026-03-12 00:56:30,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:31,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:31,437 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e52b0f5558b5d7cccca/lava-logs.yaml 2026-03-12 00:56:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:31,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:31,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e52b0f5558b5d7cccca/lava_callback.json.gz 2026-03-12 00:56:31,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:31,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e52b0f5558b5d7cccca HTTP/1.1" 200 None 2026-03-12 00:56:31,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:32,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 00:56:32,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:32,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e52b0f5558b5d7cccca HTTP/1.1" 200 None 2026-03-12 00:56:32,040 - lava_callback - INFO - Completed processing callback for node 69b20e52b0f5558b5d7cccca 2026-03-12 00:56:35,191 - lava_callback - INFO - Received callback for node 69b20e08b0f5558b5d7ccb91 INFO: 172.21.0.1:33352 - "POST /node/69b20e08b0f5558b5d7ccb91 HTTP/1.0" 202 Accepted 2026-03-12 00:56:35,199 - lava_callback - INFO - Starting async job submit for node 69b20e08b0f5558b5d7ccb91 2026-03-12 00:56:35,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:35,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e08b0f5558b5d7ccb91 HTTP/1.1" 200 None 2026-03-12 00:56:35,264 - lava_callback - DEBUG - Processing node 69b20e08b0f5558b5d7ccb91: ltp-fs_bind 2026-03-12 00:56:35,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:36,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:36,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b20e08b0f5558b5d7ccb91/log.txt.gz INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:36,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:37,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:37,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b20e08b0f5558b5d7ccb91/lava-logs.yaml 2026-03-12 00:56:37,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:56:37,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:56:37,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b20e08b0f5558b5d7ccb91/lava_callback.json.gz 2026-03-12 00:56:37,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:37,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e08b0f5558b5d7ccb91 HTTP/1.1" 200 None 2026-03-12 00:56:37,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:37,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:56:37,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:37,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e08b0f5558b5d7ccb91 HTTP/1.1" 200 None 2026-03-12 00:56:37,784 - lava_callback - INFO - Completed processing callback for node 69b20e08b0f5558b5d7ccb91 INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:47,867 - lava_callback - INFO - Received callback for node 69af6c4a275c8d3b7939a5c0 INFO: 172.21.0.1:45276 - "POST /node/69af6c4a275c8d3b7939a5c0 HTTP/1.0" 202 Accepted 2026-03-12 00:56:47,876 - lava_callback - INFO - Starting async job submit for node 69af6c4a275c8d3b7939a5c0 2026-03-12 00:56:47,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:47,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c4a275c8d3b7939a5c0 HTTP/1.1" 200 None 2026-03-12 00:56:47,900 - lava_callback - DEBUG - Processing node 69af6c4a275c8d3b7939a5c0: baseline-arm-baylibre 2026-03-12 00:56:47,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c4a275c8d3b7939a5c0 2026-03-12 00:56:47,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:47,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c4a275c8d3b7939a5c0 HTTP/1.1" 200 None 2026-03-12 00:56:47,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:47,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a57a255cc0324eb010a HTTP/1.1" 200 None 2026-03-12 00:56:47,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:47,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c4a275c8d3b7939a5c0 HTTP/1.1" 200 None 2026-03-12 00:56:47,969 - lava_callback - ERROR - Error processing callback for node 69af6c4a275c8d3b7939a5c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:56:58,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:56:58,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:57:45,647 - lava_callback - INFO - Received callback for node 69af6c77275c8d3b7939a621 INFO: 172.21.0.1:46798 - "POST /node/69af6c77275c8d3b7939a621 HTTP/1.0" 202 Accepted 2026-03-12 00:57:45,655 - lava_callback - INFO - Starting async job submit for node 69af6c77275c8d3b7939a621 2026-03-12 00:57:45,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:57:45,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c77275c8d3b7939a621 HTTP/1.1" 200 None 2026-03-12 00:57:45,673 - lava_callback - DEBUG - Processing node 69af6c77275c8d3b7939a621: baseline-arm-clabbe 2026-03-12 00:57:45,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6c77275c8d3b7939a621 2026-03-12 00:57:45,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:57:45,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6c77275c8d3b7939a621 HTTP/1.1" 200 None 2026-03-12 00:57:45,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:57:45,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 00:57:45,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:57:45,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6c77275c8d3b7939a621 HTTP/1.1" 200 None 2026-03-12 00:57:45,743 - lava_callback - ERROR - Error processing callback for node 69af6c77275c8d3b7939a621: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:58:22,024 - lava_callback - INFO - Received callback for node 69b20de6b0f5558b5d7ccb2d INFO: 172.21.0.1:37778 - "POST /node/69b20de6b0f5558b5d7ccb2d HTTP/1.0" 202 Accepted 2026-03-12 00:58:22,032 - lava_callback - INFO - Starting async job submit for node 69b20de6b0f5558b5d7ccb2d 2026-03-12 00:58:22,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:22,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de6b0f5558b5d7ccb2d HTTP/1.1" 200 None 2026-03-12 00:58:22,073 - lava_callback - DEBUG - Processing node 69b20de6b0f5558b5d7ccb2d: baseline-arm-clabbe 2026-03-12 00:58:22,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:22,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:22,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de6b0f5558b5d7ccb2d/log.txt.gz 2026-03-12 00:58:22,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:22,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:22,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de6b0f5558b5d7ccb2d/lava-logs.yaml 2026-03-12 00:58:22,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:22,903 - lava_callback - INFO - Received callback for node 69af6ca2275c8d3b7939a63c INFO: 172.21.0.1:37794 - "POST /node/69af6ca2275c8d3b7939a63c HTTP/1.0" 202 Accepted 2026-03-12 00:58:22,910 - lava_callback - INFO - Starting async job submit for node 69af6ca2275c8d3b7939a63c 2026-03-12 00:58:22,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:22,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6ca2275c8d3b7939a63c HTTP/1.1" 200 None 2026-03-12 00:58:22,935 - lava_callback - DEBUG - Processing node 69af6ca2275c8d3b7939a63c: baseline-arm-clabbe 2026-03-12 00:58:22,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6ca2275c8d3b7939a63c 2026-03-12 00:58:22,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:22,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6ca2275c8d3b7939a63c HTTP/1.1" 200 None 2026-03-12 00:58:22,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:22,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 00:58:22,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:23,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6ca2275c8d3b7939a63c HTTP/1.1" 200 None 2026-03-12 00:58:23,026 - lava_callback - ERROR - Error processing callback for node 69af6ca2275c8d3b7939a63c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-12 00:58:23,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:23,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de6b0f5558b5d7ccb2d/lava_callback.json.gz 2026-03-12 00:58:23,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:23,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de6b0f5558b5d7ccb2d HTTP/1.1" 200 None 2026-03-12 00:58:23,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:23,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:58:23,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:23,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de6b0f5558b5d7ccb2d HTTP/1.1" 200 None 2026-03-12 00:58:23,287 - lava_callback - INFO - Completed processing callback for node 69b20de6b0f5558b5d7ccb2d INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:58:28,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:28,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:58:55,278 - lava_callback - INFO - Received callback for node 69b20e03b0f5558b5d7ccb88 INFO: 172.21.0.1:35618 - "POST /node/69b20e03b0f5558b5d7ccb88 HTTP/1.0" 202 Accepted 2026-03-12 00:58:55,289 - lava_callback - INFO - Starting async job submit for node 69b20e03b0f5558b5d7ccb88 2026-03-12 00:58:55,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:55,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e03b0f5558b5d7ccb88 HTTP/1.1" 200 None 2026-03-12 00:58:55,353 - lava_callback - DEBUG - Processing node 69b20e03b0f5558b5d7ccb88: ltp-controllers 2026-03-12 00:58:56,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:56,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:56,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b20e03b0f5558b5d7ccb88/log.txt.gz INFO: 172.21.0.1:35630 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:58:56,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:56,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:56,747 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b20e03b0f5558b5d7ccb88/lava-logs.yaml 2026-03-12 00:58:56,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:58:57,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:58:57,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b20e03b0f5558b5d7ccb88/lava_callback.json.gz 2026-03-12 00:58:57,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:57,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e03b0f5558b5d7ccb88 HTTP/1.1" 200 None 2026-03-12 00:58:57,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:57,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:58:57,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:57,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e03b0f5558b5d7ccb88 HTTP/1.1" 200 None 2026-03-12 00:58:57,143 - lava_callback - INFO - Completed processing callback for node 69b20e03b0f5558b5d7ccb88 2026-03-12 00:58:58,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:58:58,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 00:59:02,752 - lava_callback - INFO - Received callback for node 69af6ccc275c8d3b7939a651 INFO: 172.21.0.1:44326 - "POST /node/69af6ccc275c8d3b7939a651 HTTP/1.0" 202 Accepted 2026-03-12 00:59:02,758 - lava_callback - INFO - Starting async job submit for node 69af6ccc275c8d3b7939a651 2026-03-12 00:59:02,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:02,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6ccc275c8d3b7939a651 HTTP/1.1" 200 None 2026-03-12 00:59:02,777 - lava_callback - DEBUG - Processing node 69af6ccc275c8d3b7939a651: baseline-arm-clabbe 2026-03-12 00:59:02,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af6ccc275c8d3b7939a651 2026-03-12 00:59:02,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:02,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6ccc275c8d3b7939a651 HTTP/1.1" 200 None 2026-03-12 00:59:02,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:02,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 00:59:02,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:02,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af6ccc275c8d3b7939a651 HTTP/1.1" 200 None 2026-03-12 00:59:02,854 - lava_callback - ERROR - Error processing callback for node 69af6ccc275c8d3b7939a651: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 00:59:15,440 - lava_callback - INFO - Received callback for node 69b20e0ab0f5558b5d7ccb94 INFO: 172.21.0.1:47638 - "POST /node/69b20e0ab0f5558b5d7ccb94 HTTP/1.0" 202 Accepted 2026-03-12 00:59:15,447 - lava_callback - INFO - Starting async job submit for node 69b20e0ab0f5558b5d7ccb94 2026-03-12 00:59:15,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:15,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0ab0f5558b5d7ccb94 HTTP/1.1" 200 None 2026-03-12 00:59:15,491 - lava_callback - DEBUG - Processing node 69b20e0ab0f5558b5d7ccb94: ltp-fsx 2026-03-12 00:59:16,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:16,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:16,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b20e0ab0f5558b5d7ccb94/log.txt.gz 2026-03-12 00:59:16,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:59:16,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:16,579 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b20e0ab0f5558b5d7ccb94/lava-logs.yaml 2026-03-12 00:59:16,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:16,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:16,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b20e0ab0f5558b5d7ccb94/lava_callback.json.gz 2026-03-12 00:59:16,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:16,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0ab0f5558b5d7ccb94 HTTP/1.1" 200 None 2026-03-12 00:59:16,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:16,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:59:16,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:16,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e0ab0f5558b5d7ccb94 HTTP/1.1" 200 None 2026-03-12 00:59:16,906 - lava_callback - INFO - Completed processing callback for node 69b20e0ab0f5558b5d7ccb94 INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:59:28,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:28,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:59:50,034 - lava_callback - INFO - Received callback for node 69b20e0bb0f5558b5d7ccb97 INFO: 172.21.0.1:55100 - "POST /node/69b20e0bb0f5558b5d7ccb97 HTTP/1.0" 202 Accepted 2026-03-12 00:59:50,041 - lava_callback - INFO - Starting async job submit for node 69b20e0bb0f5558b5d7ccb97 2026-03-12 00:59:50,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:50,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0bb0f5558b5d7ccb97 HTTP/1.1" 200 None 2026-03-12 00:59:50,080 - lava_callback - DEBUG - Processing node 69b20e0bb0f5558b5d7ccb97: ltp-input 2026-03-12 00:59:50,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:50,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:50,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b20e0bb0f5558b5d7ccb97/log.txt.gz 2026-03-12 00:59:50,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:51,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:51,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b20e0bb0f5558b5d7ccb97/lava-logs.yaml 2026-03-12 00:59:51,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 00:59:51,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 00:59:51,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b20e0bb0f5558b5d7ccb97/lava_callback.json.gz 2026-03-12 00:59:51,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:51,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0bb0f5558b5d7ccb97 HTTP/1.1" 200 None 2026-03-12 00:59:51,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:51,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 00:59:51,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:51,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e0bb0f5558b5d7ccb97 HTTP/1.1" 200 None 2026-03-12 00:59:51,295 - lava_callback - INFO - Completed processing callback for node 69b20e0bb0f5558b5d7ccb97 INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK 2026-03-12 00:59:58,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 00:59:58,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:10,478 - lava_callback - INFO - Received callback for node 69b20e2eb0f5558b5d7ccc2b INFO: 172.21.0.1:45930 - "POST /node/69b20e2eb0f5558b5d7ccc2b HTTP/1.0" 202 Accepted 2026-03-12 01:00:10,486 - lava_callback - INFO - Starting async job submit for node 69b20e2eb0f5558b5d7ccc2b 2026-03-12 01:00:10,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:10,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2eb0f5558b5d7ccc2b HTTP/1.1" 200 None 2026-03-12 01:00:10,537 - lava_callback - DEBUG - Processing node 69b20e2eb0f5558b5d7ccc2b: baseline-arm64 2026-03-12 01:00:10,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:11,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:11,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2eb0f5558b5d7ccc2b/log.txt.gz 2026-03-12 01:00:11,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:11,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:11,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2eb0f5558b5d7ccc2b/lava-logs.yaml 2026-03-12 01:00:11,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:11,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:11,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b20e2eb0f5558b5d7ccc2b/lava_callback.json.gz DEBUG: Setup failed for 69b20e2eb0f5558b5d7ccc2b. Transitting job node result: incomplete -> fail 2026-03-12 01:00:11,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:11,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e2eb0f5558b5d7ccc2b HTTP/1.1" 200 None 2026-03-12 01:00:11,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:11,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:00:11,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:11,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e2eb0f5558b5d7ccc2b HTTP/1.1" 200 None 2026-03-12 01:00:11,903 - lava_callback - INFO - Completed processing callback for node 69b20e2eb0f5558b5d7ccc2b INFO: 172.21.0.1:45940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:21,491 - lava_callback - INFO - Received callback for node 69b20de7b0f5558b5d7ccb32 INFO: 172.21.0.1:40708 - "POST /node/69b20de7b0f5558b5d7ccb32 HTTP/1.0" 202 Accepted 2026-03-12 01:00:21,497 - lava_callback - INFO - Starting async job submit for node 69b20de7b0f5558b5d7ccb32 2026-03-12 01:00:21,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:21,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de7b0f5558b5d7ccb32 HTTP/1.1" 200 None 2026-03-12 01:00:21,533 - lava_callback - DEBUG - Processing node 69b20de7b0f5558b5d7ccb32: baseline-arm-clabbe 2026-03-12 01:00:21,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:21,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:21,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de7b0f5558b5d7ccb32/log.txt.gz 2026-03-12 01:00:22,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:22,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:22,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de7b0f5558b5d7ccb32/lava-logs.yaml 2026-03-12 01:00:22,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:22,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:22,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b20de7b0f5558b5d7ccb32/lava_callback.json.gz 2026-03-12 01:00:22,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:22,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20de7b0f5558b5d7ccb32 HTTP/1.1" 200 None 2026-03-12 01:00:22,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:22,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:00:22,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:22,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20de7b0f5558b5d7ccb32 HTTP/1.1" 200 None 2026-03-12 01:00:22,461 - lava_callback - INFO - Completed processing callback for node 69b20de7b0f5558b5d7ccb32 INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:28,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:00:35,287 - lava_callback - INFO - Received callback for node 69b20e0cb0f5558b5d7ccb9a INFO: 172.21.0.1:59028 - "POST /node/69b20e0cb0f5558b5d7ccb9a HTTP/1.0" 202 Accepted 2026-03-12 01:00:35,293 - lava_callback - INFO - Starting async job submit for node 69b20e0cb0f5558b5d7ccb9a 2026-03-12 01:00:35,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:35,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0cb0f5558b5d7ccb9a HTTP/1.1" 200 None 2026-03-12 01:00:35,334 - lava_callback - DEBUG - Processing node 69b20e0cb0f5558b5d7ccb9a: ltp-ipc 2026-03-12 01:00:35,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:35,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:35,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b20e0cb0f5558b5d7ccb9a/log.txt.gz 2026-03-12 01:00:36,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:36,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:36,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b20e0cb0f5558b5d7ccb9a/lava-logs.yaml 2026-03-12 01:00:36,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:36,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:36,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b20e0cb0f5558b5d7ccb9a/lava_callback.json.gz 2026-03-12 01:00:36,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:36,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0cb0f5558b5d7ccb9a HTTP/1.1" 200 None 2026-03-12 01:00:36,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:36,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:36,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:36,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e0cb0f5558b5d7ccb9a HTTP/1.1" 200 None 2026-03-12 01:00:36,583 - lava_callback - INFO - Completed processing callback for node 69b20e0cb0f5558b5d7ccb9a 2026-03-12 01:00:36,915 - lava_callback - INFO - Received callback for node 69b20e0eb0f5558b5d7ccb9d INFO: 172.21.0.1:59052 - "POST /node/69b20e0eb0f5558b5d7ccb9d HTTP/1.0" 202 Accepted 2026-03-12 01:00:36,923 - lava_callback - INFO - Starting async job submit for node 69b20e0eb0f5558b5d7ccb9d 2026-03-12 01:00:36,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:36,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0eb0f5558b5d7ccb9d HTTP/1.1" 200 None 2026-03-12 01:00:36,965 - lava_callback - DEBUG - Processing node 69b20e0eb0f5558b5d7ccb9d: ltp-pty 2026-03-12 01:00:37,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:37,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:37,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b20e0eb0f5558b5d7ccb9d/log.txt.gz 2026-03-12 01:00:37,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:37,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:37,939 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b20e0eb0f5558b5d7ccb9d/lava-logs.yaml 2026-03-12 01:00:37,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:00:38,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:00:38,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b20e0eb0f5558b5d7ccb9d/lava_callback.json.gz 2026-03-12 01:00:38,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:38,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e0eb0f5558b5d7ccb9d HTTP/1.1" 200 None 2026-03-12 01:00:38,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:38,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:00:38,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:38,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e0eb0f5558b5d7ccb9d HTTP/1.1" 200 None 2026-03-12 01:00:38,214 - lava_callback - INFO - Completed processing callback for node 69b20e0eb0f5558b5d7ccb9d INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:00:58,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:00:58,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:01:05,323 - lava_callback - INFO - Received callback for node 69b2103ab0f5558b5d7ccf86 INFO: 172.21.0.1:37888 - "POST /node/69b2103ab0f5558b5d7ccf86 HTTP/1.0" 202 Accepted 2026-03-12 01:01:05,329 - lava_callback - INFO - Starting async job submit for node 69b2103ab0f5558b5d7ccf86 2026-03-12 01:01:05,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:05,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2103ab0f5558b5d7ccf86 HTTP/1.1" 200 None 2026-03-12 01:01:05,345 - lava_callback - DEBUG - Processing node 69b2103ab0f5558b5d7ccf86: baseline-nfs-arm64 2026-03-12 01:01:05,347 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:01:05,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:01:05,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:01:05,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2103ab0f5558b5d7ccf86/lava-logs.yaml 2026-03-12 01:01:05,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:01:05,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:01:05,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2103ab0f5558b5d7ccf86/lava_callback.json.gz 2026-03-12 01:01:05,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:05,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2103ab0f5558b5d7ccf86 HTTP/1.1" 200 None 2026-03-12 01:01:05,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:05,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:01:05,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:05,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2103ab0f5558b5d7ccf86 HTTP/1.1" 200 None 2026-03-12 01:01:05,683 - lava_callback - INFO - Completed processing callback for node 69b2103ab0f5558b5d7ccf86 INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:01:28,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:01:28,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:03,879 - lava_callback - INFO - Received callback for node 69b21080b0f5558b5d7ccf99 INFO: 172.21.0.1:53200 - "POST /node/69b21080b0f5558b5d7ccf99 HTTP/1.0" 202 Accepted 2026-03-12 01:03:03,885 - lava_callback - INFO - Starting async job submit for node 69b21080b0f5558b5d7ccf99 2026-03-12 01:03:03,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:03,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21080b0f5558b5d7ccf99 HTTP/1.1" 200 None 2026-03-12 01:03:03,929 - lava_callback - DEBUG - Processing node 69b21080b0f5558b5d7ccf99: baseline-arm64 2026-03-12 01:03:04,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:04,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:04,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21080b0f5558b5d7ccf99/log.txt.gz 2026-03-12 01:03:04,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:04,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:04,529 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21080b0f5558b5d7ccf99/lava-logs.yaml 2026-03-12 01:03:04,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:04,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:04,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21080b0f5558b5d7ccf99/lava_callback.json.gz 2026-03-12 01:03:04,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:04,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21080b0f5558b5d7ccf99 HTTP/1.1" 200 None 2026-03-12 01:03:04,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:04,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:03:04,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:04,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21080b0f5558b5d7ccf99 HTTP/1.1" 200 None 2026-03-12 01:03:04,845 - lava_callback - INFO - Completed processing callback for node 69b21080b0f5558b5d7ccf99 INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 01:03:15,477 - lava_callback - INFO - Received callback for node 69b20e11b0f5558b5d7ccba6 INFO: 172.21.0.1:38430 - "POST /node/69b20e11b0f5558b5d7ccba6 HTTP/1.0" 202 Accepted 2026-03-12 01:03:15,483 - lava_callback - INFO - Starting async job submit for node 69b20e11b0f5558b5d7ccba6 2026-03-12 01:03:15,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:15,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e11b0f5558b5d7ccba6 HTTP/1.1" 200 None 2026-03-12 01:03:15,523 - lava_callback - DEBUG - Processing node 69b20e11b0f5558b5d7ccba6: ltp-smoke 2026-03-12 01:03:15,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:16,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:16,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20e11b0f5558b5d7ccba6/log.txt.gz 2026-03-12 01:03:16,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:16,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:16,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20e11b0f5558b5d7ccba6/lava-logs.yaml 2026-03-12 01:03:16,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:16,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:16,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20e11b0f5558b5d7ccba6/lava_callback.json.gz 2026-03-12 01:03:16,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:16,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e11b0f5558b5d7ccba6 HTTP/1.1" 200 None 2026-03-12 01:03:16,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:16,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:03:16,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:16,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e11b0f5558b5d7ccba6 HTTP/1.1" 200 None 2026-03-12 01:03:16,782 - lava_callback - INFO - Completed processing callback for node 69b20e11b0f5558b5d7ccba6 INFO: 172.21.0.1:57296 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:28,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:28,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:54,386 - lava_callback - INFO - Received callback for node 69b210cdb0f5558b5d7ccfa4 INFO: 172.21.0.1:47212 - "POST /node/69b210cdb0f5558b5d7ccfa4 HTTP/1.0" 202 Accepted 2026-03-12 01:03:54,393 - lava_callback - INFO - Starting async job submit for node 69b210cdb0f5558b5d7ccfa4 2026-03-12 01:03:54,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:54,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b210cdb0f5558b5d7ccfa4 HTTP/1.1" 200 None 2026-03-12 01:03:54,461 - lava_callback - DEBUG - Processing node 69b210cdb0f5558b5d7ccfa4: baseline-arm64 2026-03-12 01:03:54,596 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:03:54,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:54,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:54,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b210cdb0f5558b5d7ccfa4/lava-logs.yaml 2026-03-12 01:03:54,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:03:54,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:03:54,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b210cdb0f5558b5d7ccfa4/lava_callback.json.gz 2026-03-12 01:03:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:55,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b210cdb0f5558b5d7ccfa4 HTTP/1.1" 200 None 2026-03-12 01:03:55,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:55,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:03:55,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:55,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b210cdb0f5558b5d7ccfa4 HTTP/1.1" 200 None 2026-03-12 01:03:55,160 - lava_callback - INFO - Completed processing callback for node 69b210cdb0f5558b5d7ccfa4 INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:03:58,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:03:58,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:04:10,242 - lava_callback - INFO - Received callback for node 69b20e14b0f5558b5d7ccbac INFO: 172.21.0.1:35362 - "POST /node/69b20e14b0f5558b5d7ccbac HTTP/1.0" 202 Accepted 2026-03-12 01:04:10,260 - lava_callback - INFO - Starting async job submit for node 69b20e14b0f5558b5d7ccbac 2026-03-12 01:04:10,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:10,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e14b0f5558b5d7ccbac HTTP/1.1" 200 None 2026-03-12 01:04:10,313 - lava_callback - DEBUG - Processing node 69b20e14b0f5558b5d7ccbac: ltp-syscalls-ipc 2026-03-12 01:04:10,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:10,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:10,846 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b20e14b0f5558b5d7ccbac/log.txt.gz 2026-03-12 01:04:11,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:11,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:11,296 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b20e14b0f5558b5d7ccbac/lava-logs.yaml 2026-03-12 01:04:11,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:11,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:11,504 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b20e14b0f5558b5d7ccbac/lava_callback.json.gz 2026-03-12 01:04:11,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:11,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e14b0f5558b5d7ccbac HTTP/1.1" 200 None 2026-03-12 01:04:11,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:11,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:04:11,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:11,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e14b0f5558b5d7ccbac HTTP/1.1" 200 None 2026-03-12 01:04:11,594 - lava_callback - INFO - Completed processing callback for node 69b20e14b0f5558b5d7ccbac INFO: 172.21.0.1:35378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:04:28,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:28,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:04:35,469 - lava_callback - INFO - Received callback for node 69b20e17b0f5558b5d7ccbb2 INFO: 172.21.0.1:42130 - "POST /node/69b20e17b0f5558b5d7ccbb2 HTTP/1.0" 202 Accepted 2026-03-12 01:04:35,476 - lava_callback - INFO - Starting async job submit for node 69b20e17b0f5558b5d7ccbb2 2026-03-12 01:04:35,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:35,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e17b0f5558b5d7ccbb2 HTTP/1.1" 200 None 2026-03-12 01:04:35,526 - lava_callback - DEBUG - Processing node 69b20e17b0f5558b5d7ccbb2: ltp-watchqueue 2026-03-12 01:04:35,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:36,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:36,046 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b20e17b0f5558b5d7ccbb2/log.txt.gz 2026-03-12 01:04:36,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:04:36,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:36,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b20e17b0f5558b5d7ccbb2/lava-logs.yaml 2026-03-12 01:04:36,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:04:36,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:04:36,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b20e17b0f5558b5d7ccbb2/lava_callback.json.gz 2026-03-12 01:04:36,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:36,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e17b0f5558b5d7ccbb2 HTTP/1.1" 200 None 2026-03-12 01:04:36,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:36,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:04:36,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:36,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e17b0f5558b5d7ccbb2 HTTP/1.1" 200 None 2026-03-12 01:04:36,740 - lava_callback - INFO - Completed processing callback for node 69b20e17b0f5558b5d7ccbb2 INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:04:58,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:04:58,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 01:05:15,516 - lava_callback - INFO - Received callback for node 69b20e15b0f5558b5d7ccbaf INFO: 172.21.0.1:58326 - "POST /node/69b20e15b0f5558b5d7ccbaf HTTP/1.0" 202 Accepted 2026-03-12 01:05:15,523 - lava_callback - INFO - Starting async job submit for node 69b20e15b0f5558b5d7ccbaf 2026-03-12 01:05:15,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:15,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e15b0f5558b5d7ccbaf HTTP/1.1" 200 None 2026-03-12 01:05:15,562 - lava_callback - DEBUG - Processing node 69b20e15b0f5558b5d7ccbaf: ltp-timers 2026-03-12 01:05:15,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:05:16,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:05:16,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b20e15b0f5558b5d7ccbaf/log.txt.gz 2026-03-12 01:05:16,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58338 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:05:16,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:05:16,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b20e15b0f5558b5d7ccbaf/lava-logs.yaml 2026-03-12 01:05:16,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:05:16,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:05:16,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b20e15b0f5558b5d7ccbaf/lava_callback.json.gz 2026-03-12 01:05:16,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:16,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e15b0f5558b5d7ccbaf HTTP/1.1" 200 None 2026-03-12 01:05:16,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:16,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:05:16,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:16,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e15b0f5558b5d7ccbaf HTTP/1.1" 200 None 2026-03-12 01:05:16,835 - lava_callback - INFO - Completed processing callback for node 69b20e15b0f5558b5d7ccbaf INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:05:28,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:05:28,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:06:31,639 - lava_callback - INFO - Received callback for node 69b21186b0f5558b5d7ccff2 INFO: 172.21.0.1:60468 - "POST /node/69b21186b0f5558b5d7ccff2 HTTP/1.0" 202 Accepted 2026-03-12 01:06:31,645 - lava_callback - INFO - Starting async job submit for node 69b21186b0f5558b5d7ccff2 2026-03-12 01:06:31,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:31,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21186b0f5558b5d7ccff2 HTTP/1.1" 200 None 2026-03-12 01:06:31,665 - lava_callback - DEBUG - Processing node 69b21186b0f5558b5d7ccff2: baseline-arm 2026-03-12 01:06:31,670 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:06:31,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:31,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:31,824 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b21186b0f5558b5d7ccff2/lava-logs.yaml 2026-03-12 01:06:31,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:31,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:31,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b21186b0f5558b5d7ccff2/lava_callback.json.gz 2026-03-12 01:06:31,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:32,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21186b0f5558b5d7ccff2 HTTP/1.1" 200 None 2026-03-12 01:06:32,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:32,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:06:32,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:32,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21186b0f5558b5d7ccff2 HTTP/1.1" 200 None 2026-03-12 01:06:32,054 - lava_callback - INFO - Completed processing callback for node 69b21186b0f5558b5d7ccff2 INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:06:51,368 - lava_callback - INFO - Received callback for node 69b20dcab0f5558b5d7ccab8 INFO: 172.21.0.1:43768 - "POST /node/69b20dcab0f5558b5d7ccab8 HTTP/1.0" 202 Accepted 2026-03-12 01:06:51,375 - lava_callback - INFO - Starting async job submit for node 69b20dcab0f5558b5d7ccab8 2026-03-12 01:06:51,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:51,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcab0f5558b5d7ccab8 HTTP/1.1" 200 None 2026-03-12 01:06:51,448 - lava_callback - DEBUG - Processing node 69b20dcab0f5558b5d7ccab8: baseline-arm 2026-03-12 01:06:52,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:52,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:52,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcab0f5558b5d7ccab8/log.txt.gz 2026-03-12 01:06:52,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:52,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:52,767 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcab0f5558b5d7ccab8/lava-logs.yaml 2026-03-12 01:06:52,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:06:52,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:06:52,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b20dcab0f5558b5d7ccab8/lava_callback.json.gz DEBUG: Setup failed for 69b20dcab0f5558b5d7ccab8. Transitting job node result: incomplete -> fail 2026-03-12 01:06:53,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:53,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20dcab0f5558b5d7ccab8 HTTP/1.1" 200 None 2026-03-12 01:06:53,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:53,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:06:53,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:53,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20dcab0f5558b5d7ccab8 HTTP/1.1" 200 None 2026-03-12 01:06:53,282 - lava_callback - INFO - Completed processing callback for node 69b20dcab0f5558b5d7ccab8 INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:06:58,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:06:58,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:10:31,882 - lava_callback - INFO - Received callback for node 69b20deeb0f5558b5d7ccb4b INFO: 172.21.0.1:56186 - "POST /node/69b20deeb0f5558b5d7ccb4b HTTP/1.0" 202 Accepted 2026-03-12 01:10:31,929 - lava_callback - INFO - Starting async job submit for node 69b20deeb0f5558b5d7ccb4b 2026-03-12 01:10:31,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:31,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20deeb0f5558b5d7ccb4b HTTP/1.1" 200 None 2026-03-12 01:10:31,970 - lava_callback - DEBUG - Processing node 69b20deeb0f5558b5d7ccb4b: baseline-arm-pengutronix 2026-03-12 01:10:32,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:10:32,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:10:32,203 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20deeb0f5558b5d7ccb4b/log.txt.gz 2026-03-12 01:10:32,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:10:32,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:10:32,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20deeb0f5558b5d7ccb4b/lava-logs.yaml 2026-03-12 01:10:32,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:10:32,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:10:32,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b20deeb0f5558b5d7ccb4b/lava_callback.json.gz DEBUG: Setup failed for 69b20deeb0f5558b5d7ccb4b. Transitting job node result: incomplete -> fail 2026-03-12 01:10:32,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:32,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20deeb0f5558b5d7ccb4b HTTP/1.1" 200 None 2026-03-12 01:10:32,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:32,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:10:32,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:32,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20deeb0f5558b5d7ccb4b HTTP/1.1" 200 None 2026-03-12 01:10:32,762 - lava_callback - INFO - Completed processing callback for node 69b20deeb0f5558b5d7ccb4b INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:10:58,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:10:58,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:11:57,915 - lava_callback - INFO - Received callback for node 69b20e33b0f5558b5d7ccc37 INFO: 172.21.0.1:58614 - "POST /node/69b20e33b0f5558b5d7ccc37 HTTP/1.0" 202 Accepted 2026-03-12 01:11:57,923 - lava_callback - INFO - Starting async job submit for node 69b20e33b0f5558b5d7ccc37 2026-03-12 01:11:57,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:11:57,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e33b0f5558b5d7ccc37 HTTP/1.1" 200 None 2026-03-12 01:11:57,981 - lava_callback - DEBUG - Processing node 69b20e33b0f5558b5d7ccc37: baseline-nfs-arm64 2026-03-12 01:11:59,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:11:59,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:11:59,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e33b0f5558b5d7ccc37/log.txt.gz 2026-03-12 01:11:59,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:00,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:00,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e33b0f5558b5d7ccc37/lava-logs.yaml 2026-03-12 01:12:00,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:00,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:00,399 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b20e33b0f5558b5d7ccc37/lava_callback.json.gz DEBUG: Setup failed for 69b20e33b0f5558b5d7ccc37. Transitting job node result: incomplete -> fail 2026-03-12 01:12:00,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:00,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e33b0f5558b5d7ccc37 HTTP/1.1" 200 None 2026-03-12 01:12:00,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:00,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:12:00,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:00,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e33b0f5558b5d7ccc37 HTTP/1.1" 200 None 2026-03-12 01:12:00,654 - lava_callback - INFO - Completed processing callback for node 69b20e33b0f5558b5d7ccc37 INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:12:28,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:28,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:12:50,592 - lava_callback - INFO - Received callback for node 69b20edfb0f5558b5d7cce74 INFO: 172.21.0.1:38282 - "POST /node/69b20edfb0f5558b5d7cce74 HTTP/1.0" 202 Accepted 2026-03-12 01:12:50,599 - lava_callback - INFO - Starting async job submit for node 69b20edfb0f5558b5d7cce74 2026-03-12 01:12:50,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:50,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20edfb0f5558b5d7cce74 HTTP/1.1" 200 None 2026-03-12 01:12:50,692 - lava_callback - DEBUG - Processing node 69b20edfb0f5558b5d7cce74: ltp-smoke 2026-03-12 01:12:51,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:51,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:51,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20edfb0f5558b5d7cce74/log.txt.gz 2026-03-12 01:12:51,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:51,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:51,789 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20edfb0f5558b5d7cce74/lava-logs.yaml 2026-03-12 01:12:51,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:12:51,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:12:51,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b20edfb0f5558b5d7cce74/lava_callback.json.gz 2026-03-12 01:12:52,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:52,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20edfb0f5558b5d7cce74 HTTP/1.1" 200 None 2026-03-12 01:12:52,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:52,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 01:12:52,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:52,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20edfb0f5558b5d7cce74 HTTP/1.1" 200 None 2026-03-12 01:12:52,303 - lava_callback - INFO - Completed processing callback for node 69b20edfb0f5558b5d7cce74 INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:12:58,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:12:58,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:20:55,722 - lava_callback - INFO - Received callback for node 69b20e10b0f5558b5d7ccba3 INFO: 172.21.0.1:47966 - "POST /node/69b20e10b0f5558b5d7ccba3 HTTP/1.0" 202 Accepted 2026-03-12 01:20:55,769 - lava_callback - INFO - Starting async job submit for node 69b20e10b0f5558b5d7ccba3 2026-03-12 01:20:55,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:20:55,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e10b0f5558b5d7ccba3 HTTP/1.1" 200 None 2026-03-12 01:20:55,832 - lava_callback - DEBUG - Processing node 69b20e10b0f5558b5d7ccba3: ltp-sched 2026-03-12 01:20:55,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:20:56,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:20:56,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b20e10b0f5558b5d7ccba3/log.txt.gz 2026-03-12 01:20:56,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:20:56,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:20:56,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b20e10b0f5558b5d7ccba3/lava-logs.yaml 2026-03-12 01:20:56,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:20:56,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:20:56,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b20e10b0f5558b5d7ccba3/lava_callback.json.gz 2026-03-12 01:20:56,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:20:56,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e10b0f5558b5d7ccba3 HTTP/1.1" 200 None 2026-03-12 01:20:56,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:20:56,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:20:56,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:20:56,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e10b0f5558b5d7ccba3 HTTP/1.1" 200 None 2026-03-12 01:20:56,653 - lava_callback - INFO - Completed processing callback for node 69b20e10b0f5558b5d7ccba3 2026-03-12 01:20:58,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:20:58,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:29:31,109 - lava_callback - INFO - Received callback for node 69b1c01aa26b422765ba3fa1 INFO: 172.21.0.1:37666 - "POST /node/69b1c01aa26b422765ba3fa1 HTTP/1.0" 202 Accepted 2026-03-12 01:29:31,116 - lava_callback - INFO - Starting async job submit for node 69b1c01aa26b422765ba3fa1 2026-03-12 01:29:31,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:31,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01aa26b422765ba3fa1 HTTP/1.1" 200 None 2026-03-12 01:29:31,148 - lava_callback - DEBUG - Processing node 69b1c01aa26b422765ba3fa1: baseline-arm64-broonie 2026-03-12 01:29:31,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:29:31,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:29:31,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01aa26b422765ba3fa1/log.txt.gz 2026-03-12 01:29:31,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:29:32,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:29:32,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01aa26b422765ba3fa1/lava-logs.yaml 2026-03-12 01:29:32,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:29:32,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:29:32,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01aa26b422765ba3fa1/lava_callback.json.gz 2026-03-12 01:29:32,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:32,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01aa26b422765ba3fa1 HTTP/1.1" 200 None 2026-03-12 01:29:32,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:32,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 01:29:32,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:32,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c01aa26b422765ba3fa1 HTTP/1.1" 200 None 2026-03-12 01:29:32,338 - lava_callback - INFO - Completed processing callback for node 69b1c01aa26b422765ba3fa1 INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:29:58,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:29:58,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:31:26,322 - lava_callback - INFO - Received callback for node 69b21753b0f5558b5d7cd198 INFO: 172.21.0.1:48902 - "POST /node/69b21753b0f5558b5d7cd198 HTTP/1.0" 202 Accepted 2026-03-12 01:31:26,328 - lava_callback - INFO - Starting async job submit for node 69b21753b0f5558b5d7cd198 2026-03-12 01:31:26,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:26,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21753b0f5558b5d7cd198 HTTP/1.1" 200 None 2026-03-12 01:31:26,345 - lava_callback - DEBUG - Processing node 69b21753b0f5558b5d7cd198: baseline-nfs-arm64 2026-03-12 01:31:26,346 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:31:26,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:31:26,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:31:26,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b21753b0f5558b5d7cd198/lava-logs.yaml 2026-03-12 01:31:26,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:31:26,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:31:26,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b21753b0f5558b5d7cd198/lava_callback.json.gz 2026-03-12 01:31:26,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:26,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21753b0f5558b5d7cd198 HTTP/1.1" 200 None 2026-03-12 01:31:26,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:26,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:31:26,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:26,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21753b0f5558b5d7cd198 HTTP/1.1" 200 None 2026-03-12 01:31:26,718 - lava_callback - INFO - Completed processing callback for node 69b21753b0f5558b5d7cd198 2026-03-12 01:31:28,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:31:28,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39608 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:32:51,110 - lava_callback - INFO - Received callback for node 69b20e4db0f5558b5d7cccb9 INFO: 172.21.0.1:39474 - "POST /node/69b20e4db0f5558b5d7cccb9 HTTP/1.0" 202 Accepted 2026-03-12 01:32:51,115 - lava_callback - INFO - Starting async job submit for node 69b20e4db0f5558b5d7cccb9 2026-03-12 01:32:51,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:51,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4db0f5558b5d7cccb9 HTTP/1.1" 200 None 2026-03-12 01:32:51,149 - lava_callback - DEBUG - Processing node 69b20e4db0f5558b5d7cccb9: baseline-arm64-broonie 2026-03-12 01:32:51,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:32:51,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:32:51,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4db0f5558b5d7cccb9/log.txt.gz 2026-03-12 01:32:51,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:32:52,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:32:52,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4db0f5558b5d7cccb9/lava-logs.yaml 2026-03-12 01:32:52,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:32:52,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:32:52,278 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4db0f5558b5d7cccb9/lava_callback.json.gz 2026-03-12 01:32:52,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:52,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4db0f5558b5d7cccb9 HTTP/1.1" 200 None 2026-03-12 01:32:52,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:52,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:32:52,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:52,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e4db0f5558b5d7cccb9 HTTP/1.1" 200 None 2026-03-12 01:32:52,415 - lava_callback - INFO - Completed processing callback for node 69b20e4db0f5558b5d7cccb9 INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:32:58,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:32:58,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:33:05,566 - lava_callback - INFO - Received callback for node 69b21797b0f5558b5d7cd1a5 INFO: 172.21.0.1:59038 - "POST /node/69b21797b0f5558b5d7cd1a5 HTTP/1.0" 202 Accepted 2026-03-12 01:33:05,572 - lava_callback - INFO - Starting async job submit for node 69b21797b0f5558b5d7cd1a5 2026-03-12 01:33:05,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:05,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21797b0f5558b5d7cd1a5 HTTP/1.1" 200 None 2026-03-12 01:33:05,618 - lava_callback - DEBUG - Processing node 69b21797b0f5558b5d7cd1a5: baseline-arm64 2026-03-12 01:33:05,760 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:33:05,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:33:06,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:33:06,039 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21797b0f5558b5d7cd1a5/lava-logs.yaml 2026-03-12 01:33:06,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:33:06,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:33:06,160 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21797b0f5558b5d7cd1a5/lava_callback.json.gz 2026-03-12 01:33:06,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:06,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21797b0f5558b5d7cd1a5 HTTP/1.1" 200 None 2026-03-12 01:33:06,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:06,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:33:06,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:06,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21797b0f5558b5d7cd1a5 HTTP/1.1" 200 None 2026-03-12 01:33:06,334 - lava_callback - INFO - Completed processing callback for node 69b21797b0f5558b5d7cd1a5 INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:33:28,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:33:28,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 01:34:15,750 - lava_callback - INFO - Received callback for node 69b217e3b0f5558b5d7cd1b8 INFO: 172.21.0.1:40828 - "POST /node/69b217e3b0f5558b5d7cd1b8 HTTP/1.0" 202 Accepted 2026-03-12 01:34:15,760 - lava_callback - INFO - Starting async job submit for node 69b217e3b0f5558b5d7cd1b8 2026-03-12 01:34:15,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:15,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b217e3b0f5558b5d7cd1b8 HTTP/1.1" 200 None 2026-03-12 01:34:15,805 - lava_callback - DEBUG - Processing node 69b217e3b0f5558b5d7cd1b8: baseline-arm64 2026-03-12 01:34:15,940 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:34:16,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:34:16,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:34:16,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b217e3b0f5558b5d7cd1b8/lava-logs.yaml 2026-03-12 01:34:16,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:34:16,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:34:16,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b217e3b0f5558b5d7cd1b8/lava_callback.json.gz 2026-03-12 01:34:16,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:16,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b217e3b0f5558b5d7cd1b8 HTTP/1.1" 200 None 2026-03-12 01:34:16,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:16,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:34:16,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:16,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b217e3b0f5558b5d7cd1b8 HTTP/1.1" 200 None 2026-03-12 01:34:16,521 - lava_callback - INFO - Completed processing callback for node 69b217e3b0f5558b5d7cd1b8 INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:34:28,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:34:28,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:35:51,217 - lava_callback - INFO - Received callback for node 69b21852b0f5558b5d7cd1d4 INFO: 172.21.0.1:54582 - "POST /node/69b21852b0f5558b5d7cd1d4 HTTP/1.0" 202 Accepted 2026-03-12 01:35:51,223 - lava_callback - INFO - Starting async job submit for node 69b21852b0f5558b5d7cd1d4 2026-03-12 01:35:51,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:51,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21852b0f5558b5d7cd1d4 HTTP/1.1" 200 None 2026-03-12 01:35:51,245 - lava_callback - DEBUG - Processing node 69b21852b0f5558b5d7cd1d4: baseline-arm 2026-03-12 01:35:51,250 - lava_callback - WARNING - Failed to upload log 2026-03-12 01:35:51,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:35:51,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:35:51,464 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b21852b0f5558b5d7cd1d4/lava-logs.yaml 2026-03-12 01:35:51,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:35:51,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:35:51,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b21852b0f5558b5d7cd1d4/lava_callback.json.gz 2026-03-12 01:35:51,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:51,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21852b0f5558b5d7cd1d4 HTTP/1.1" 200 None 2026-03-12 01:35:51,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:51,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:35:51,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:51,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21852b0f5558b5d7cd1d4 HTTP/1.1" 200 None 2026-03-12 01:35:51,678 - lava_callback - INFO - Completed processing callback for node 69b21852b0f5558b5d7cd1d4 INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:35:58,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:35:58,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:36:56,538 - lava_callback - INFO - Received callback for node 69b21705b0f5558b5d7cd18b INFO: 172.21.0.1:36962 - "POST /node/69b21705b0f5558b5d7cd18b HTTP/1.0" 202 Accepted 2026-03-12 01:36:56,561 - lava_callback - INFO - Starting async job submit for node 69b21705b0f5558b5d7cd18b 2026-03-12 01:36:56,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:56,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21705b0f5558b5d7cd18b HTTP/1.1" 200 None 2026-03-12 01:36:56,612 - lava_callback - DEBUG - Processing node 69b21705b0f5558b5d7cd18b: baseline-arm64 2026-03-12 01:36:56,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:36:57,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:36:57,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21705b0f5558b5d7cd18b/log.txt.gz 2026-03-12 01:36:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:36:57,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:36:57,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21705b0f5558b5d7cd18b/lava-logs.yaml 2026-03-12 01:36:57,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:36:57,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:36:57,763 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b21705b0f5558b5d7cd18b/lava_callback.json.gz DEBUG: Setup failed for 69b21705b0f5558b5d7cd18b. Transitting job node result: incomplete -> fail 2026-03-12 01:36:57,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:57,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21705b0f5558b5d7cd18b HTTP/1.1" 200 None 2026-03-12 01:36:57,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:57,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:36:57,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:57,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21705b0f5558b5d7cd18b HTTP/1.1" 200 None 2026-03-12 01:36:57,974 - lava_callback - INFO - Completed processing callback for node 69b21705b0f5558b5d7cd18b 2026-03-12 01:36:58,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:36:58,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:48:10,610 - lava_callback - INFO - Received callback for node 69af784f275c8d3b7939a8e0 INFO: 172.21.0.1:48356 - "POST /node/69af784f275c8d3b7939a8e0 HTTP/1.0" 202 Accepted 2026-03-12 01:48:10,616 - lava_callback - INFO - Starting async job submit for node 69af784f275c8d3b7939a8e0 2026-03-12 01:48:10,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:48:10,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af784f275c8d3b7939a8e0 HTTP/1.1" 200 None 2026-03-12 01:48:10,636 - lava_callback - DEBUG - Processing node 69af784f275c8d3b7939a8e0: baseline-arm64-baylibre 2026-03-12 01:48:10,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af784f275c8d3b7939a8e0 2026-03-12 01:48:10,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:48:10,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af784f275c8d3b7939a8e0 HTTP/1.1" 200 None 2026-03-12 01:48:10,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:48:10,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 01:48:10,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:48:10,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af784f275c8d3b7939a8e0 HTTP/1.1" 200 None 2026-03-12 01:48:10,703 - lava_callback - ERROR - Error processing callback for node 69af784f275c8d3b7939a8e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45518 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:51:05,206 - lava_callback - INFO - Received callback for node 69af78f6275c8d3b7939a909 INFO: 172.21.0.1:44046 - "POST /node/69af78f6275c8d3b7939a909 HTTP/1.0" 202 Accepted 2026-03-12 01:51:05,211 - lava_callback - INFO - Starting async job submit for node 69af78f6275c8d3b7939a909 2026-03-12 01:51:05,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:51:05,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af78f6275c8d3b7939a909 HTTP/1.1" 200 None 2026-03-12 01:51:05,230 - lava_callback - DEBUG - Processing node 69af78f6275c8d3b7939a909: baseline-arm64-clabbe 2026-03-12 01:51:05,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af78f6275c8d3b7939a909 2026-03-12 01:51:05,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:51:05,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af78f6275c8d3b7939a909 HTTP/1.1" 200 None 2026-03-12 01:51:05,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:51:05,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 01:51:05,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:51:05,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af78f6275c8d3b7939a909 HTTP/1.1" 200 None 2026-03-12 01:51:05,290 - lava_callback - ERROR - Error processing callback for node 69af78f6275c8d3b7939a909: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:52:23,235 - lava_callback - INFO - Received callback for node 69b21875b0f5558b5d7cd1e0 INFO: 172.21.0.1:44042 - "POST /node/69b21875b0f5558b5d7cd1e0 HTTP/1.0" 202 Accepted 2026-03-12 01:52:23,242 - lava_callback - INFO - Starting async job submit for node 69b21875b0f5558b5d7cd1e0 2026-03-12 01:52:23,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:23,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21875b0f5558b5d7cd1e0 HTTP/1.1" 200 None 2026-03-12 01:52:23,320 - lava_callback - DEBUG - Processing node 69b21875b0f5558b5d7cd1e0: baseline-arm 2026-03-12 01:52:23,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:52:24,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:52:24,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b21875b0f5558b5d7cd1e0/log.txt.gz 2026-03-12 01:52:24,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:52:24,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:52:24,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b21875b0f5558b5d7cd1e0/lava-logs.yaml 2026-03-12 01:52:24,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:52:24,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:52:24,856 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b21875b0f5558b5d7cd1e0/lava_callback.json.gz DEBUG: Setup failed for 69b21875b0f5558b5d7cd1e0. Transitting job node result: incomplete -> fail 2026-03-12 01:52:24,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:24,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21875b0f5558b5d7cd1e0 HTTP/1.1" 200 None 2026-03-12 01:52:24,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:24,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:52:24,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:25,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21875b0f5558b5d7cd1e0 HTTP/1.1" 200 None 2026-03-12 01:52:25,170 - lava_callback - INFO - Completed processing callback for node 69b21875b0f5558b5d7cd1e0 INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:52:28,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:52:28,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:55:05,370 - lava_callback - INFO - Received callback for node 69af79e7275c8d3b7939a946 INFO: 172.21.0.1:47774 - "POST /node/69af79e7275c8d3b7939a946 HTTP/1.0" 202 Accepted 2026-03-12 01:55:05,375 - lava_callback - INFO - Starting async job submit for node 69af79e7275c8d3b7939a946 2026-03-12 01:55:05,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:55:05,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af79e7275c8d3b7939a946 HTTP/1.1" 200 None 2026-03-12 01:55:05,391 - lava_callback - DEBUG - Processing node 69af79e7275c8d3b7939a946: baseline-arm64-clabbe 2026-03-12 01:55:05,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af79e7275c8d3b7939a946 2026-03-12 01:55:05,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:55:05,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af79e7275c8d3b7939a946 HTTP/1.1" 200 None 2026-03-12 01:55:05,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:55:05,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 01:55:05,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:55:05,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af79e7275c8d3b7939a946 HTTP/1.1" 200 None 2026-03-12 01:55:05,448 - lava_callback - ERROR - Error processing callback for node 69af79e7275c8d3b7939a946: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:57:06,571 - lava_callback - INFO - Received callback for node 69b218e9b0f5558b5d7cd216 INFO: 172.21.0.1:59616 - "POST /node/69b218e9b0f5558b5d7cd216 HTTP/1.0" 202 Accepted 2026-03-12 01:57:06,617 - lava_callback - INFO - Starting async job submit for node 69b218e9b0f5558b5d7cd216 2026-03-12 01:57:06,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:06,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b218e9b0f5558b5d7cd216 HTTP/1.1" 200 None 2026-03-12 01:57:06,665 - lava_callback - DEBUG - Processing node 69b218e9b0f5558b5d7cd216: baseline-arm-pengutronix 2026-03-12 01:57:06,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:06,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:06,917 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b218e9b0f5558b5d7cd216/log.txt.gz 2026-03-12 01:57:06,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:07,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:07,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b218e9b0f5558b5d7cd216/lava-logs.yaml 2026-03-12 01:57:07,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:07,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:07,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b218e9b0f5558b5d7cd216/lava_callback.json.gz DEBUG: Setup failed for 69b218e9b0f5558b5d7cd216. Transitting job node result: incomplete -> fail 2026-03-12 01:57:07,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:07,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b218e9b0f5558b5d7cd216 HTTP/1.1" 200 None 2026-03-12 01:57:07,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:07,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 01:57:07,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:07,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b218e9b0f5558b5d7cd216 HTTP/1.1" 200 None 2026-03-12 01:57:07,499 - lava_callback - INFO - Completed processing callback for node 69b218e9b0f5558b5d7cd216 INFO: 172.21.0.1:42930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:57:28,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:28,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:57:32,700 - lava_callback - INFO - Received callback for node 69b21d0db0f5558b5d7cd2d4 INFO: 172.21.0.1:43998 - "POST /node/69b21d0db0f5558b5d7cd2d4 HTTP/1.0" 202 Accepted 2026-03-12 01:57:32,706 - lava_callback - INFO - Starting async job submit for node 69b21d0db0f5558b5d7cd2d4 2026-03-12 01:57:32,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:32,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21d0db0f5558b5d7cd2d4 HTTP/1.1" 200 None 2026-03-12 01:57:32,738 - lava_callback - DEBUG - Processing node 69b21d0db0f5558b5d7cd2d4: baseline-arm64-broonie 2026-03-12 01:57:33,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:33,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:33,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d0db0f5558b5d7cd2d4/log.txt.gz 2026-03-12 01:57:33,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:33,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:33,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d0db0f5558b5d7cd2d4/lava-logs.yaml 2026-03-12 01:57:33,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:57:33,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:57:33,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d0db0f5558b5d7cd2d4/lava_callback.json.gz 2026-03-12 01:57:33,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:33,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21d0db0f5558b5d7cd2d4 HTTP/1.1" 200 None 2026-03-12 01:57:33,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:33,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 01:57:33,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:33,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21d0db0f5558b5d7cd2d4 HTTP/1.1" 200 None 2026-03-12 01:57:33,864 - lava_callback - INFO - Completed processing callback for node 69b21d0db0f5558b5d7cd2d4 INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:57:58,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:57:58,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:58:09,804 - lava_callback - INFO - Received callback for node 69b2190ab0f5558b5d7cd224 INFO: 172.21.0.1:58328 - "POST /node/69b2190ab0f5558b5d7cd224 HTTP/1.0" 202 Accepted 2026-03-12 01:58:09,812 - lava_callback - INFO - Starting async job submit for node 69b2190ab0f5558b5d7cd224 2026-03-12 01:58:09,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:09,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2190ab0f5558b5d7cd224 HTTP/1.1" 200 None 2026-03-12 01:58:09,870 - lava_callback - DEBUG - Processing node 69b2190ab0f5558b5d7cd224: baseline-nfs-arm64 2026-03-12 01:58:11,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:11,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:11,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2190ab0f5558b5d7cd224/log.txt.gz 2026-03-12 01:58:11,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:12,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:12,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2190ab0f5558b5d7cd224/lava-logs.yaml 2026-03-12 01:58:12,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:12,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:12,350 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b2190ab0f5558b5d7cd224/lava_callback.json.gz DEBUG: Setup failed for 69b2190ab0f5558b5d7cd224. Transitting job node result: incomplete -> fail 2026-03-12 01:58:12,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:12,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2190ab0f5558b5d7cd224 HTTP/1.1" 200 None 2026-03-12 01:58:12,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:12,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 01:58:12,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:12,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2190ab0f5558b5d7cd224 HTTP/1.1" 200 None 2026-03-12 01:58:12,600 - lava_callback - INFO - Completed processing callback for node 69b2190ab0f5558b5d7cd224 INFO: 172.21.0.1:58332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:58:28,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:28,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 01:58:32,442 - lava_callback - INFO - Received callback for node 69b2198db0f5558b5d7cd232 INFO: 172.21.0.1:51074 - "POST /node/69b2198db0f5558b5d7cd232 HTTP/1.0" 202 Accepted 2026-03-12 01:58:32,448 - lava_callback - INFO - Starting async job submit for node 69b2198db0f5558b5d7cd232 2026-03-12 01:58:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:32,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2198db0f5558b5d7cd232 HTTP/1.1" 200 None 2026-03-12 01:58:32,526 - lava_callback - DEBUG - Processing node 69b2198db0f5558b5d7cd232: ltp-smoke 2026-03-12 01:58:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:33,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:33,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2198db0f5558b5d7cd232/log.txt.gz 2026-03-12 01:58:33,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:33,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:33,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2198db0f5558b5d7cd232/lava-logs.yaml 2026-03-12 01:58:33,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 01:58:34,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 01:58:34,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2198db0f5558b5d7cd232/lava_callback.json.gz 2026-03-12 01:58:34,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:34,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2198db0f5558b5d7cd232 HTTP/1.1" 200 None 2026-03-12 01:58:34,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:34,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 01:58:34,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:34,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2198db0f5558b5d7cd232 HTTP/1.1" 200 None 2026-03-12 01:58:34,465 - lava_callback - INFO - Completed processing callback for node 69b2198db0f5558b5d7cd232 INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK 2026-03-12 01:58:58,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 01:58:58,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:08:07,667 - lava_callback - INFO - Received callback for node 69b21fecb0f5558b5d7cd376 INFO: 172.21.0.1:36192 - "POST /node/69b21fecb0f5558b5d7cd376 HTTP/1.0" 202 Accepted 2026-03-12 02:08:07,673 - lava_callback - INFO - Starting async job submit for node 69b21fecb0f5558b5d7cd376 2026-03-12 02:08:07,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:07,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21fecb0f5558b5d7cd376 HTTP/1.1" 200 None 2026-03-12 02:08:07,690 - lava_callback - DEBUG - Processing node 69b21fecb0f5558b5d7cd376: baseline-nfs-arm64 2026-03-12 02:08:07,691 - lava_callback - WARNING - Failed to upload log 2026-03-12 02:08:07,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:08:07,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:08:07,840 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b21fecb0f5558b5d7cd376/lava-logs.yaml 2026-03-12 02:08:07,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:08:07,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:08:07,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b21fecb0f5558b5d7cd376/lava_callback.json.gz 2026-03-12 02:08:07,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:07,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21fecb0f5558b5d7cd376 HTTP/1.1" 200 None 2026-03-12 02:08:08,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:08:08,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:08,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21fecb0f5558b5d7cd376 HTTP/1.1" 200 None 2026-03-12 02:08:08,066 - lava_callback - INFO - Completed processing callback for node 69b21fecb0f5558b5d7cd376 INFO: 172.21.0.1:59296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:08:28,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:08:28,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:11:12,574 - lava_callback - INFO - Received callback for node 69b22041b0f5558b5d7cd386 INFO: 172.21.0.1:57662 - "POST /node/69b22041b0f5558b5d7cd386 HTTP/1.0" 202 Accepted 2026-03-12 02:11:12,580 - lava_callback - INFO - Starting async job submit for node 69b22041b0f5558b5d7cd386 2026-03-12 02:11:12,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:12,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22041b0f5558b5d7cd386 HTTP/1.1" 200 None 2026-03-12 02:11:12,611 - lava_callback - DEBUG - Processing node 69b22041b0f5558b5d7cd386: baseline-arm64-broonie 2026-03-12 02:11:12,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:13,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:13,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b22041b0f5558b5d7cd386/log.txt.gz 2026-03-12 02:11:13,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:13,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:13,405 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b22041b0f5558b5d7cd386/lava-logs.yaml 2026-03-12 02:11:13,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:13,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:13,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b22041b0f5558b5d7cd386/lava_callback.json.gz 2026-03-12 02:11:13,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:13,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22041b0f5558b5d7cd386 HTTP/1.1" 200 None 2026-03-12 02:11:13,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:13,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:11:13,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:13,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22041b0f5558b5d7cd386 HTTP/1.1" 200 None 2026-03-12 02:11:13,663 - lava_callback - INFO - Completed processing callback for node 69b22041b0f5558b5d7cd386 INFO: 172.21.0.1:57678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:11:28,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:28,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:11:37,723 - lava_callback - INFO - Received callback for node 69b2207eb0f5558b5d7cd391 INFO: 172.21.0.1:48710 - "POST /node/69b2207eb0f5558b5d7cd391 HTTP/1.0" 202 Accepted 2026-03-12 02:11:37,729 - lava_callback - INFO - Starting async job submit for node 69b2207eb0f5558b5d7cd391 2026-03-12 02:11:37,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:37,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2207eb0f5558b5d7cd391 HTTP/1.1" 200 None 2026-03-12 02:11:37,774 - lava_callback - DEBUG - Processing node 69b2207eb0f5558b5d7cd391: baseline-arm64 2026-03-12 02:11:37,975 - lava_callback - WARNING - Failed to upload log 2026-03-12 02:11:38,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:38,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:38,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b2207eb0f5558b5d7cd391/lava-logs.yaml 2026-03-12 02:11:38,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:11:38,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:11:38,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b2207eb0f5558b5d7cd391/lava_callback.json.gz 2026-03-12 02:11:38,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:38,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2207eb0f5558b5d7cd391 HTTP/1.1" 200 None 2026-03-12 02:11:38,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:38,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:11:38,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:38,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2207eb0f5558b5d7cd391 HTTP/1.1" 200 None 2026-03-12 02:11:38,579 - lava_callback - INFO - Completed processing callback for node 69b2207eb0f5558b5d7cd391 INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:11:58,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:11:58,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:12:16,656 - lava_callback - INFO - Received callback for node 69b220cab0f5558b5d7cd3a2 INFO: 172.21.0.1:52024 - "POST /node/69b220cab0f5558b5d7cd3a2 HTTP/1.0" 202 Accepted 2026-03-12 02:12:16,663 - lava_callback - INFO - Starting async job submit for node 69b220cab0f5558b5d7cd3a2 2026-03-12 02:12:16,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:16,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b220cab0f5558b5d7cd3a2 HTTP/1.1" 200 None 2026-03-12 02:12:16,711 - lava_callback - DEBUG - Processing node 69b220cab0f5558b5d7cd3a2: baseline-arm64 2026-03-12 02:12:16,845 - lava_callback - WARNING - Failed to upload log 2026-03-12 02:12:16,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:12:17,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:12:17,120 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b220cab0f5558b5d7cd3a2/lava-logs.yaml 2026-03-12 02:12:17,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:12:17,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:12:17,261 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b220cab0f5558b5d7cd3a2/lava_callback.json.gz 2026-03-12 02:12:17,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:17,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b220cab0f5558b5d7cd3a2 HTTP/1.1" 200 None 2026-03-12 02:12:17,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:17,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:12:17,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:17,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b220cab0f5558b5d7cd3a2 HTTP/1.1" 200 None 2026-03-12 02:12:17,409 - lava_callback - INFO - Completed processing callback for node 69b220cab0f5558b5d7cd3a2 INFO: 172.21.0.1:60034 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:12:28,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:12:28,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:14:59,503 - lava_callback - INFO - Received callback for node 69b21f93b0f5558b5d7cd362 INFO: 172.21.0.1:58554 - "POST /node/69b21f93b0f5558b5d7cd362 HTTP/1.0" 202 Accepted 2026-03-12 02:14:59,509 - lava_callback - INFO - Starting async job submit for node 69b21f93b0f5558b5d7cd362 2026-03-12 02:14:59,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:14:59,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21f93b0f5558b5d7cd362 HTTP/1.1" 200 None 2026-03-12 02:14:59,553 - lava_callback - DEBUG - Processing node 69b21f93b0f5558b5d7cd362: ltp-sched 2026-03-12 02:14:59,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:15:00,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:15:00,059 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b21f93b0f5558b5d7cd362/log.txt.gz 2026-03-12 02:15:00,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:15:00,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:15:00,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b21f93b0f5558b5d7cd362/lava-logs.yaml 2026-03-12 02:15:00,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:15:00,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:15:00,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b21f93b0f5558b5d7cd362/lava_callback.json.gz 2026-03-12 02:15:00,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:15:00,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21f93b0f5558b5d7cd362 HTTP/1.1" 200 None 2026-03-12 02:15:00,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:15:00,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 02:15:00,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:15:00,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21f93b0f5558b5d7cd362 HTTP/1.1" 200 None 2026-03-12 02:15:00,784 - lava_callback - INFO - Completed processing callback for node 69b21f93b0f5558b5d7cd362 INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:15:28,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:15:28,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET /node/69938cf3cebe99dd8e0720ac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:21:27,173 - lava_callback - INFO - Received callback for node 69b22168b0f5558b5d7cd3bf INFO: 172.21.0.1:36666 - "POST /node/69b22168b0f5558b5d7cd3bf HTTP/1.0" 202 Accepted 2026-03-12 02:21:27,180 - lava_callback - INFO - Starting async job submit for node 69b22168b0f5558b5d7cd3bf 2026-03-12 02:21:27,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:27,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22168b0f5558b5d7cd3bf HTTP/1.1" 200 None 2026-03-12 02:21:27,232 - lava_callback - DEBUG - Processing node 69b22168b0f5558b5d7cd3bf: baseline-arm64 2026-03-12 02:21:27,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:21:27,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:21:27,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b22168b0f5558b5d7cd3bf/log.txt.gz 2026-03-12 02:21:27,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:21:28,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:21:28,217 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b22168b0f5558b5d7cd3bf/lava-logs.yaml 2026-03-12 02:21:28,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:21:28,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:21:28,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b22168b0f5558b5d7cd3bf/lava_callback.json.gz DEBUG: Setup failed for 69b22168b0f5558b5d7cd3bf. Transitting job node result: incomplete -> fail 2026-03-12 02:21:28,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:28,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22168b0f5558b5d7cd3bf HTTP/1.1" 200 None 2026-03-12 02:21:28,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:28,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:21:28,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:28,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22168b0f5558b5d7cd3bf HTTP/1.1" 200 None 2026-03-12 02:21:28,634 - lava_callback - INFO - Completed processing callback for node 69b22168b0f5558b5d7cd3bf 2026-03-12 02:21:28,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:21:28,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:22:52,447 - lava_callback - INFO - Received callback for node 69af8074275c8d3b7939aa90 INFO: 172.21.0.1:40542 - "POST /node/69af8074275c8d3b7939aa90 HTTP/1.0" 202 Accepted 2026-03-12 02:22:52,453 - lava_callback - INFO - Starting async job submit for node 69af8074275c8d3b7939aa90 2026-03-12 02:22:52,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:22:52,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8074275c8d3b7939aa90 HTTP/1.1" 200 None 2026-03-12 02:22:52,471 - lava_callback - DEBUG - Processing node 69af8074275c8d3b7939aa90: baseline-arm64-baylibre 2026-03-12 02:22:52,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8074275c8d3b7939aa90 2026-03-12 02:22:52,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:22:52,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8074275c8d3b7939aa90 HTTP/1.1" 200 None 2026-03-12 02:22:52,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:22:52,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:22:52,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:22:52,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8074275c8d3b7939aa90 HTTP/1.1" 200 None 2026-03-12 02:22:52,524 - lava_callback - ERROR - Error processing callback for node 69af8074275c8d3b7939aa90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:24:12,525 - lava_callback - INFO - Received callback for node 69af80c0275c8d3b7939aa9c INFO: 172.21.0.1:40270 - "POST /node/69af80c0275c8d3b7939aa9c HTTP/1.0" 202 Accepted 2026-03-12 02:24:12,530 - lava_callback - INFO - Starting async job submit for node 69af80c0275c8d3b7939aa9c 2026-03-12 02:24:12,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:24:12,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af80c0275c8d3b7939aa9c HTTP/1.1" 200 None 2026-03-12 02:24:12,547 - lava_callback - DEBUG - Processing node 69af80c0275c8d3b7939aa9c: baseline-arm64-baylibre 2026-03-12 02:24:12,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af80c0275c8d3b7939aa9c 2026-03-12 02:24:12,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:24:12,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af80c0275c8d3b7939aa9c HTTP/1.1" 200 None 2026-03-12 02:24:12,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:24:12,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:24:12,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:24:12,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af80c0275c8d3b7939aa9c HTTP/1.1" 200 None 2026-03-12 02:24:12,609 - lava_callback - ERROR - Error processing callback for node 69af80c0275c8d3b7939aa9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:25:32,783 - lava_callback - INFO - Received callback for node 69af810f275c8d3b7939aaa4 INFO: 172.21.0.1:46438 - "POST /node/69af810f275c8d3b7939aaa4 HTTP/1.0" 202 Accepted 2026-03-12 02:25:32,788 - lava_callback - INFO - Starting async job submit for node 69af810f275c8d3b7939aaa4 2026-03-12 02:25:32,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:25:32,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af810f275c8d3b7939aaa4 HTTP/1.1" 200 None 2026-03-12 02:25:32,805 - lava_callback - DEBUG - Processing node 69af810f275c8d3b7939aaa4: baseline-arm64-baylibre 2026-03-12 02:25:32,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af810f275c8d3b7939aaa4 2026-03-12 02:25:32,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:25:32,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af810f275c8d3b7939aaa4 HTTP/1.1" 200 None 2026-03-12 02:25:32,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:25:32,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:25:32,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:25:32,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af810f275c8d3b7939aaa4 HTTP/1.1" 200 None 2026-03-12 02:25:32,871 - lava_callback - ERROR - Error processing callback for node 69af810f275c8d3b7939aaa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:26:52,852 - lava_callback - INFO - Received callback for node 69af815d275c8d3b7939aaae INFO: 172.21.0.1:42564 - "POST /node/69af815d275c8d3b7939aaae HTTP/1.0" 202 Accepted 2026-03-12 02:26:52,857 - lava_callback - INFO - Starting async job submit for node 69af815d275c8d3b7939aaae 2026-03-12 02:26:52,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:26:52,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af815d275c8d3b7939aaae HTTP/1.1" 200 None 2026-03-12 02:26:52,873 - lava_callback - DEBUG - Processing node 69af815d275c8d3b7939aaae: baseline-arm64-baylibre 2026-03-12 02:26:52,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af815d275c8d3b7939aaae 2026-03-12 02:26:52,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:26:52,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af815d275c8d3b7939aaae HTTP/1.1" 200 None 2026-03-12 02:26:52,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:26:52,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:26:52,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:26:52,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af815d275c8d3b7939aaae HTTP/1.1" 200 None 2026-03-12 02:26:52,931 - lava_callback - ERROR - Error processing callback for node 69af815d275c8d3b7939aaae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:28:06,771 - lava_callback - INFO - Received callback for node 69af81af275c8d3b7939aabb INFO: 172.21.0.1:53046 - "POST /node/69af81af275c8d3b7939aabb HTTP/1.0" 202 Accepted 2026-03-12 02:28:06,776 - lava_callback - INFO - Starting async job submit for node 69af81af275c8d3b7939aabb 2026-03-12 02:28:06,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:28:06,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af81af275c8d3b7939aabb HTTP/1.1" 200 None 2026-03-12 02:28:06,793 - lava_callback - DEBUG - Processing node 69af81af275c8d3b7939aabb: baseline-arm64-clabbe 2026-03-12 02:28:06,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af81af275c8d3b7939aabb 2026-03-12 02:28:06,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:28:06,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af81af275c8d3b7939aabb HTTP/1.1" 200 None 2026-03-12 02:28:06,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:28:06,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:28:06,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:28:06,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af81af275c8d3b7939aabb HTTP/1.1" 200 None 2026-03-12 02:28:06,856 - lava_callback - ERROR - Error processing callback for node 69af81af275c8d3b7939aabb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:29:26,796 - lava_callback - INFO - Received callback for node 69af81fd275c8d3b7939aac2 INFO: 172.21.0.1:51374 - "POST /node/69af81fd275c8d3b7939aac2 HTTP/1.0" 202 Accepted 2026-03-12 02:29:26,802 - lava_callback - INFO - Starting async job submit for node 69af81fd275c8d3b7939aac2 2026-03-12 02:29:26,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:29:26,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af81fd275c8d3b7939aac2 HTTP/1.1" 200 None 2026-03-12 02:29:26,836 - lava_callback - DEBUG - Processing node 69af81fd275c8d3b7939aac2: baseline-arm64-clabbe 2026-03-12 02:29:26,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af81fd275c8d3b7939aac2 2026-03-12 02:29:26,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:29:26,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af81fd275c8d3b7939aac2 HTTP/1.1" 200 None 2026-03-12 02:29:26,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:29:26,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 02:29:26,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:29:26,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af81fd275c8d3b7939aac2 HTTP/1.1" 200 None 2026-03-12 02:29:26,898 - lava_callback - ERROR - Error processing callback for node 69af81fd275c8d3b7939aac2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:33:13,051 - lava_callback - INFO - Received callback for node 69af82e3275c8d3b7939aaef INFO: 172.21.0.1:44930 - "POST /node/69af82e3275c8d3b7939aaef HTTP/1.0" 202 Accepted 2026-03-12 02:33:13,057 - lava_callback - INFO - Starting async job submit for node 69af82e3275c8d3b7939aaef 2026-03-12 02:33:13,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:33:13,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af82e3275c8d3b7939aaef HTTP/1.1" 200 None 2026-03-12 02:33:13,078 - lava_callback - DEBUG - Processing node 69af82e3275c8d3b7939aaef: baseline-arm64-baylibre 2026-03-12 02:33:13,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af82e3275c8d3b7939aaef 2026-03-12 02:33:13,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:33:13,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af82e3275c8d3b7939aaef HTTP/1.1" 200 None 2026-03-12 02:33:13,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:33:13,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:33:13,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:33:13,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af82e3275c8d3b7939aaef HTTP/1.1" 200 None 2026-03-12 02:33:13,138 - lava_callback - ERROR - Error processing callback for node 69af82e3275c8d3b7939aaef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57404 - "GET /node/69ae17658ef4424e487b3429%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:35:53,514 - lava_callback - INFO - Received callback for node 69af8384275c8d3b7939ab16 INFO: 172.21.0.1:51342 - "POST /node/69af8384275c8d3b7939ab16 HTTP/1.0" 202 Accepted 2026-03-12 02:35:53,520 - lava_callback - INFO - Starting async job submit for node 69af8384275c8d3b7939ab16 2026-03-12 02:35:53,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:35:53,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8384275c8d3b7939ab16 HTTP/1.1" 200 None 2026-03-12 02:35:53,546 - lava_callback - DEBUG - Processing node 69af8384275c8d3b7939ab16: baseline-arm64-baylibre 2026-03-12 02:35:53,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8384275c8d3b7939ab16 2026-03-12 02:35:53,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:35:53,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8384275c8d3b7939ab16 HTTP/1.1" 200 None 2026-03-12 02:35:53,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:35:53,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:35:53,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:35:53,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8384275c8d3b7939ab16 HTTP/1.1" 200 None 2026-03-12 02:35:53,603 - lava_callback - ERROR - Error processing callback for node 69af8384275c8d3b7939ab16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:38:33,333 - lava_callback - INFO - Received callback for node 69af8420275c8d3b7939ab31 INFO: 172.21.0.1:49128 - "POST /node/69af8420275c8d3b7939ab31 HTTP/1.0" 202 Accepted 2026-03-12 02:38:33,338 - lava_callback - INFO - Starting async job submit for node 69af8420275c8d3b7939ab31 2026-03-12 02:38:33,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:38:33,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8420275c8d3b7939ab31 HTTP/1.1" 200 None 2026-03-12 02:38:33,371 - lava_callback - DEBUG - Processing node 69af8420275c8d3b7939ab31: baseline-arm64-baylibre 2026-03-12 02:38:33,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8420275c8d3b7939ab31 2026-03-12 02:38:33,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:38:33,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8420275c8d3b7939ab31 HTTP/1.1" 200 None 2026-03-12 02:38:33,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:38:33,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:38:33,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:38:33,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8420275c8d3b7939ab31 HTTP/1.1" 200 None 2026-03-12 02:38:33,423 - lava_callback - ERROR - Error processing callback for node 69af8420275c8d3b7939ab31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:41:13,384 - lava_callback - INFO - Received callback for node 69af84ba275c8d3b7939ab48 INFO: 172.21.0.1:42562 - "POST /node/69af84ba275c8d3b7939ab48 HTTP/1.0" 202 Accepted 2026-03-12 02:41:13,390 - lava_callback - INFO - Starting async job submit for node 69af84ba275c8d3b7939ab48 2026-03-12 02:41:13,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:41:13,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af84ba275c8d3b7939ab48 HTTP/1.1" 200 None 2026-03-12 02:41:13,418 - lava_callback - DEBUG - Processing node 69af84ba275c8d3b7939ab48: baseline-arm64-baylibre 2026-03-12 02:41:13,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af84ba275c8d3b7939ab48 2026-03-12 02:41:13,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:41:13,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af84ba275c8d3b7939ab48 HTTP/1.1" 200 None 2026-03-12 02:41:13,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:41:13,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:41:13,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:41:13,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af84ba275c8d3b7939ab48 HTTP/1.1" 200 None 2026-03-12 02:41:13,474 - lava_callback - ERROR - Error processing callback for node 69af84ba275c8d3b7939ab48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:42:20,005 - lava_callback - INFO - Received callback for node 69b2241db0f5558b5d7cd45c INFO: 172.21.0.1:41832 - "POST /node/69b2241db0f5558b5d7cd45c HTTP/1.0" 202 Accepted 2026-03-12 02:42:20,012 - lava_callback - INFO - Starting async job submit for node 69b2241db0f5558b5d7cd45c 2026-03-12 02:42:20,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:20,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2241db0f5558b5d7cd45c HTTP/1.1" 200 None 2026-03-12 02:42:20,086 - lava_callback - DEBUG - Processing node 69b2241db0f5558b5d7cd45c: baseline-arm 2026-03-12 02:42:20,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:42:20,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:42:20,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b2241db0f5558b5d7cd45c/log.txt.gz 2026-03-12 02:42:21,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:42:21,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:42:21,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b2241db0f5558b5d7cd45c/lava-logs.yaml 2026-03-12 02:42:21,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:42:21,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:42:21,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b2241db0f5558b5d7cd45c/lava_callback.json.gz DEBUG: Setup failed for 69b2241db0f5558b5d7cd45c. Transitting job node result: incomplete -> fail 2026-03-12 02:42:21,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:21,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2241db0f5558b5d7cd45c HTTP/1.1" 200 None 2026-03-12 02:42:21,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:21,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 02:42:21,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:21,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2241db0f5558b5d7cd45c HTTP/1.1" 200 None 2026-03-12 02:42:21,920 - lava_callback - INFO - Completed processing callback for node 69b2241db0f5558b5d7cd45c INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:42:28,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:29,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-12 02:42:33,642 - lava_callback - INFO - Received callback for node 69af850b275c8d3b7939ab56 INFO: 172.21.0.1:49290 - "POST /node/69af850b275c8d3b7939ab56 HTTP/1.0" 202 Accepted 2026-03-12 02:42:33,648 - lava_callback - INFO - Starting async job submit for node 69af850b275c8d3b7939ab56 2026-03-12 02:42:33,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:33,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af850b275c8d3b7939ab56 HTTP/1.1" 200 None 2026-03-12 02:42:33,679 - lava_callback - DEBUG - Processing node 69af850b275c8d3b7939ab56: baseline-arm64-baylibre 2026-03-12 02:42:33,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af850b275c8d3b7939ab56 2026-03-12 02:42:33,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:33,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af850b275c8d3b7939ab56 HTTP/1.1" 200 None 2026-03-12 02:42:33,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:33,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:42:33,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:42:33,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af850b275c8d3b7939ab56 HTTP/1.1" 200 None 2026-03-12 02:42:33,765 - lava_callback - ERROR - Error processing callback for node 69af850b275c8d3b7939ab56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:45:13,698 - lava_callback - INFO - Received callback for node 69af85ab275c8d3b7939ab76 INFO: 172.21.0.1:59854 - "POST /node/69af85ab275c8d3b7939ab76 HTTP/1.0" 202 Accepted 2026-03-12 02:45:13,704 - lava_callback - INFO - Starting async job submit for node 69af85ab275c8d3b7939ab76 2026-03-12 02:45:13,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:45:13,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af85ab275c8d3b7939ab76 HTTP/1.1" 200 None 2026-03-12 02:45:13,720 - lava_callback - DEBUG - Processing node 69af85ab275c8d3b7939ab76: baseline-arm64-baylibre 2026-03-12 02:45:13,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af85ab275c8d3b7939ab76 2026-03-12 02:45:13,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:45:13,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af85ab275c8d3b7939ab76 HTTP/1.1" 200 None 2026-03-12 02:45:13,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:45:13,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-12 02:45:13,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:45:13,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af85ab275c8d3b7939ab76 HTTP/1.1" 200 None 2026-03-12 02:45:13,777 - lava_callback - ERROR - Error processing callback for node 69af85ab275c8d3b7939ab76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:47:30,698 - lava_callback - INFO - Received callback for node 69b226eab0f5558b5d7cd502 INFO: 172.21.0.1:44738 - "POST /node/69b226eab0f5558b5d7cd502 HTTP/1.0" 202 Accepted 2026-03-12 02:47:30,705 - lava_callback - INFO - Starting async job submit for node 69b226eab0f5558b5d7cd502 2026-03-12 02:47:30,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:30,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b226eab0f5558b5d7cd502 HTTP/1.1" 200 None 2026-03-12 02:47:30,755 - lava_callback - DEBUG - Processing node 69b226eab0f5558b5d7cd502: baseline-arm64 2026-03-12 02:47:31,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:47:31,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:47:31,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b226eab0f5558b5d7cd502/log.txt.gz 2026-03-12 02:47:31,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:47:31,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:47:31,808 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b226eab0f5558b5d7cd502/lava-logs.yaml 2026-03-12 02:47:31,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:47:32,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:47:32,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b226eab0f5558b5d7cd502/lava_callback.json.gz DEBUG: Setup failed for 69b226eab0f5558b5d7cd502. Transitting job node result: incomplete -> fail 2026-03-12 02:47:32,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:32,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b226eab0f5558b5d7cd502 HTTP/1.1" 200 None 2026-03-12 02:47:32,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:32,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:47:32,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:32,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b226eab0f5558b5d7cd502 HTTP/1.1" 200 None 2026-03-12 02:47:32,253 - lava_callback - INFO - Completed processing callback for node 69b226eab0f5558b5d7cd502 INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:47:59,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:47:59,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:49:28,501 - lava_callback - INFO - Received callback for node 69b22535b0f5558b5d7cd48b INFO: 172.21.0.1:43380 - "POST /node/69b22535b0f5558b5d7cd48b HTTP/1.0" 202 Accepted 2026-03-12 02:49:28,549 - lava_callback - INFO - Starting async job submit for node 69b22535b0f5558b5d7cd48b 2026-03-12 02:49:28,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:28,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22535b0f5558b5d7cd48b HTTP/1.1" 200 None 2026-03-12 02:49:28,588 - lava_callback - DEBUG - Processing node 69b22535b0f5558b5d7cd48b: baseline-arm-pengutronix 2026-03-12 02:49:28,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:28,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:28,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22535b0f5558b5d7cd48b/log.txt.gz 2026-03-12 02:49:28,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:29,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:29,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22535b0f5558b5d7cd48b/lava-logs.yaml 2026-03-12 02:49:29,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:29,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:29,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22535b0f5558b5d7cd48b/lava_callback.json.gz DEBUG: Setup failed for 69b22535b0f5558b5d7cd48b. Transitting job node result: incomplete -> fail 2026-03-12 02:49:29,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:29,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22535b0f5558b5d7cd48b HTTP/1.1" 200 None 2026-03-12 02:49:29,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:29,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 02:49:29,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:29,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22535b0f5558b5d7cd48b HTTP/1.1" 200 None 2026-03-12 02:49:29,348 - lava_callback - INFO - Completed processing callback for node 69b22535b0f5558b5d7cd48b INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:49:54,337 - lava_callback - INFO - Received callback for node 69b2259bb0f5558b5d7cd4a0 INFO: 172.21.0.1:47314 - "POST /node/69b2259bb0f5558b5d7cd4a0 HTTP/1.0" 202 Accepted 2026-03-12 02:49:54,343 - lava_callback - INFO - Starting async job submit for node 69b2259bb0f5558b5d7cd4a0 2026-03-12 02:49:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:54,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2259bb0f5558b5d7cd4a0 HTTP/1.1" 200 None 2026-03-12 02:49:54,437 - lava_callback - DEBUG - Processing node 69b2259bb0f5558b5d7cd4a0: ltp-smoke 2026-03-12 02:49:54,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:55,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:55,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2259bb0f5558b5d7cd4a0/log.txt.gz 2026-03-12 02:49:55,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:55,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:55,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2259bb0f5558b5d7cd4a0/lava-logs.yaml 2026-03-12 02:49:55,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:49:55,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:49:55,787 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b2259bb0f5558b5d7cd4a0/lava_callback.json.gz 2026-03-12 02:49:55,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:55,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2259bb0f5558b5d7cd4a0 HTTP/1.1" 200 None 2026-03-12 02:49:55,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:55,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20610b0f5558b5d7cc5e9 HTTP/1.1" 200 None 2026-03-12 02:49:55,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:55,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2259bb0f5558b5d7cd4a0 HTTP/1.1" 200 None 2026-03-12 02:49:56,105 - lava_callback - INFO - Completed processing callback for node 69b2259bb0f5558b5d7cd4a0 INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:49:59,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:49:59,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:50:28,930 - lava_callback - INFO - Received callback for node 69b22555b0f5558b5d7cd49a INFO: 172.21.0.1:54082 - "POST /node/69b22555b0f5558b5d7cd49a HTTP/1.0" 202 Accepted 2026-03-12 02:50:28,938 - lava_callback - INFO - Starting async job submit for node 69b22555b0f5558b5d7cd49a 2026-03-12 02:50:28,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:28,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22555b0f5558b5d7cd49a HTTP/1.1" 200 None 2026-03-12 02:50:28,997 - lava_callback - DEBUG - Processing node 69b22555b0f5558b5d7cd49a: baseline-nfs-arm64 2026-03-12 02:50:30,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:50:30,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:50:30,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22555b0f5558b5d7cd49a/log.txt.gz 2026-03-12 02:50:30,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:50:31,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:50:31,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22555b0f5558b5d7cd49a/lava-logs.yaml 2026-03-12 02:50:31,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 02:50:31,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 02:50:31,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22555b0f5558b5d7cd49a/lava_callback.json.gz DEBUG: Setup failed for 69b22555b0f5558b5d7cd49a. Transitting job node result: incomplete -> fail 2026-03-12 02:50:31,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:31,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22555b0f5558b5d7cd49a HTTP/1.1" 200 None 2026-03-12 02:50:31,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:31,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 02:50:31,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:31,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22555b0f5558b5d7cd49a HTTP/1.1" 200 None 2026-03-12 02:50:31,662 - lava_callback - INFO - Completed processing callback for node 69b22555b0f5558b5d7cd49a INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK 2026-03-12 02:50:59,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 02:50:59,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:05:21,456 - lava_callback - INFO - Received callback for node 69b2296db0f5558b5d7cd57e INFO: 172.21.0.1:48662 - "POST /node/69b2296db0f5558b5d7cd57e HTTP/1.0" 202 Accepted 2026-03-12 03:05:21,462 - lava_callback - INFO - Starting async job submit for node 69b2296db0f5558b5d7cd57e 2026-03-12 03:05:21,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:21,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2296db0f5558b5d7cd57e HTTP/1.1" 200 None 2026-03-12 03:05:21,536 - lava_callback - DEBUG - Processing node 69b2296db0f5558b5d7cd57e: baseline-arm 2026-03-12 03:05:22,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:05:22,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:05:22,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b2296db0f5558b5d7cd57e/log.txt.gz 2026-03-12 03:05:22,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:05:22,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:05:22,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b2296db0f5558b5d7cd57e/lava-logs.yaml 2026-03-12 03:05:22,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:05:23,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:05:23,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b2296db0f5558b5d7cd57e/lava_callback.json.gz DEBUG: Setup failed for 69b2296db0f5558b5d7cd57e. Transitting job node result: incomplete -> fail 2026-03-12 03:05:23,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:23,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2296db0f5558b5d7cd57e HTTP/1.1" 200 None 2026-03-12 03:05:23,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:23,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 03:05:23,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:23,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b2296db0f5558b5d7cd57e HTTP/1.1" 200 None 2026-03-12 03:05:23,338 - lava_callback - INFO - Completed processing callback for node 69b2296db0f5558b5d7cd57e INFO: 172.21.0.1:48678 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:05:29,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:05:29,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:11:09,563 - lava_callback - INFO - Received callback for node 69b22a49b0f5558b5d7cd5f7 INFO: 172.21.0.1:35034 - "POST /node/69b22a49b0f5558b5d7cd5f7 HTTP/1.0" 202 Accepted 2026-03-12 03:11:09,609 - lava_callback - INFO - Starting async job submit for node 69b22a49b0f5558b5d7cd5f7 2026-03-12 03:11:09,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:09,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22a49b0f5558b5d7cd5f7 HTTP/1.1" 200 None 2026-03-12 03:11:09,647 - lava_callback - DEBUG - Processing node 69b22a49b0f5558b5d7cd5f7: baseline-arm-pengutronix 2026-03-12 03:11:09,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:11:09,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:11:09,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22a49b0f5558b5d7cd5f7/log.txt.gz 2026-03-12 03:11:10,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:11:10,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:11:10,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22a49b0f5558b5d7cd5f7/lava-logs.yaml 2026-03-12 03:11:10,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:11:10,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:11:10,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b22a49b0f5558b5d7cd5f7/lava_callback.json.gz DEBUG: Setup failed for 69b22a49b0f5558b5d7cd5f7. Transitting job node result: incomplete -> fail 2026-03-12 03:11:10,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:10,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22a49b0f5558b5d7cd5f7 HTTP/1.1" 200 None 2026-03-12 03:11:10,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:10,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-12 03:11:10,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:10,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22a49b0f5558b5d7cd5f7 HTTP/1.1" 200 None 2026-03-12 03:11:10,531 - lava_callback - INFO - Completed processing callback for node 69b22a49b0f5558b5d7cd5f7 INFO: 172.21.0.1:43472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:11:29,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:11:29,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:13:32,329 - lava_callback - INFO - Received callback for node 69b22ab9b0f5558b5d7cd613 INFO: 172.21.0.1:57274 - "POST /node/69b22ab9b0f5558b5d7cd613 HTTP/1.0" 202 Accepted 2026-03-12 03:13:32,337 - lava_callback - INFO - Starting async job submit for node 69b22ab9b0f5558b5d7cd613 2026-03-12 03:13:32,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:32,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22ab9b0f5558b5d7cd613 HTTP/1.1" 200 None 2026-03-12 03:13:32,395 - lava_callback - DEBUG - Processing node 69b22ab9b0f5558b5d7cd613: baseline-nfs-arm64 2026-03-12 03:13:33,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:13:33,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:13:33,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22ab9b0f5558b5d7cd613/log.txt.gz 2026-03-12 03:13:34,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:13:34,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:13:34,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22ab9b0f5558b5d7cd613/lava-logs.yaml 2026-03-12 03:13:34,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 03:13:34,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 03:13:34,834 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b22ab9b0f5558b5d7cd613/lava_callback.json.gz DEBUG: Setup failed for 69b22ab9b0f5558b5d7cd613. Transitting job node result: incomplete -> fail 2026-03-12 03:13:34,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:34,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b22ab9b0f5558b5d7cd613 HTTP/1.1" 200 None 2026-03-12 03:13:34,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:34,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 03:13:34,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:34,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b22ab9b0f5558b5d7cd613 HTTP/1.1" 200 None 2026-03-12 03:13:35,074 - lava_callback - INFO - Completed processing callback for node 69b22ab9b0f5558b5d7cd613 INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:13:59,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:13:59,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:16:35,481 - lava_callback - INFO - Received callback for node 69af8d03275c8d3b7939ad63 INFO: 172.21.0.1:54844 - "POST /node/69af8d03275c8d3b7939ad63 HTTP/1.0" 202 Accepted 2026-03-12 03:16:35,486 - lava_callback - INFO - Starting async job submit for node 69af8d03275c8d3b7939ad63 2026-03-12 03:16:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:16:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d03275c8d3b7939ad63 HTTP/1.1" 200 None 2026-03-12 03:16:35,505 - lava_callback - DEBUG - Processing node 69af8d03275c8d3b7939ad63: baseline-arm-baylibre 2026-03-12 03:16:35,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8d03275c8d3b7939ad63 2026-03-12 03:16:35,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:16:35,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d03275c8d3b7939ad63 HTTP/1.1" 200 None 2026-03-12 03:16:35,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:16:35,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:16:35,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:16:35,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8d03275c8d3b7939ad63 HTTP/1.1" 200 None 2026-03-12 03:16:35,561 - lava_callback - ERROR - Error processing callback for node 69af8d03275c8d3b7939ad63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 03:17:15,417 - lava_callback - INFO - Received callback for node 69af8d2c275c8d3b7939ad70 INFO: 172.21.0.1:44006 - "POST /node/69af8d2c275c8d3b7939ad70 HTTP/1.0" 202 Accepted 2026-03-12 03:17:15,423 - lava_callback - INFO - Starting async job submit for node 69af8d2c275c8d3b7939ad70 2026-03-12 03:17:15,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:15,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d2c275c8d3b7939ad70 HTTP/1.1" 200 None 2026-03-12 03:17:15,460 - lava_callback - DEBUG - Processing node 69af8d2c275c8d3b7939ad70: baseline-arm-baylibre 2026-03-12 03:17:15,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8d2c275c8d3b7939ad70 2026-03-12 03:17:15,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:15,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d2c275c8d3b7939ad70 HTTP/1.1" 200 None 2026-03-12 03:17:15,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:15,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:17:15,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:15,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8d2c275c8d3b7939ad70 HTTP/1.1" 200 None 2026-03-12 03:17:15,519 - lava_callback - ERROR - Error processing callback for node 69af8d2c275c8d3b7939ad70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:17:55,512 - lava_callback - INFO - Received callback for node 69af8d54275c8d3b7939ad7a INFO: 172.21.0.1:37706 - "POST /node/69af8d54275c8d3b7939ad7a HTTP/1.0" 202 Accepted 2026-03-12 03:17:55,518 - lava_callback - INFO - Starting async job submit for node 69af8d54275c8d3b7939ad7a 2026-03-12 03:17:55,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:55,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d54275c8d3b7939ad7a HTTP/1.1" 200 None 2026-03-12 03:17:55,533 - lava_callback - DEBUG - Processing node 69af8d54275c8d3b7939ad7a: baseline-arm-baylibre 2026-03-12 03:17:55,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8d54275c8d3b7939ad7a 2026-03-12 03:17:55,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:55,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8d54275c8d3b7939ad7a HTTP/1.1" 200 None 2026-03-12 03:17:55,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:55,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:17:55,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:17:55,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8d54275c8d3b7939ad7a HTTP/1.1" 200 None 2026-03-12 03:17:55,590 - lava_callback - ERROR - Error processing callback for node 69af8d54275c8d3b7939ad7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 03:21:15,659 - lava_callback - INFO - Received callback for node 69af8e18275c8d3b7939adab INFO: 172.21.0.1:35224 - "POST /node/69af8e18275c8d3b7939adab HTTP/1.0" 202 Accepted 2026-03-12 03:21:15,665 - lava_callback - INFO - Starting async job submit for node 69af8e18275c8d3b7939adab 2026-03-12 03:21:15,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:21:15,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8e18275c8d3b7939adab HTTP/1.1" 200 None 2026-03-12 03:21:15,681 - lava_callback - DEBUG - Processing node 69af8e18275c8d3b7939adab: baseline-arm-baylibre 2026-03-12 03:21:15,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8e18275c8d3b7939adab 2026-03-12 03:21:15,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:21:15,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8e18275c8d3b7939adab HTTP/1.1" 200 None 2026-03-12 03:21:15,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:21:15,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:21:15,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:21:15,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8e18275c8d3b7939adab HTTP/1.1" 200 None 2026-03-12 03:21:15,789 - lava_callback - ERROR - Error processing callback for node 69af8e18275c8d3b7939adab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:22:55,969 - lava_callback - INFO - Received callback for node 69af8e8e275c8d3b7939adc3 INFO: 172.21.0.1:45680 - "POST /node/69af8e8e275c8d3b7939adc3 HTTP/1.0" 202 Accepted 2026-03-12 03:22:55,975 - lava_callback - INFO - Starting async job submit for node 69af8e8e275c8d3b7939adc3 2026-03-12 03:22:55,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:22:55,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8e8e275c8d3b7939adc3 HTTP/1.1" 200 None 2026-03-12 03:22:55,992 - lava_callback - DEBUG - Processing node 69af8e8e275c8d3b7939adc3: baseline-arm-baylibre 2026-03-12 03:22:55,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8e8e275c8d3b7939adc3 2026-03-12 03:22:55,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:22:56,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8e8e275c8d3b7939adc3 HTTP/1.1" 200 None 2026-03-12 03:22:56,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:22:56,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:22:56,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:22:56,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8e8e275c8d3b7939adc3 HTTP/1.1" 200 None 2026-03-12 03:22:56,052 - lava_callback - ERROR - Error processing callback for node 69af8e8e275c8d3b7939adc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:26:29,236 - lava_callback - INFO - Received callback for node 69af8f5a275c8d3b7939adf3 INFO: 172.21.0.1:40908 - "POST /node/69af8f5a275c8d3b7939adf3 HTTP/1.0" 202 Accepted 2026-03-12 03:26:29,242 - lava_callback - INFO - Starting async job submit for node 69af8f5a275c8d3b7939adf3 2026-03-12 03:26:29,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:26:29,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8f5a275c8d3b7939adf3 HTTP/1.1" 200 None 2026-03-12 03:26:29,259 - lava_callback - DEBUG - Processing node 69af8f5a275c8d3b7939adf3: baseline-arm-clabbe 2026-03-12 03:26:29,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8f5a275c8d3b7939adf3 2026-03-12 03:26:29,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:26:29,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8f5a275c8d3b7939adf3 HTTP/1.1" 200 None 2026-03-12 03:26:29,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:26:29,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:26:29,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:26:29,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8f5a275c8d3b7939adf3 HTTP/1.1" 200 None 2026-03-12 03:26:29,319 - lava_callback - ERROR - Error processing callback for node 69af8f5a275c8d3b7939adf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:27:09,205 - lava_callback - INFO - Received callback for node 69af8f83275c8d3b7939adff INFO: 172.21.0.1:34028 - "POST /node/69af8f83275c8d3b7939adff HTTP/1.0" 202 Accepted 2026-03-12 03:27:09,210 - lava_callback - INFO - Starting async job submit for node 69af8f83275c8d3b7939adff 2026-03-12 03:27:09,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:09,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8f83275c8d3b7939adff HTTP/1.1" 200 None 2026-03-12 03:27:09,228 - lava_callback - DEBUG - Processing node 69af8f83275c8d3b7939adff: baseline-arm-clabbe 2026-03-12 03:27:09,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8f83275c8d3b7939adff 2026-03-12 03:27:09,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:09,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8f83275c8d3b7939adff HTTP/1.1" 200 None 2026-03-12 03:27:09,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:09,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:27:09,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:09,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8f83275c8d3b7939adff HTTP/1.1" 200 None 2026-03-12 03:27:09,284 - lava_callback - ERROR - Error processing callback for node 69af8f83275c8d3b7939adff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:27:49,285 - lava_callback - INFO - Received callback for node 69af8fad275c8d3b7939ae07 INFO: 172.21.0.1:60192 - "POST /node/69af8fad275c8d3b7939ae07 HTTP/1.0" 202 Accepted 2026-03-12 03:27:49,290 - lava_callback - INFO - Starting async job submit for node 69af8fad275c8d3b7939ae07 2026-03-12 03:27:49,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:49,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8fad275c8d3b7939ae07 HTTP/1.1" 200 None 2026-03-12 03:27:49,306 - lava_callback - DEBUG - Processing node 69af8fad275c8d3b7939ae07: baseline-arm-clabbe 2026-03-12 03:27:49,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8fad275c8d3b7939ae07 2026-03-12 03:27:49,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:49,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8fad275c8d3b7939ae07 HTTP/1.1" 200 None 2026-03-12 03:27:49,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:49,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:27:49,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:27:49,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8fad275c8d3b7939ae07 HTTP/1.1" 200 None 2026-03-12 03:27:49,367 - lava_callback - ERROR - Error processing callback for node 69af8fad275c8d3b7939ae07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:28:29,292 - lava_callback - INFO - Received callback for node 69af8fd5275c8d3b7939ae11 INFO: 172.21.0.1:41534 - "POST /node/69af8fd5275c8d3b7939ae11 HTTP/1.0" 202 Accepted 2026-03-12 03:28:29,297 - lava_callback - INFO - Starting async job submit for node 69af8fd5275c8d3b7939ae11 2026-03-12 03:28:29,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:28:29,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8fd5275c8d3b7939ae11 HTTP/1.1" 200 None 2026-03-12 03:28:29,318 - lava_callback - DEBUG - Processing node 69af8fd5275c8d3b7939ae11: baseline-arm-clabbe 2026-03-12 03:28:29,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af8fd5275c8d3b7939ae11 2026-03-12 03:28:29,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:28:29,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af8fd5275c8d3b7939ae11 HTTP/1.1" 200 None 2026-03-12 03:28:29,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:28:29,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:28:29,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:28:29,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af8fd5275c8d3b7939ae11 HTTP/1.1" 200 None 2026-03-12 03:28:29,379 - lava_callback - ERROR - Error processing callback for node 69af8fd5275c8d3b7939ae11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK 2026-03-12 03:30:29,438 - lava_callback - INFO - Received callback for node 69af904c275c8d3b7939ae28 INFO: 172.21.0.1:33420 - "POST /node/69af904c275c8d3b7939ae28 HTTP/1.0" 202 Accepted 2026-03-12 03:30:29,444 - lava_callback - INFO - Starting async job submit for node 69af904c275c8d3b7939ae28 2026-03-12 03:30:29,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:30:29,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af904c275c8d3b7939ae28 HTTP/1.1" 200 None 2026-03-12 03:30:29,461 - lava_callback - DEBUG - Processing node 69af904c275c8d3b7939ae28: baseline-arm-clabbe 2026-03-12 03:30:29,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af904c275c8d3b7939ae28 2026-03-12 03:30:29,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:30:29,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af904c275c8d3b7939ae28 HTTP/1.1" 200 None 2026-03-12 03:30:29,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:30:29,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-12 03:30:29,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 03:30:29,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af904c275c8d3b7939ae28 HTTP/1.1" 200 None 2026-03-12 03:30:29,523 - lava_callback - ERROR - Error processing callback for node 69af904c275c8d3b7939ae28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:04:58,215 - lava_callback - INFO - Received callback for node 69af985a275c8d3b7939afc3 INFO: 172.21.0.1:48544 - "POST /node/69af985a275c8d3b7939afc3 HTTP/1.0" 202 Accepted 2026-03-12 04:04:58,220 - lava_callback - INFO - Starting async job submit for node 69af985a275c8d3b7939afc3 2026-03-12 04:04:58,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:04:58,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af985a275c8d3b7939afc3 HTTP/1.1" 200 None 2026-03-12 04:04:58,237 - lava_callback - DEBUG - Processing node 69af985a275c8d3b7939afc3: baseline-arm64-baylibre 2026-03-12 04:04:58,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af985a275c8d3b7939afc3 2026-03-12 04:04:58,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:04:58,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af985a275c8d3b7939afc3 HTTP/1.1" 200 None 2026-03-12 04:04:58,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:04:58,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:04:58,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:04:58,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af985a275c8d3b7939afc3 HTTP/1.1" 200 None 2026-03-12 04:04:58,291 - lava_callback - ERROR - Error processing callback for node 69af985a275c8d3b7939afc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:07:38,298 - lava_callback - INFO - Received callback for node 69af98f5275c8d3b7939afe0 INFO: 172.21.0.1:47038 - "POST /node/69af98f5275c8d3b7939afe0 HTTP/1.0" 202 Accepted 2026-03-12 04:07:38,303 - lava_callback - INFO - Starting async job submit for node 69af98f5275c8d3b7939afe0 2026-03-12 04:07:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:07:38,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af98f5275c8d3b7939afe0 HTTP/1.1" 200 None 2026-03-12 04:07:38,320 - lava_callback - DEBUG - Processing node 69af98f5275c8d3b7939afe0: baseline-arm64-baylibre 2026-03-12 04:07:38,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af98f5275c8d3b7939afe0 2026-03-12 04:07:38,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:07:38,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af98f5275c8d3b7939afe0 HTTP/1.1" 200 None 2026-03-12 04:07:38,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:07:38,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:07:38,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:07:38,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af98f5275c8d3b7939afe0 HTTP/1.1" 200 None 2026-03-12 04:07:38,377 - lava_callback - ERROR - Error processing callback for node 69af98f5275c8d3b7939afe0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:09:58,444 - lava_callback - INFO - Received callback for node 69af998e275c8d3b7939afff INFO: 172.21.0.1:37170 - "POST /node/69af998e275c8d3b7939afff HTTP/1.0" 202 Accepted 2026-03-12 04:09:58,450 - lava_callback - INFO - Starting async job submit for node 69af998e275c8d3b7939afff 2026-03-12 04:09:58,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:09:58,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af998e275c8d3b7939afff HTTP/1.1" 200 None 2026-03-12 04:09:58,483 - lava_callback - DEBUG - Processing node 69af998e275c8d3b7939afff: baseline-arm64-baylibre 2026-03-12 04:09:58,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af998e275c8d3b7939afff 2026-03-12 04:09:58,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:09:58,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af998e275c8d3b7939afff HTTP/1.1" 200 None 2026-03-12 04:09:58,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:09:58,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:09:58,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:09:58,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af998e275c8d3b7939afff HTTP/1.1" 200 None 2026-03-12 04:09:58,546 - lava_callback - ERROR - Error processing callback for node 69af998e275c8d3b7939afff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:11:18,645 - lava_callback - INFO - Received callback for node 69af99dd275c8d3b7939b011 INFO: 172.21.0.1:48180 - "POST /node/69af99dd275c8d3b7939b011 HTTP/1.0" 202 Accepted 2026-03-12 04:11:18,651 - lava_callback - INFO - Starting async job submit for node 69af99dd275c8d3b7939b011 2026-03-12 04:11:18,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:11:18,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af99dd275c8d3b7939b011 HTTP/1.1" 200 None 2026-03-12 04:11:18,666 - lava_callback - DEBUG - Processing node 69af99dd275c8d3b7939b011: baseline-arm64-baylibre 2026-03-12 04:11:18,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af99dd275c8d3b7939b011 2026-03-12 04:11:18,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:11:18,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af99dd275c8d3b7939b011 HTTP/1.1" 200 None 2026-03-12 04:11:18,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:11:18,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:11:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:11:18,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af99dd275c8d3b7939b011 HTTP/1.1" 200 None 2026-03-12 04:11:18,718 - lava_callback - ERROR - Error processing callback for node 69af99dd275c8d3b7939b011: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:12:38,555 - lava_callback - INFO - Received callback for node 69af9a2b275c8d3b7939b01f INFO: 172.21.0.1:45058 - "POST /node/69af9a2b275c8d3b7939b01f HTTP/1.0" 202 Accepted 2026-03-12 04:12:38,561 - lava_callback - INFO - Starting async job submit for node 69af9a2b275c8d3b7939b01f 2026-03-12 04:12:38,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:12:38,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9a2b275c8d3b7939b01f HTTP/1.1" 200 None 2026-03-12 04:12:38,580 - lava_callback - DEBUG - Processing node 69af9a2b275c8d3b7939b01f: baseline-arm64-baylibre 2026-03-12 04:12:38,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9a2b275c8d3b7939b01f 2026-03-12 04:12:38,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:12:38,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9a2b275c8d3b7939b01f HTTP/1.1" 200 None 2026-03-12 04:12:38,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:12:38,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:12:38,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:12:38,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9a2b275c8d3b7939b01f HTTP/1.1" 200 None 2026-03-12 04:12:38,644 - lava_callback - ERROR - Error processing callback for node 69af9a2b275c8d3b7939b01f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:15:18,695 - lava_callback - INFO - Received callback for node 69af9ac5275c8d3b7939b02e INFO: 172.21.0.1:34256 - "POST /node/69af9ac5275c8d3b7939b02e HTTP/1.0" 202 Accepted 2026-03-12 04:15:18,701 - lava_callback - INFO - Starting async job submit for node 69af9ac5275c8d3b7939b02e 2026-03-12 04:15:18,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:15:18,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9ac5275c8d3b7939b02e HTTP/1.1" 200 None 2026-03-12 04:15:18,724 - lava_callback - DEBUG - Processing node 69af9ac5275c8d3b7939b02e: baseline-arm64-baylibre 2026-03-12 04:15:18,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9ac5275c8d3b7939b02e 2026-03-12 04:15:18,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:15:18,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9ac5275c8d3b7939b02e HTTP/1.1" 200 None 2026-03-12 04:15:18,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:15:18,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:15:18,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:15:18,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9ac5275c8d3b7939b02e HTTP/1.1" 200 None 2026-03-12 04:15:18,774 - lava_callback - ERROR - Error processing callback for node 69af9ac5275c8d3b7939b02e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:17:51,384 - lava_callback - INFO - Received callback for node 69af9b64275c8d3b7939b043 INFO: 172.21.0.1:56208 - "POST /node/69af9b64275c8d3b7939b043 HTTP/1.0" 202 Accepted 2026-03-12 04:17:51,390 - lava_callback - INFO - Starting async job submit for node 69af9b64275c8d3b7939b043 2026-03-12 04:17:51,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:17:51,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9b64275c8d3b7939b043 HTTP/1.1" 200 None 2026-03-12 04:17:51,406 - lava_callback - DEBUG - Processing node 69af9b64275c8d3b7939b043: baseline-arm64-clabbe 2026-03-12 04:17:51,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9b64275c8d3b7939b043 2026-03-12 04:17:51,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:17:51,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9b64275c8d3b7939b043 HTTP/1.1" 200 None 2026-03-12 04:17:51,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:17:51,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:17:51,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:17:51,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9b64275c8d3b7939b043 HTTP/1.1" 200 None 2026-03-12 04:17:51,497 - lava_callback - ERROR - Error processing callback for node 69af9b64275c8d3b7939b043: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:19:11,529 - lava_callback - INFO - Received callback for node 69af9bb2275c8d3b7939b04c INFO: 172.21.0.1:54660 - "POST /node/69af9bb2275c8d3b7939b04c HTTP/1.0" 202 Accepted 2026-03-12 04:19:11,535 - lava_callback - INFO - Starting async job submit for node 69af9bb2275c8d3b7939b04c 2026-03-12 04:19:11,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:19:11,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9bb2275c8d3b7939b04c HTTP/1.1" 200 None 2026-03-12 04:19:11,551 - lava_callback - DEBUG - Processing node 69af9bb2275c8d3b7939b04c: baseline-arm64-clabbe 2026-03-12 04:19:11,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9bb2275c8d3b7939b04c 2026-03-12 04:19:11,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:19:11,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9bb2275c8d3b7939b04c HTTP/1.1" 200 None 2026-03-12 04:19:11,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:19:11,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:19:11,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:19:11,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9bb2275c8d3b7939b04c HTTP/1.1" 200 None 2026-03-12 04:19:11,613 - lava_callback - ERROR - Error processing callback for node 69af9bb2275c8d3b7939b04c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:22:11,504 - lava_callback - INFO - Received callback for node 69af9c5f275c8d3b7939b05c INFO: 172.21.0.1:36442 - "POST /node/69af9c5f275c8d3b7939b05c HTTP/1.0" 202 Accepted 2026-03-12 04:22:11,510 - lava_callback - INFO - Starting async job submit for node 69af9c5f275c8d3b7939b05c 2026-03-12 04:22:11,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:22:11,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9c5f275c8d3b7939b05c HTTP/1.1" 200 None 2026-03-12 04:22:11,526 - lava_callback - DEBUG - Processing node 69af9c5f275c8d3b7939b05c: baseline-arm64-clabbe 2026-03-12 04:22:11,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9c5f275c8d3b7939b05c 2026-03-12 04:22:11,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:22:11,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9c5f275c8d3b7939b05c HTTP/1.1" 200 None 2026-03-12 04:22:11,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:22:11,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:22:11,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:22:11,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9c5f275c8d3b7939b05c HTTP/1.1" 200 None 2026-03-12 04:22:11,598 - lava_callback - ERROR - Error processing callback for node 69af9c5f275c8d3b7939b05c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:23:31,567 - lava_callback - INFO - Received callback for node 69af9cb3275c8d3b7939b06c INFO: 172.21.0.1:55422 - "POST /node/69af9cb3275c8d3b7939b06c HTTP/1.0" 202 Accepted 2026-03-12 04:23:31,573 - lava_callback - INFO - Starting async job submit for node 69af9cb3275c8d3b7939b06c 2026-03-12 04:23:31,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:23:31,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9cb3275c8d3b7939b06c HTTP/1.1" 200 None 2026-03-12 04:23:31,598 - lava_callback - DEBUG - Processing node 69af9cb3275c8d3b7939b06c: baseline-arm64-clabbe 2026-03-12 04:23:31,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9cb3275c8d3b7939b06c 2026-03-12 04:23:31,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:23:31,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9cb3275c8d3b7939b06c HTTP/1.1" 200 None 2026-03-12 04:23:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:23:31,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:23:31,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:23:31,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9cb3275c8d3b7939b06c HTTP/1.1" 200 None 2026-03-12 04:23:31,660 - lava_callback - ERROR - Error processing callback for node 69af9cb3275c8d3b7939b06c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:24:51,628 - lava_callback - INFO - Received callback for node 69af9d05275c8d3b7939b076 INFO: 172.21.0.1:56370 - "POST /node/69af9d05275c8d3b7939b076 HTTP/1.0" 202 Accepted 2026-03-12 04:24:51,634 - lava_callback - INFO - Starting async job submit for node 69af9d05275c8d3b7939b076 2026-03-12 04:24:51,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:24:51,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9d05275c8d3b7939b076 HTTP/1.1" 200 None 2026-03-12 04:24:51,655 - lava_callback - DEBUG - Processing node 69af9d05275c8d3b7939b076: baseline-arm64-clabbe 2026-03-12 04:24:51,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9d05275c8d3b7939b076 2026-03-12 04:24:51,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:24:51,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9d05275c8d3b7939b076 HTTP/1.1" 200 None 2026-03-12 04:24:51,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:24:51,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:24:51,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:24:51,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9d05275c8d3b7939b076 HTTP/1.1" 200 None 2026-03-12 04:24:51,766 - lava_callback - ERROR - Error processing callback for node 69af9d05275c8d3b7939b076: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:26:11,676 - lava_callback - INFO - Received callback for node 69af9d56275c8d3b7939b07f INFO: 172.21.0.1:35964 - "POST /node/69af9d56275c8d3b7939b07f HTTP/1.0" 202 Accepted 2026-03-12 04:26:11,682 - lava_callback - INFO - Starting async job submit for node 69af9d56275c8d3b7939b07f 2026-03-12 04:26:11,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:11,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9d56275c8d3b7939b07f HTTP/1.1" 200 None 2026-03-12 04:26:11,699 - lava_callback - DEBUG - Processing node 69af9d56275c8d3b7939b07f: baseline-arm64-clabbe 2026-03-12 04:26:11,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af9d56275c8d3b7939b07f 2026-03-12 04:26:11,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:11,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af9d56275c8d3b7939b07f HTTP/1.1" 200 None 2026-03-12 04:26:11,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:11,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-12 04:26:11,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:11,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af9d56275c8d3b7939b07f HTTP/1.1" 200 None 2026-03-12 04:26:11,761 - lava_callback - ERROR - Error processing callback for node 69af9d56275c8d3b7939b07f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:26:22,855 - lava_callback - INFO - Received callback for node 69b1c01ca26b422765ba3fa8 INFO: 172.21.0.1:56420 - "POST /node/69b1c01ca26b422765ba3fa8 HTTP/1.0" 202 Accepted 2026-03-12 04:26:22,861 - lava_callback - INFO - Starting async job submit for node 69b1c01ca26b422765ba3fa8 2026-03-12 04:26:22,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:22,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01ca26b422765ba3fa8 HTTP/1.1" 200 None 2026-03-12 04:26:22,902 - lava_callback - DEBUG - Processing node 69b1c01ca26b422765ba3fa8: baseline-arm64-broonie 2026-03-12 04:26:23,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:26:23,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:26:23,394 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ca26b422765ba3fa8/log.txt.gz 2026-03-12 04:26:23,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:26:23,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:26:23,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ca26b422765ba3fa8/lava-logs.yaml 2026-03-12 04:26:23,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:26:23,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:26:23,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ca26b422765ba3fa8/lava_callback.json.gz 2026-03-12 04:26:24,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:24,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01ca26b422765ba3fa8 HTTP/1.1" 200 None 2026-03-12 04:26:24,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:24,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 04:26:24,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:24,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c01ca26b422765ba3fa8 HTTP/1.1" 200 None 2026-03-12 04:26:24,066 - lava_callback - INFO - Completed processing callback for node 69b1c01ca26b422765ba3fa8 INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:26:29,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:26:29,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:28:22,959 - lava_callback - INFO - Received callback for node 69b20e4fb0f5558b5d7cccc0 INFO: 172.21.0.1:40774 - "POST /node/69b20e4fb0f5558b5d7cccc0 HTTP/1.0" 202 Accepted 2026-03-12 04:28:22,965 - lava_callback - INFO - Starting async job submit for node 69b20e4fb0f5558b5d7cccc0 2026-03-12 04:28:22,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:23,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4fb0f5558b5d7cccc0 HTTP/1.1" 200 None 2026-03-12 04:28:23,003 - lava_callback - DEBUG - Processing node 69b20e4fb0f5558b5d7cccc0: baseline-arm64-broonie 2026-03-12 04:28:23,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:28:23,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:28:23,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4fb0f5558b5d7cccc0/log.txt.gz 2026-03-12 04:28:23,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:28:23,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:28:23,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4fb0f5558b5d7cccc0/lava-logs.yaml 2026-03-12 04:28:23,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:28:24,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:28:24,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b20e4fb0f5558b5d7cccc0/lava_callback.json.gz 2026-03-12 04:28:24,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:24,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b20e4fb0f5558b5d7cccc0 HTTP/1.1" 200 None 2026-03-12 04:28:24,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:24,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-12 04:28:24,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:24,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b20e4fb0f5558b5d7cccc0 HTTP/1.1" 200 None 2026-03-12 04:28:24,190 - lava_callback - INFO - Completed processing callback for node 69b20e4fb0f5558b5d7cccc0 INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:28:29,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:28:29,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:30:23,733 - lava_callback - INFO - Received callback for node 69b21d5ab0f5558b5d7cd2e2 INFO: 172.21.0.1:37780 - "POST /node/69b21d5ab0f5558b5d7cd2e2 HTTP/1.0" 202 Accepted 2026-03-12 04:30:23,739 - lava_callback - INFO - Starting async job submit for node 69b21d5ab0f5558b5d7cd2e2 2026-03-12 04:30:23,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:23,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21d5ab0f5558b5d7cd2e2 HTTP/1.1" 200 None 2026-03-12 04:30:23,799 - lava_callback - DEBUG - Processing node 69b21d5ab0f5558b5d7cd2e2: baseline-arm64-broonie 2026-03-12 04:30:24,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:30:24,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:30:24,237 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d5ab0f5558b5d7cd2e2/log.txt.gz 2026-03-12 04:30:24,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:30:24,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:30:24,634 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d5ab0f5558b5d7cd2e2/lava-logs.yaml 2026-03-12 04:30:24,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-12 04:30:24,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-12 04:30:24,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b21d5ab0f5558b5d7cd2e2/lava_callback.json.gz 2026-03-12 04:30:24,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:24,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b21d5ab0f5558b5d7cd2e2 HTTP/1.1" 200 None 2026-03-12 04:30:24,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:24,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-12 04:30:24,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:24,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b21d5ab0f5558b5d7cd2e2 HTTP/1.1" 200 None 2026-03-12 04:30:24,889 - lava_callback - INFO - Completed processing callback for node 69b21d5ab0f5558b5d7cd2e2 INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:30:29,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:30:29,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:46:40,459 - lava_callback - INFO - Received callback for node 69afa21b275c8d3b7939b132 INFO: 172.21.0.1:41580 - "POST /node/69afa21b275c8d3b7939b132 HTTP/1.0" 202 Accepted 2026-03-12 04:46:40,465 - lava_callback - INFO - Starting async job submit for node 69afa21b275c8d3b7939b132 2026-03-12 04:46:40,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:46:40,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa21b275c8d3b7939b132 HTTP/1.1" 200 None 2026-03-12 04:46:40,481 - lava_callback - DEBUG - Processing node 69afa21b275c8d3b7939b132: baseline-arm-baylibre 2026-03-12 04:46:40,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa21b275c8d3b7939b132 2026-03-12 04:46:40,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:46:40,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa21b275c8d3b7939b132 HTTP/1.1" 200 None 2026-03-12 04:46:40,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:46:40,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:46:40,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:46:40,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa21b275c8d3b7939b132 HTTP/1.1" 200 None 2026-03-12 04:46:40,547 - lava_callback - ERROR - Error processing callback for node 69afa21b275c8d3b7939b132: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:47:20,313 - lava_callback - INFO - Received callback for node 69afa244275c8d3b7939b143 INFO: 172.21.0.1:35718 - "POST /node/69afa244275c8d3b7939b143 HTTP/1.0" 202 Accepted 2026-03-12 04:47:20,318 - lava_callback - INFO - Starting async job submit for node 69afa244275c8d3b7939b143 2026-03-12 04:47:20,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:47:20,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa244275c8d3b7939b143 HTTP/1.1" 200 None 2026-03-12 04:47:20,337 - lava_callback - DEBUG - Processing node 69afa244275c8d3b7939b143: baseline-arm-baylibre 2026-03-12 04:47:20,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa244275c8d3b7939b143 2026-03-12 04:47:20,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:47:20,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa244275c8d3b7939b143 HTTP/1.1" 200 None 2026-03-12 04:47:20,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:47:20,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:47:20,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:47:20,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa244275c8d3b7939b143 HTTP/1.1" 200 None 2026-03-12 04:47:20,405 - lava_callback - ERROR - Error processing callback for node 69afa244275c8d3b7939b143: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:49:00,499 - lava_callback - INFO - Received callback for node 69afa2ac275c8d3b7939b155 INFO: 172.21.0.1:40108 - "POST /node/69afa2ac275c8d3b7939b155 HTTP/1.0" 202 Accepted 2026-03-12 04:49:00,504 - lava_callback - INFO - Starting async job submit for node 69afa2ac275c8d3b7939b155 2026-03-12 04:49:00,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:00,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2ac275c8d3b7939b155 HTTP/1.1" 200 None 2026-03-12 04:49:00,520 - lava_callback - DEBUG - Processing node 69afa2ac275c8d3b7939b155: baseline-arm-baylibre 2026-03-12 04:49:00,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa2ac275c8d3b7939b155 2026-03-12 04:49:00,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:00,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2ac275c8d3b7939b155 HTTP/1.1" 200 None 2026-03-12 04:49:00,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:00,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:49:00,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:00,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa2ac275c8d3b7939b155 HTTP/1.1" 200 None 2026-03-12 04:49:00,600 - lava_callback - ERROR - Error processing callback for node 69afa2ac275c8d3b7939b155: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:49:40,428 - lava_callback - INFO - Received callback for node 69afa2d4275c8d3b7939b162 INFO: 172.21.0.1:47868 - "POST /node/69afa2d4275c8d3b7939b162 HTTP/1.0" 202 Accepted 2026-03-12 04:49:40,433 - lava_callback - INFO - Starting async job submit for node 69afa2d4275c8d3b7939b162 2026-03-12 04:49:40,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:40,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2d4275c8d3b7939b162 HTTP/1.1" 200 None 2026-03-12 04:49:40,450 - lava_callback - DEBUG - Processing node 69afa2d4275c8d3b7939b162: baseline-arm-baylibre 2026-03-12 04:49:40,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa2d4275c8d3b7939b162 2026-03-12 04:49:40,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:40,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2d4275c8d3b7939b162 HTTP/1.1" 200 None 2026-03-12 04:49:40,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:40,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:49:40,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:49:40,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa2d4275c8d3b7939b162 HTTP/1.1" 200 None 2026-03-12 04:49:40,511 - lava_callback - ERROR - Error processing callback for node 69afa2d4275c8d3b7939b162: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:50:20,563 - lava_callback - INFO - Received callback for node 69afa2fb275c8d3b7939b16e INFO: 172.21.0.1:54534 - "POST /node/69afa2fb275c8d3b7939b16e HTTP/1.0" 202 Accepted 2026-03-12 04:50:20,569 - lava_callback - INFO - Starting async job submit for node 69afa2fb275c8d3b7939b16e 2026-03-12 04:50:20,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:50:20,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2fb275c8d3b7939b16e HTTP/1.1" 200 None 2026-03-12 04:50:20,606 - lava_callback - DEBUG - Processing node 69afa2fb275c8d3b7939b16e: baseline-arm-baylibre 2026-03-12 04:50:20,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa2fb275c8d3b7939b16e 2026-03-12 04:50:20,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:50:20,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa2fb275c8d3b7939b16e HTTP/1.1" 200 None 2026-03-12 04:50:20,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:50:20,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:50:20,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:50:20,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa2fb275c8d3b7939b16e HTTP/1.1" 200 None 2026-03-12 04:50:20,711 - lava_callback - ERROR - Error processing callback for node 69afa2fb275c8d3b7939b16e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:51:00,537 - lava_callback - INFO - Received callback for node 69afa328275c8d3b7939b17e INFO: 172.21.0.1:49540 - "POST /node/69afa328275c8d3b7939b17e HTTP/1.0" 202 Accepted 2026-03-12 04:51:00,543 - lava_callback - INFO - Starting async job submit for node 69afa328275c8d3b7939b17e 2026-03-12 04:51:00,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:00,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa328275c8d3b7939b17e HTTP/1.1" 200 None 2026-03-12 04:51:00,558 - lava_callback - DEBUG - Processing node 69afa328275c8d3b7939b17e: baseline-arm-baylibre 2026-03-12 04:51:00,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa328275c8d3b7939b17e 2026-03-12 04:51:00,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:00,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa328275c8d3b7939b17e HTTP/1.1" 200 None 2026-03-12 04:51:00,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:00,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:51:00,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:00,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa328275c8d3b7939b17e HTTP/1.1" 200 None 2026-03-12 04:51:00,629 - lava_callback - ERROR - Error processing callback for node 69afa328275c8d3b7939b17e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:51:32,744 - lava_callback - INFO - Received callback for node 69afa350275c8d3b7939b18d INFO: 172.21.0.1:33644 - "POST /node/69afa350275c8d3b7939b18d HTTP/1.0" 202 Accepted 2026-03-12 04:51:32,750 - lava_callback - INFO - Starting async job submit for node 69afa350275c8d3b7939b18d 2026-03-12 04:51:32,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:32,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa350275c8d3b7939b18d HTTP/1.1" 200 None 2026-03-12 04:51:32,766 - lava_callback - DEBUG - Processing node 69afa350275c8d3b7939b18d: baseline-arm-clabbe 2026-03-12 04:51:32,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa350275c8d3b7939b18d 2026-03-12 04:51:32,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:32,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa350275c8d3b7939b18d HTTP/1.1" 200 None 2026-03-12 04:51:32,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:32,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:51:32,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:51:32,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa350275c8d3b7939b18d HTTP/1.1" 200 None 2026-03-12 04:51:32,825 - lava_callback - ERROR - Error processing callback for node 69afa350275c8d3b7939b18d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:52:12,691 - lava_callback - INFO - Received callback for node 69afa377275c8d3b7939b198 INFO: 172.21.0.1:35480 - "POST /node/69afa377275c8d3b7939b198 HTTP/1.0" 202 Accepted 2026-03-12 04:52:12,696 - lava_callback - INFO - Starting async job submit for node 69afa377275c8d3b7939b198 2026-03-12 04:52:12,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:52:12,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa377275c8d3b7939b198 HTTP/1.1" 200 None 2026-03-12 04:52:12,713 - lava_callback - DEBUG - Processing node 69afa377275c8d3b7939b198: baseline-arm-clabbe 2026-03-12 04:52:12,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa377275c8d3b7939b198 2026-03-12 04:52:12,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:52:12,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa377275c8d3b7939b198 HTTP/1.1" 200 None 2026-03-12 04:52:12,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:52:12,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:52:12,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:52:12,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa377275c8d3b7939b198 HTTP/1.1" 200 None 2026-03-12 04:52:12,814 - lava_callback - ERROR - Error processing callback for node 69afa377275c8d3b7939b198: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:54:20,814 - lava_callback - INFO - Received callback for node 69afa3e7275c8d3b7939b1bd INFO: 172.21.0.1:46530 - "POST /node/69afa3e7275c8d3b7939b1bd HTTP/1.0" 202 Accepted 2026-03-12 04:54:20,819 - lava_callback - INFO - Starting async job submit for node 69afa3e7275c8d3b7939b1bd 2026-03-12 04:54:20,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:54:20,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa3e7275c8d3b7939b1bd HTTP/1.1" 200 None 2026-03-12 04:54:20,836 - lava_callback - DEBUG - Processing node 69afa3e7275c8d3b7939b1bd: baseline-arm-baylibre 2026-03-12 04:54:20,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa3e7275c8d3b7939b1bd 2026-03-12 04:54:20,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:54:20,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa3e7275c8d3b7939b1bd HTTP/1.1" 200 None 2026-03-12 04:54:20,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:54:20,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:54:20,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:54:20,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa3e7275c8d3b7939b1bd HTTP/1.1" 200 None 2026-03-12 04:54:20,912 - lava_callback - ERROR - Error processing callback for node 69afa3e7275c8d3b7939b1bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:55:00,784 - lava_callback - INFO - Received callback for node 69afa416275c8d3b7939b1ca INFO: 172.21.0.1:53136 - "POST /node/69afa416275c8d3b7939b1ca HTTP/1.0" 202 Accepted 2026-03-12 04:55:00,790 - lava_callback - INFO - Starting async job submit for node 69afa416275c8d3b7939b1ca 2026-03-12 04:55:00,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:00,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa416275c8d3b7939b1ca HTTP/1.1" 200 None 2026-03-12 04:55:00,806 - lava_callback - DEBUG - Processing node 69afa416275c8d3b7939b1ca: baseline-arm-baylibre 2026-03-12 04:55:00,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa416275c8d3b7939b1ca 2026-03-12 04:55:00,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:00,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa416275c8d3b7939b1ca HTTP/1.1" 200 None 2026-03-12 04:55:00,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:00,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:55:00,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:00,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa416275c8d3b7939b1ca HTTP/1.1" 200 None 2026-03-12 04:55:00,876 - lava_callback - ERROR - Error processing callback for node 69afa416275c8d3b7939b1ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:55:40,846 - lava_callback - INFO - Received callback for node 69afa43b275c8d3b7939b1d4 INFO: 172.21.0.1:57860 - "POST /node/69afa43b275c8d3b7939b1d4 HTTP/1.0" 202 Accepted 2026-03-12 04:55:40,852 - lava_callback - INFO - Starting async job submit for node 69afa43b275c8d3b7939b1d4 2026-03-12 04:55:40,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:40,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa43b275c8d3b7939b1d4 HTTP/1.1" 200 None 2026-03-12 04:55:40,872 - lava_callback - DEBUG - Processing node 69afa43b275c8d3b7939b1d4: baseline-arm-baylibre 2026-03-12 04:55:40,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa43b275c8d3b7939b1d4 2026-03-12 04:55:40,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:40,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa43b275c8d3b7939b1d4 HTTP/1.1" 200 None 2026-03-12 04:55:40,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:40,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:55:40,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:55:40,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa43b275c8d3b7939b1d4 HTTP/1.1" 200 None 2026-03-12 04:55:40,939 - lava_callback - ERROR - Error processing callback for node 69afa43b275c8d3b7939b1d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:56:20,812 - lava_callback - INFO - Received callback for node 69afa461275c8d3b7939b1e5 INFO: 172.21.0.1:33094 - "POST /node/69afa461275c8d3b7939b1e5 HTTP/1.0" 202 Accepted 2026-03-12 04:56:20,818 - lava_callback - INFO - Starting async job submit for node 69afa461275c8d3b7939b1e5 2026-03-12 04:56:20,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:56:20,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa461275c8d3b7939b1e5 HTTP/1.1" 200 None 2026-03-12 04:56:20,834 - lava_callback - DEBUG - Processing node 69afa461275c8d3b7939b1e5: baseline-arm-baylibre 2026-03-12 04:56:20,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa461275c8d3b7939b1e5 2026-03-12 04:56:20,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:56:20,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa461275c8d3b7939b1e5 HTTP/1.1" 200 None 2026-03-12 04:56:20,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:56:20,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:56:20,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:56:20,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa461275c8d3b7939b1e5 HTTP/1.1" 200 None 2026-03-12 04:56:20,897 - lava_callback - ERROR - Error processing callback for node 69afa461275c8d3b7939b1e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:57:00,928 - lava_callback - INFO - Received callback for node 69afa488275c8d3b7939b1ee INFO: 172.21.0.1:36652 - "POST /node/69afa488275c8d3b7939b1ee HTTP/1.0" 202 Accepted 2026-03-12 04:57:00,935 - lava_callback - INFO - Starting async job submit for node 69afa488275c8d3b7939b1ee 2026-03-12 04:57:00,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:00,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa488275c8d3b7939b1ee HTTP/1.1" 200 None 2026-03-12 04:57:00,953 - lava_callback - DEBUG - Processing node 69afa488275c8d3b7939b1ee: baseline-arm-baylibre 2026-03-12 04:57:00,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa488275c8d3b7939b1ee 2026-03-12 04:57:00,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:00,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa488275c8d3b7939b1ee HTTP/1.1" 200 None 2026-03-12 04:57:00,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:00,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:57:00,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:01,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa488275c8d3b7939b1ee HTTP/1.1" 200 None 2026-03-12 04:57:01,043 - lava_callback - ERROR - Error processing callback for node 69afa488275c8d3b7939b1ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:57:20,858 - lava_callback - INFO - Received callback for node 69afa4af275c8d3b7939b1fc INFO: 172.21.0.1:60168 - "POST /node/69afa4af275c8d3b7939b1fc HTTP/1.0" 202 Accepted 2026-03-12 04:57:20,864 - lava_callback - INFO - Starting async job submit for node 69afa4af275c8d3b7939b1fc 2026-03-12 04:57:20,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:20,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4af275c8d3b7939b1fc HTTP/1.1" 200 None 2026-03-12 04:57:20,881 - lava_callback - DEBUG - Processing node 69afa4af275c8d3b7939b1fc: baseline-arm-baylibre 2026-03-12 04:57:20,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa4af275c8d3b7939b1fc 2026-03-12 04:57:20,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:20,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4af275c8d3b7939b1fc HTTP/1.1" 200 None 2026-03-12 04:57:20,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:20,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 04:57:20,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:57:20,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa4af275c8d3b7939b1fc HTTP/1.1" 200 None 2026-03-12 04:57:20,941 - lava_callback - ERROR - Error processing callback for node 69afa4af275c8d3b7939b1fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:58:13,006 - lava_callback - INFO - Received callback for node 69afa4d7275c8d3b7939b211 INFO: 172.21.0.1:54526 - "POST /node/69afa4d7275c8d3b7939b211 HTTP/1.0" 202 Accepted 2026-03-12 04:58:13,011 - lava_callback - INFO - Starting async job submit for node 69afa4d7275c8d3b7939b211 2026-03-12 04:58:13,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:13,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4d7275c8d3b7939b211 HTTP/1.1" 200 None 2026-03-12 04:58:13,029 - lava_callback - DEBUG - Processing node 69afa4d7275c8d3b7939b211: baseline-arm-clabbe 2026-03-12 04:58:13,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa4d7275c8d3b7939b211 2026-03-12 04:58:13,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:13,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4d7275c8d3b7939b211 HTTP/1.1" 200 None 2026-03-12 04:58:13,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:13,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:58:13,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:13,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa4d7275c8d3b7939b211 HTTP/1.1" 200 None 2026-03-12 04:58:13,106 - lava_callback - ERROR - Error processing callback for node 69afa4d7275c8d3b7939b211: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:58:52,989 - lava_callback - INFO - Received callback for node 69afa4fe275c8d3b7939b219 INFO: 172.21.0.1:54148 - "POST /node/69afa4fe275c8d3b7939b219 HTTP/1.0" 202 Accepted 2026-03-12 04:58:52,995 - lava_callback - INFO - Starting async job submit for node 69afa4fe275c8d3b7939b219 2026-03-12 04:58:52,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:53,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4fe275c8d3b7939b219 HTTP/1.1" 200 None 2026-03-12 04:58:53,020 - lava_callback - DEBUG - Processing node 69afa4fe275c8d3b7939b219: baseline-arm-clabbe 2026-03-12 04:58:53,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa4fe275c8d3b7939b219 2026-03-12 04:58:53,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:53,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa4fe275c8d3b7939b219 HTTP/1.1" 200 None 2026-03-12 04:58:53,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:53,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:58:53,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:58:53,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa4fe275c8d3b7939b219 HTTP/1.1" 200 None 2026-03-12 04:58:53,108 - lava_callback - ERROR - Error processing callback for node 69afa4fe275c8d3b7939b219: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK 2026-03-12 04:59:33,002 - lava_callback - INFO - Received callback for node 69afa524275c8d3b7939b225 INFO: 172.21.0.1:42722 - "POST /node/69afa524275c8d3b7939b225 HTTP/1.0" 202 Accepted 2026-03-12 04:59:33,007 - lava_callback - INFO - Starting async job submit for node 69afa524275c8d3b7939b225 2026-03-12 04:59:33,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:59:33,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa524275c8d3b7939b225 HTTP/1.1" 200 None 2026-03-12 04:59:33,025 - lava_callback - DEBUG - Processing node 69afa524275c8d3b7939b225: baseline-arm-clabbe 2026-03-12 04:59:33,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa524275c8d3b7939b225 2026-03-12 04:59:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:59:33,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa524275c8d3b7939b225 HTTP/1.1" 200 None 2026-03-12 04:59:33,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:59:33,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 04:59:33,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 04:59:33,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa524275c8d3b7939b225 HTTP/1.1" 200 None 2026-03-12 04:59:33,086 - lava_callback - ERROR - Error processing callback for node 69afa524275c8d3b7939b225: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:00:53,100 - lava_callback - INFO - Received callback for node 69afa571275c8d3b7939b23e INFO: 172.21.0.1:58720 - "POST /node/69afa571275c8d3b7939b23e HTTP/1.0" 202 Accepted 2026-03-12 05:00:53,106 - lava_callback - INFO - Starting async job submit for node 69afa571275c8d3b7939b23e 2026-03-12 05:00:53,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:00:53,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa571275c8d3b7939b23e HTTP/1.1" 200 None 2026-03-12 05:00:53,123 - lava_callback - DEBUG - Processing node 69afa571275c8d3b7939b23e: baseline-arm-clabbe 2026-03-12 05:00:53,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa571275c8d3b7939b23e 2026-03-12 05:00:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:00:53,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa571275c8d3b7939b23e HTTP/1.1" 200 None 2026-03-12 05:00:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:00:53,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 05:00:53,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:00:53,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa571275c8d3b7939b23e HTTP/1.1" 200 None 2026-03-12 05:00:53,182 - lava_callback - ERROR - Error processing callback for node 69afa571275c8d3b7939b23e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:02:13,140 - lava_callback - INFO - Received callback for node 69afa5c0275c8d3b7939b25b INFO: 172.21.0.1:60344 - "POST /node/69afa5c0275c8d3b7939b25b HTTP/1.0" 202 Accepted 2026-03-12 05:02:13,145 - lava_callback - INFO - Starting async job submit for node 69afa5c0275c8d3b7939b25b 2026-03-12 05:02:13,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:13,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa5c0275c8d3b7939b25b HTTP/1.1" 200 None 2026-03-12 05:02:13,190 - lava_callback - DEBUG - Processing node 69afa5c0275c8d3b7939b25b: baseline-arm-clabbe 2026-03-12 05:02:13,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa5c0275c8d3b7939b25b 2026-03-12 05:02:13,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:13,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa5c0275c8d3b7939b25b HTTP/1.1" 200 None 2026-03-12 05:02:13,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:13,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:02:13,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:13,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa5c0275c8d3b7939b25b HTTP/1.1" 200 None 2026-03-12 05:02:13,313 - lava_callback - ERROR - Error processing callback for node 69afa5c0275c8d3b7939b25b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:02:33,134 - lava_callback - INFO - Received callback for node 69afa5e6275c8d3b7939b267 INFO: 172.21.0.1:40948 - "POST /node/69afa5e6275c8d3b7939b267 HTTP/1.0" 202 Accepted 2026-03-12 05:02:33,140 - lava_callback - INFO - Starting async job submit for node 69afa5e6275c8d3b7939b267 2026-03-12 05:02:33,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:33,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa5e6275c8d3b7939b267 HTTP/1.1" 200 None 2026-03-12 05:02:33,158 - lava_callback - DEBUG - Processing node 69afa5e6275c8d3b7939b267: baseline-arm-clabbe 2026-03-12 05:02:33,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa5e6275c8d3b7939b267 2026-03-12 05:02:33,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:33,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa5e6275c8d3b7939b267 HTTP/1.1" 200 None 2026-03-12 05:02:33,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:33,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:02:33,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:02:33,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa5e6275c8d3b7939b267 HTTP/1.1" 200 None 2026-03-12 05:02:33,218 - lava_callback - ERROR - Error processing callback for node 69afa5e6275c8d3b7939b267: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:03:13,188 - lava_callback - INFO - Received callback for node 69afa60c275c8d3b7939b270 INFO: 172.21.0.1:38348 - "POST /node/69afa60c275c8d3b7939b270 HTTP/1.0" 202 Accepted 2026-03-12 05:03:13,193 - lava_callback - INFO - Starting async job submit for node 69afa60c275c8d3b7939b270 2026-03-12 05:03:13,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:13,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa60c275c8d3b7939b270 HTTP/1.1" 200 None 2026-03-12 05:03:13,212 - lava_callback - DEBUG - Processing node 69afa60c275c8d3b7939b270: baseline-arm-clabbe 2026-03-12 05:03:13,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa60c275c8d3b7939b270 2026-03-12 05:03:13,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:13,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa60c275c8d3b7939b270 HTTP/1.1" 200 None 2026-03-12 05:03:13,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:13,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:03:13,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa60c275c8d3b7939b270 HTTP/1.1" 200 None 2026-03-12 05:03:13,288 - lava_callback - ERROR - Error processing callback for node 69afa60c275c8d3b7939b270: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:03:53,182 - lava_callback - INFO - Received callback for node 69afa633275c8d3b7939b282 INFO: 172.21.0.1:38580 - "POST /node/69afa633275c8d3b7939b282 HTTP/1.0" 202 Accepted 2026-03-12 05:03:53,187 - lava_callback - INFO - Starting async job submit for node 69afa633275c8d3b7939b282 2026-03-12 05:03:53,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:53,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa633275c8d3b7939b282 HTTP/1.1" 200 None 2026-03-12 05:03:53,203 - lava_callback - DEBUG - Processing node 69afa633275c8d3b7939b282: baseline-arm-clabbe 2026-03-12 05:03:53,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa633275c8d3b7939b282 2026-03-12 05:03:53,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:53,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa633275c8d3b7939b282 HTTP/1.1" 200 None 2026-03-12 05:03:53,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:53,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:03:53,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:03:53,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa633275c8d3b7939b282 HTTP/1.1" 200 None 2026-03-12 05:03:53,261 - lava_callback - ERROR - Error processing callback for node 69afa633275c8d3b7939b282: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:04:33,236 - lava_callback - INFO - Received callback for node 69afa658275c8d3b7939b291 INFO: 172.21.0.1:60728 - "POST /node/69afa658275c8d3b7939b291 HTTP/1.0" 202 Accepted 2026-03-12 05:04:33,241 - lava_callback - INFO - Starting async job submit for node 69afa658275c8d3b7939b291 2026-03-12 05:04:33,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:04:33,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa658275c8d3b7939b291 HTTP/1.1" 200 None 2026-03-12 05:04:33,258 - lava_callback - DEBUG - Processing node 69afa658275c8d3b7939b291: baseline-arm-clabbe 2026-03-12 05:04:33,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa658275c8d3b7939b291 2026-03-12 05:04:33,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:04:33,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa658275c8d3b7939b291 HTTP/1.1" 200 None 2026-03-12 05:04:33,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:04:33,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-12 05:04:33,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:04:33,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa658275c8d3b7939b291 HTTP/1.1" 200 None 2026-03-12 05:04:33,315 - lava_callback - ERROR - Error processing callback for node 69afa658275c8d3b7939b291: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:06:33,319 - lava_callback - INFO - Received callback for node 69afa6cd275c8d3b7939b2aa INFO: 172.21.0.1:52250 - "POST /node/69afa6cd275c8d3b7939b2aa HTTP/1.0" 202 Accepted 2026-03-12 05:06:33,324 - lava_callback - INFO - Starting async job submit for node 69afa6cd275c8d3b7939b2aa 2026-03-12 05:06:33,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:06:33,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa6cd275c8d3b7939b2aa HTTP/1.1" 200 None 2026-03-12 05:06:33,342 - lava_callback - DEBUG - Processing node 69afa6cd275c8d3b7939b2aa: baseline-arm-clabbe 2026-03-12 05:06:33,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa6cd275c8d3b7939b2aa 2026-03-12 05:06:33,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:06:33,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa6cd275c8d3b7939b2aa HTTP/1.1" 200 None 2026-03-12 05:06:33,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:06:33,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 05:06:33,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:06:33,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa6cd275c8d3b7939b2aa HTTP/1.1" 200 None 2026-03-12 05:06:33,402 - lava_callback - ERROR - Error processing callback for node 69afa6cd275c8d3b7939b2aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:07:13,333 - lava_callback - INFO - Received callback for node 69afa6f3275c8d3b7939b2b9 INFO: 172.21.0.1:43658 - "POST /node/69afa6f3275c8d3b7939b2b9 HTTP/1.0" 202 Accepted 2026-03-12 05:07:13,339 - lava_callback - INFO - Starting async job submit for node 69afa6f3275c8d3b7939b2b9 2026-03-12 05:07:13,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:13,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa6f3275c8d3b7939b2b9 HTTP/1.1" 200 None 2026-03-12 05:07:13,359 - lava_callback - DEBUG - Processing node 69afa6f3275c8d3b7939b2b9: baseline-arm-clabbe 2026-03-12 05:07:13,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa6f3275c8d3b7939b2b9 2026-03-12 05:07:13,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:13,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa6f3275c8d3b7939b2b9 HTTP/1.1" 200 None 2026-03-12 05:07:13,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:13,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 05:07:13,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:13,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa6f3275c8d3b7939b2b9 HTTP/1.1" 200 None 2026-03-12 05:07:13,423 - lava_callback - ERROR - Error processing callback for node 69afa6f3275c8d3b7939b2b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:07:53,394 - lava_callback - INFO - Received callback for node 69afa719275c8d3b7939b2c0 INFO: 172.21.0.1:47200 - "POST /node/69afa719275c8d3b7939b2c0 HTTP/1.0" 202 Accepted 2026-03-12 05:07:53,400 - lava_callback - INFO - Starting async job submit for node 69afa719275c8d3b7939b2c0 2026-03-12 05:07:53,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:53,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa719275c8d3b7939b2c0 HTTP/1.1" 200 None 2026-03-12 05:07:53,428 - lava_callback - DEBUG - Processing node 69afa719275c8d3b7939b2c0: baseline-arm-clabbe 2026-03-12 05:07:53,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa719275c8d3b7939b2c0 2026-03-12 05:07:53,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:53,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa719275c8d3b7939b2c0 HTTP/1.1" 200 None 2026-03-12 05:07:53,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:53,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-12 05:07:53,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:07:53,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa719275c8d3b7939b2c0 HTTP/1.1" 200 None 2026-03-12 05:07:53,492 - lava_callback - ERROR - Error processing callback for node 69afa719275c8d3b7939b2c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:13:01,830 - lava_callback - INFO - Received callback for node 69afa85a275c8d3b7939b2e1 INFO: 172.21.0.1:59260 - "POST /node/69afa85a275c8d3b7939b2e1 HTTP/1.0" 202 Accepted 2026-03-12 05:13:01,836 - lava_callback - INFO - Starting async job submit for node 69afa85a275c8d3b7939b2e1 2026-03-12 05:13:01,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:13:01,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa85a275c8d3b7939b2e1 HTTP/1.1" 200 None 2026-03-12 05:13:01,857 - lava_callback - DEBUG - Processing node 69afa85a275c8d3b7939b2e1: baseline-arm64-baylibre 2026-03-12 05:13:01,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa85a275c8d3b7939b2e1 2026-03-12 05:13:01,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:13:01,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa85a275c8d3b7939b2e1 HTTP/1.1" 200 None 2026-03-12 05:13:01,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:13:01,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:13:01,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:13:01,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa85a275c8d3b7939b2e1 HTTP/1.1" 200 None 2026-03-12 05:13:01,909 - lava_callback - ERROR - Error processing callback for node 69afa85a275c8d3b7939b2e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:14:21,787 - lava_callback - INFO - Received callback for node 69afa8a9275c8d3b7939b2e9 INFO: 172.21.0.1:40954 - "POST /node/69afa8a9275c8d3b7939b2e9 HTTP/1.0" 202 Accepted 2026-03-12 05:14:21,793 - lava_callback - INFO - Starting async job submit for node 69afa8a9275c8d3b7939b2e9 2026-03-12 05:14:21,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:14:21,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa8a9275c8d3b7939b2e9 HTTP/1.1" 200 None 2026-03-12 05:14:21,809 - lava_callback - DEBUG - Processing node 69afa8a9275c8d3b7939b2e9: baseline-arm64-baylibre 2026-03-12 05:14:21,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa8a9275c8d3b7939b2e9 2026-03-12 05:14:21,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:14:21,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa8a9275c8d3b7939b2e9 HTTP/1.1" 200 None 2026-03-12 05:14:21,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:14:21,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:14:21,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:14:21,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa8a9275c8d3b7939b2e9 HTTP/1.1" 200 None 2026-03-12 05:14:21,870 - lava_callback - ERROR - Error processing callback for node 69afa8a9275c8d3b7939b2e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:15:41,852 - lava_callback - INFO - Received callback for node 69afa8f8275c8d3b7939b2f7 INFO: 172.21.0.1:44908 - "POST /node/69afa8f8275c8d3b7939b2f7 HTTP/1.0" 202 Accepted 2026-03-12 05:15:41,857 - lava_callback - INFO - Starting async job submit for node 69afa8f8275c8d3b7939b2f7 2026-03-12 05:15:41,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:15:41,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa8f8275c8d3b7939b2f7 HTTP/1.1" 200 None 2026-03-12 05:15:41,881 - lava_callback - DEBUG - Processing node 69afa8f8275c8d3b7939b2f7: baseline-arm64-baylibre 2026-03-12 05:15:41,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa8f8275c8d3b7939b2f7 2026-03-12 05:15:41,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:15:41,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa8f8275c8d3b7939b2f7 HTTP/1.1" 200 None 2026-03-12 05:15:41,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:15:41,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:15:41,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:15:41,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa8f8275c8d3b7939b2f7 HTTP/1.1" 200 None 2026-03-12 05:15:41,959 - lava_callback - ERROR - Error processing callback for node 69afa8f8275c8d3b7939b2f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:17:01,927 - lava_callback - INFO - Received callback for node 69afa945275c8d3b7939b307 INFO: 172.21.0.1:56872 - "POST /node/69afa945275c8d3b7939b307 HTTP/1.0" 202 Accepted 2026-03-12 05:17:01,932 - lava_callback - INFO - Starting async job submit for node 69afa945275c8d3b7939b307 2026-03-12 05:17:01,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:17:01,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa945275c8d3b7939b307 HTTP/1.1" 200 None 2026-03-12 05:17:01,949 - lava_callback - DEBUG - Processing node 69afa945275c8d3b7939b307: baseline-arm64-baylibre 2026-03-12 05:17:01,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa945275c8d3b7939b307 2026-03-12 05:17:01,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:17:01,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa945275c8d3b7939b307 HTTP/1.1" 200 None 2026-03-12 05:17:01,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:17:01,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:17:01,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:17:02,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa945275c8d3b7939b307 HTTP/1.1" 200 None 2026-03-12 05:17:02,008 - lava_callback - ERROR - Error processing callback for node 69afa945275c8d3b7939b307: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:19:02,373 - lava_callback - INFO - Received callback for node 69afa9b8275c8d3b7939b322 INFO: 172.21.0.1:56070 - "POST /node/69afa9b8275c8d3b7939b322 HTTP/1.0" 202 Accepted 2026-03-12 05:19:02,379 - lava_callback - INFO - Starting async job submit for node 69afa9b8275c8d3b7939b322 2026-03-12 05:19:02,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:19:02,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa9b8275c8d3b7939b322 HTTP/1.1" 200 None 2026-03-12 05:19:02,418 - lava_callback - DEBUG - Processing node 69afa9b8275c8d3b7939b322: baseline-arm64-baylibre 2026-03-12 05:19:02,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afa9b8275c8d3b7939b322 2026-03-12 05:19:02,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:19:02,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afa9b8275c8d3b7939b322 HTTP/1.1" 200 None 2026-03-12 05:19:02,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:19:02,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:19:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:19:02,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afa9b8275c8d3b7939b322 HTTP/1.1" 200 None 2026-03-12 05:19:02,506 - lava_callback - ERROR - Error processing callback for node 69afa9b8275c8d3b7939b322: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:20:33,955 - lava_callback - INFO - Received callback for node 69afaa0e275c8d3b7939b330 INFO: 172.21.0.1:41424 - "POST /node/69afaa0e275c8d3b7939b330 HTTP/1.0" 202 Accepted 2026-03-12 05:20:33,961 - lava_callback - INFO - Starting async job submit for node 69afaa0e275c8d3b7939b330 2026-03-12 05:20:33,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:20:33,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaa0e275c8d3b7939b330 HTTP/1.1" 200 None 2026-03-12 05:20:33,977 - lava_callback - DEBUG - Processing node 69afaa0e275c8d3b7939b330: baseline-arm64-clabbe 2026-03-12 05:20:33,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaa0e275c8d3b7939b330 2026-03-12 05:20:33,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:20:33,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaa0e275c8d3b7939b330 HTTP/1.1" 200 None 2026-03-12 05:20:33,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:20:34,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:20:34,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:20:34,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaa0e275c8d3b7939b330 HTTP/1.1" 200 None 2026-03-12 05:20:34,040 - lava_callback - ERROR - Error processing callback for node 69afaa0e275c8d3b7939b330: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:21:54,042 - lava_callback - INFO - Received callback for node 69afaa5e275c8d3b7939b33b INFO: 172.21.0.1:35694 - "POST /node/69afaa5e275c8d3b7939b33b HTTP/1.0" 202 Accepted 2026-03-12 05:21:54,047 - lava_callback - INFO - Starting async job submit for node 69afaa5e275c8d3b7939b33b 2026-03-12 05:21:54,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:21:54,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaa5e275c8d3b7939b33b HTTP/1.1" 200 None 2026-03-12 05:21:54,069 - lava_callback - DEBUG - Processing node 69afaa5e275c8d3b7939b33b: baseline-arm64-clabbe 2026-03-12 05:21:54,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaa5e275c8d3b7939b33b 2026-03-12 05:21:54,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:21:54,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaa5e275c8d3b7939b33b HTTP/1.1" 200 None 2026-03-12 05:21:54,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:21:54,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:21:54,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:21:54,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaa5e275c8d3b7939b33b HTTP/1.1" 200 None 2026-03-12 05:21:54,121 - lava_callback - ERROR - Error processing callback for node 69afaa5e275c8d3b7939b33b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:23:02,259 - lava_callback - INFO - Received callback for node 69afaaa7275c8d3b7939b345 INFO: 172.21.0.1:39470 - "POST /node/69afaaa7275c8d3b7939b345 HTTP/1.0" 202 Accepted 2026-03-12 05:23:02,264 - lava_callback - INFO - Starting async job submit for node 69afaaa7275c8d3b7939b345 2026-03-12 05:23:02,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:23:02,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaaa7275c8d3b7939b345 HTTP/1.1" 200 None 2026-03-12 05:23:02,287 - lava_callback - DEBUG - Processing node 69afaaa7275c8d3b7939b345: baseline-arm64-baylibre 2026-03-12 05:23:02,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaaa7275c8d3b7939b345 2026-03-12 05:23:02,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:23:02,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaaa7275c8d3b7939b345 HTTP/1.1" 200 None 2026-03-12 05:23:02,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:23:02,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:23:02,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:23:02,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaaa7275c8d3b7939b345 HTTP/1.1" 200 None 2026-03-12 05:23:02,342 - lava_callback - ERROR - Error processing callback for node 69afaaa7275c8d3b7939b345: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:24:22,322 - lava_callback - INFO - Received callback for node 69afaaf7275c8d3b7939b354 INFO: 172.21.0.1:52590 - "POST /node/69afaaf7275c8d3b7939b354 HTTP/1.0" 202 Accepted 2026-03-12 05:24:22,328 - lava_callback - INFO - Starting async job submit for node 69afaaf7275c8d3b7939b354 2026-03-12 05:24:22,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:24:22,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaaf7275c8d3b7939b354 HTTP/1.1" 200 None 2026-03-12 05:24:22,357 - lava_callback - DEBUG - Processing node 69afaaf7275c8d3b7939b354: baseline-arm64-baylibre 2026-03-12 05:24:22,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaaf7275c8d3b7939b354 2026-03-12 05:24:22,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:24:22,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaaf7275c8d3b7939b354 HTTP/1.1" 200 None 2026-03-12 05:24:22,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:24:22,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:24:22,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:24:22,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaaf7275c8d3b7939b354 HTTP/1.1" 200 None 2026-03-12 05:24:22,440 - lava_callback - ERROR - Error processing callback for node 69afaaf7275c8d3b7939b354: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:25:54,259 - lava_callback - INFO - Received callback for node 69afab4d275c8d3b7939b360 INFO: 172.21.0.1:51168 - "POST /node/69afab4d275c8d3b7939b360 HTTP/1.0" 202 Accepted 2026-03-12 05:25:54,265 - lava_callback - INFO - Starting async job submit for node 69afab4d275c8d3b7939b360 2026-03-12 05:25:54,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:25:54,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afab4d275c8d3b7939b360 HTTP/1.1" 200 None 2026-03-12 05:25:54,283 - lava_callback - DEBUG - Processing node 69afab4d275c8d3b7939b360: baseline-arm64-clabbe 2026-03-12 05:25:54,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afab4d275c8d3b7939b360 2026-03-12 05:25:54,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:25:54,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afab4d275c8d3b7939b360 HTTP/1.1" 200 None 2026-03-12 05:25:54,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:25:54,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:25:54,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:25:54,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afab4d275c8d3b7939b360 HTTP/1.1" 200 None 2026-03-12 05:25:54,348 - lava_callback - ERROR - Error processing callback for node 69afab4d275c8d3b7939b360: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:28:14,248 - lava_callback - INFO - Received callback for node 69afabdd275c8d3b7939b376 INFO: 172.21.0.1:35636 - "POST /node/69afabdd275c8d3b7939b376 HTTP/1.0" 202 Accepted 2026-03-12 05:28:14,254 - lava_callback - INFO - Starting async job submit for node 69afabdd275c8d3b7939b376 2026-03-12 05:28:14,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:28:14,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afabdd275c8d3b7939b376 HTTP/1.1" 200 None 2026-03-12 05:28:14,270 - lava_callback - DEBUG - Processing node 69afabdd275c8d3b7939b376: baseline-arm64-clabbe 2026-03-12 05:28:14,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afabdd275c8d3b7939b376 2026-03-12 05:28:14,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:28:14,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afabdd275c8d3b7939b376 HTTP/1.1" 200 None 2026-03-12 05:28:14,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:28:14,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:28:14,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:28:14,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afabdd275c8d3b7939b376 HTTP/1.1" 200 None 2026-03-12 05:28:14,335 - lava_callback - ERROR - Error processing callback for node 69afabdd275c8d3b7939b376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:29:22,623 - lava_callback - INFO - Received callback for node 69afac26275c8d3b7939b37e INFO: 172.21.0.1:33174 - "POST /node/69afac26275c8d3b7939b37e HTTP/1.0" 202 Accepted 2026-03-12 05:29:22,629 - lava_callback - INFO - Starting async job submit for node 69afac26275c8d3b7939b37e 2026-03-12 05:29:22,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:29:22,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afac26275c8d3b7939b37e HTTP/1.1" 200 None 2026-03-12 05:29:22,645 - lava_callback - DEBUG - Processing node 69afac26275c8d3b7939b37e: baseline-arm64-baylibre 2026-03-12 05:29:22,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afac26275c8d3b7939b37e 2026-03-12 05:29:22,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:29:22,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afac26275c8d3b7939b37e HTTP/1.1" 200 None 2026-03-12 05:29:22,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:29:22,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:29:22,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:29:22,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afac26275c8d3b7939b37e HTTP/1.1" 200 None 2026-03-12 05:29:22,738 - lava_callback - ERROR - Error processing callback for node 69afac26275c8d3b7939b37e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:30:54,382 - lava_callback - INFO - Received callback for node 69afac7b275c8d3b7939b38e INFO: 172.21.0.1:42994 - "POST /node/69afac7b275c8d3b7939b38e HTTP/1.0" 202 Accepted 2026-03-12 05:30:54,388 - lava_callback - INFO - Starting async job submit for node 69afac7b275c8d3b7939b38e 2026-03-12 05:30:54,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:30:54,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afac7b275c8d3b7939b38e HTTP/1.1" 200 None 2026-03-12 05:30:54,405 - lava_callback - DEBUG - Processing node 69afac7b275c8d3b7939b38e: baseline-arm64-clabbe 2026-03-12 05:30:54,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afac7b275c8d3b7939b38e 2026-03-12 05:30:54,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:30:54,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afac7b275c8d3b7939b38e HTTP/1.1" 200 None 2026-03-12 05:30:54,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:30:54,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:30:54,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:30:54,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afac7b275c8d3b7939b38e HTTP/1.1" 200 None 2026-03-12 05:30:54,475 - lava_callback - ERROR - Error processing callback for node 69afac7b275c8d3b7939b38e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:32:14,430 - lava_callback - INFO - Received callback for node 69afaccb275c8d3b7939b39a INFO: 172.21.0.1:54140 - "POST /node/69afaccb275c8d3b7939b39a HTTP/1.0" 202 Accepted 2026-03-12 05:32:14,435 - lava_callback - INFO - Starting async job submit for node 69afaccb275c8d3b7939b39a 2026-03-12 05:32:14,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:32:14,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaccb275c8d3b7939b39a HTTP/1.1" 200 None 2026-03-12 05:32:14,463 - lava_callback - DEBUG - Processing node 69afaccb275c8d3b7939b39a: baseline-arm64-clabbe 2026-03-12 05:32:14,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaccb275c8d3b7939b39a 2026-03-12 05:32:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:32:14,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaccb275c8d3b7939b39a HTTP/1.1" 200 None 2026-03-12 05:32:14,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:32:14,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-12 05:32:14,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:32:14,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaccb275c8d3b7939b39a HTTP/1.1" 200 None 2026-03-12 05:32:14,522 - lava_callback - ERROR - Error processing callback for node 69afaccb275c8d3b7939b39a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:35:42,898 - lava_callback - INFO - Received callback for node 69afadac275c8d3b7939b3b5 INFO: 172.21.0.1:40012 - "POST /node/69afadac275c8d3b7939b3b5 HTTP/1.0" 202 Accepted 2026-03-12 05:35:42,904 - lava_callback - INFO - Starting async job submit for node 69afadac275c8d3b7939b3b5 2026-03-12 05:35:42,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:35:42,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afadac275c8d3b7939b3b5 HTTP/1.1" 200 None 2026-03-12 05:35:42,923 - lava_callback - DEBUG - Processing node 69afadac275c8d3b7939b3b5: baseline-arm64-baylibre 2026-03-12 05:35:42,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afadac275c8d3b7939b3b5 2026-03-12 05:35:42,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:35:42,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afadac275c8d3b7939b3b5 HTTP/1.1" 200 None 2026-03-12 05:35:42,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:35:42,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:35:42,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:35:42,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afadac275c8d3b7939b3b5 HTTP/1.1" 200 None 2026-03-12 05:35:42,985 - lava_callback - ERROR - Error processing callback for node 69afadac275c8d3b7939b3b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:37:02,952 - lava_callback - INFO - Received callback for node 69afadfb275c8d3b7939b3c6 INFO: 172.21.0.1:49770 - "POST /node/69afadfb275c8d3b7939b3c6 HTTP/1.0" 202 Accepted 2026-03-12 05:37:02,958 - lava_callback - INFO - Starting async job submit for node 69afadfb275c8d3b7939b3c6 2026-03-12 05:37:02,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:37:02,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afadfb275c8d3b7939b3c6 HTTP/1.1" 200 None 2026-03-12 05:37:02,978 - lava_callback - DEBUG - Processing node 69afadfb275c8d3b7939b3c6: baseline-arm64-baylibre 2026-03-12 05:37:02,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afadfb275c8d3b7939b3c6 2026-03-12 05:37:02,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:37:03,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afadfb275c8d3b7939b3c6 HTTP/1.1" 200 None 2026-03-12 05:37:03,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:37:03,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:37:03,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:37:03,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afadfb275c8d3b7939b3c6 HTTP/1.1" 200 None 2026-03-12 05:37:03,043 - lava_callback - ERROR - Error processing callback for node 69afadfb275c8d3b7939b3c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:38:23,065 - lava_callback - INFO - Received callback for node 69afae4a275c8d3b7939b3d1 INFO: 172.21.0.1:53978 - "POST /node/69afae4a275c8d3b7939b3d1 HTTP/1.0" 202 Accepted 2026-03-12 05:38:23,071 - lava_callback - INFO - Starting async job submit for node 69afae4a275c8d3b7939b3d1 2026-03-12 05:38:23,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:38:23,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afae4a275c8d3b7939b3d1 HTTP/1.1" 200 None 2026-03-12 05:38:23,090 - lava_callback - DEBUG - Processing node 69afae4a275c8d3b7939b3d1: baseline-arm64-baylibre 2026-03-12 05:38:23,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afae4a275c8d3b7939b3d1 2026-03-12 05:38:23,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:38:23,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afae4a275c8d3b7939b3d1 HTTP/1.1" 200 None 2026-03-12 05:38:23,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:38:23,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:38:23,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:38:23,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afae4a275c8d3b7939b3d1 HTTP/1.1" 200 None 2026-03-12 05:38:23,158 - lava_callback - ERROR - Error processing callback for node 69afae4a275c8d3b7939b3d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:39:43,136 - lava_callback - INFO - Received callback for node 69afae9a275c8d3b7939b3dd INFO: 172.21.0.1:45500 - "POST /node/69afae9a275c8d3b7939b3dd HTTP/1.0" 202 Accepted 2026-03-12 05:39:43,142 - lava_callback - INFO - Starting async job submit for node 69afae9a275c8d3b7939b3dd 2026-03-12 05:39:43,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:39:43,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afae9a275c8d3b7939b3dd HTTP/1.1" 200 None 2026-03-12 05:39:43,158 - lava_callback - DEBUG - Processing node 69afae9a275c8d3b7939b3dd: baseline-arm64-baylibre 2026-03-12 05:39:43,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afae9a275c8d3b7939b3dd 2026-03-12 05:39:43,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:39:43,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afae9a275c8d3b7939b3dd HTTP/1.1" 200 None 2026-03-12 05:39:43,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:39:43,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:39:43,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:39:43,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afae9a275c8d3b7939b3dd HTTP/1.1" 200 None 2026-03-12 05:39:43,211 - lava_callback - ERROR - Error processing callback for node 69afae9a275c8d3b7939b3dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33898 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:41:43,184 - lava_callback - INFO - Received callback for node 69afaf0e275c8d3b7939b3f5 INFO: 172.21.0.1:43848 - "POST /node/69afaf0e275c8d3b7939b3f5 HTTP/1.0" 202 Accepted 2026-03-12 05:41:43,189 - lava_callback - INFO - Starting async job submit for node 69afaf0e275c8d3b7939b3f5 2026-03-12 05:41:43,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:41:43,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaf0e275c8d3b7939b3f5 HTTP/1.1" 200 None 2026-03-12 05:41:43,212 - lava_callback - DEBUG - Processing node 69afaf0e275c8d3b7939b3f5: baseline-arm64-baylibre 2026-03-12 05:41:43,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaf0e275c8d3b7939b3f5 2026-03-12 05:41:43,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:41:43,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaf0e275c8d3b7939b3f5 HTTP/1.1" 200 None 2026-03-12 05:41:43,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:41:43,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:41:43,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:41:43,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaf0e275c8d3b7939b3f5 HTTP/1.1" 200 None 2026-03-12 05:41:43,287 - lava_callback - ERROR - Error processing callback for node 69afaf0e275c8d3b7939b3f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:43:03,299 - lava_callback - INFO - Received callback for node 69afaf5e275c8d3b7939b3fd INFO: 172.21.0.1:51996 - "POST /node/69afaf5e275c8d3b7939b3fd HTTP/1.0" 202 Accepted 2026-03-12 05:43:03,304 - lava_callback - INFO - Starting async job submit for node 69afaf5e275c8d3b7939b3fd 2026-03-12 05:43:03,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:43:03,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaf5e275c8d3b7939b3fd HTTP/1.1" 200 None 2026-03-12 05:43:03,325 - lava_callback - DEBUG - Processing node 69afaf5e275c8d3b7939b3fd: baseline-arm64-baylibre 2026-03-12 05:43:03,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afaf5e275c8d3b7939b3fd 2026-03-12 05:43:03,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:43:03,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afaf5e275c8d3b7939b3fd HTTP/1.1" 200 None 2026-03-12 05:43:03,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:43:03,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:43:03,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:43:03,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afaf5e275c8d3b7939b3fd HTTP/1.1" 200 None 2026-03-12 05:43:03,377 - lava_callback - ERROR - Error processing callback for node 69afaf5e275c8d3b7939b3fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:45:54,959 - lava_callback - INFO - Received callback for node 69afafff275c8d3b7939b417 INFO: 172.21.0.1:57220 - "POST /node/69afafff275c8d3b7939b417 HTTP/1.0" 202 Accepted 2026-03-12 05:45:54,965 - lava_callback - INFO - Starting async job submit for node 69afafff275c8d3b7939b417 2026-03-12 05:45:54,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:45:54,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afafff275c8d3b7939b417 HTTP/1.1" 200 None 2026-03-12 05:45:54,980 - lava_callback - DEBUG - Processing node 69afafff275c8d3b7939b417: baseline-arm64-clabbe 2026-03-12 05:45:54,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afafff275c8d3b7939b417 2026-03-12 05:45:54,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:45:54,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afafff275c8d3b7939b417 HTTP/1.1" 200 None 2026-03-12 05:45:54,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:45:55,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:45:55,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:45:55,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afafff275c8d3b7939b417 HTTP/1.1" 200 None 2026-03-12 05:45:55,038 - lava_callback - ERROR - Error processing callback for node 69afafff275c8d3b7939b417: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:47:15,017 - lava_callback - INFO - Received callback for node 69afb04f275c8d3b7939b41f INFO: 172.21.0.1:44930 - "POST /node/69afb04f275c8d3b7939b41f HTTP/1.0" 202 Accepted 2026-03-12 05:47:15,023 - lava_callback - INFO - Starting async job submit for node 69afb04f275c8d3b7939b41f 2026-03-12 05:47:15,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:47:15,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb04f275c8d3b7939b41f HTTP/1.1" 200 None 2026-03-12 05:47:15,048 - lava_callback - DEBUG - Processing node 69afb04f275c8d3b7939b41f: baseline-arm64-clabbe 2026-03-12 05:47:15,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb04f275c8d3b7939b41f 2026-03-12 05:47:15,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:47:15,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb04f275c8d3b7939b41f HTTP/1.1" 200 None 2026-03-12 05:47:15,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:47:15,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:47:15,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:47:15,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb04f275c8d3b7939b41f HTTP/1.1" 200 None 2026-03-12 05:47:15,112 - lava_callback - ERROR - Error processing callback for node 69afb04f275c8d3b7939b41f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:48:35,076 - lava_callback - INFO - Received callback for node 69afb09d275c8d3b7939b42c INFO: 172.21.0.1:37988 - "POST /node/69afb09d275c8d3b7939b42c HTTP/1.0" 202 Accepted 2026-03-12 05:48:35,082 - lava_callback - INFO - Starting async job submit for node 69afb09d275c8d3b7939b42c 2026-03-12 05:48:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:48:35,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb09d275c8d3b7939b42c HTTP/1.1" 200 None 2026-03-12 05:48:35,119 - lava_callback - DEBUG - Processing node 69afb09d275c8d3b7939b42c: baseline-arm64-clabbe 2026-03-12 05:48:35,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb09d275c8d3b7939b42c 2026-03-12 05:48:35,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:48:35,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb09d275c8d3b7939b42c HTTP/1.1" 200 None 2026-03-12 05:48:35,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:48:35,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:48:35,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:48:35,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb09d275c8d3b7939b42c HTTP/1.1" 200 None 2026-03-12 05:48:35,192 - lava_callback - ERROR - Error processing callback for node 69afb09d275c8d3b7939b42c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:49:55,158 - lava_callback - INFO - Received callback for node 69afb0f0275c8d3b7939b438 INFO: 172.21.0.1:39762 - "POST /node/69afb0f0275c8d3b7939b438 HTTP/1.0" 202 Accepted 2026-03-12 05:49:55,163 - lava_callback - INFO - Starting async job submit for node 69afb0f0275c8d3b7939b438 2026-03-12 05:49:55,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:49:55,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb0f0275c8d3b7939b438 HTTP/1.1" 200 None 2026-03-12 05:49:55,181 - lava_callback - DEBUG - Processing node 69afb0f0275c8d3b7939b438: baseline-arm64-clabbe 2026-03-12 05:49:55,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb0f0275c8d3b7939b438 2026-03-12 05:49:55,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:49:55,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb0f0275c8d3b7939b438 HTTP/1.1" 200 None 2026-03-12 05:49:55,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:49:55,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:49:55,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:49:55,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb0f0275c8d3b7939b438 HTTP/1.1" 200 None 2026-03-12 05:49:55,241 - lava_callback - ERROR - Error processing callback for node 69afb0f0275c8d3b7939b438: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-12 05:51:15,203 - lava_callback - INFO - Received callback for node 69afb140275c8d3b7939b442 INFO: 172.21.0.1:51226 - "POST /node/69afb140275c8d3b7939b442 HTTP/1.0" 202 Accepted 2026-03-12 05:51:15,208 - lava_callback - INFO - Starting async job submit for node 69afb140275c8d3b7939b442 2026-03-12 05:51:15,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:51:15,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb140275c8d3b7939b442 HTTP/1.1" 200 None 2026-03-12 05:51:15,224 - lava_callback - DEBUG - Processing node 69afb140275c8d3b7939b442: baseline-arm64-clabbe 2026-03-12 05:51:15,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb140275c8d3b7939b442 2026-03-12 05:51:15,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:51:15,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb140275c8d3b7939b442 HTTP/1.1" 200 None 2026-03-12 05:51:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:51:15,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:51:15,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:51:15,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb140275c8d3b7939b442 HTTP/1.1" 200 None 2026-03-12 05:51:15,283 - lava_callback - ERROR - Error processing callback for node 69afb140275c8d3b7939b442: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34664 - "GET / HTTP/1.0" 200 OK 2026-03-12 05:52:35,281 - lava_callback - INFO - Received callback for node 69afb18e275c8d3b7939b44a INFO: 172.21.0.1:40790 - "POST /node/69afb18e275c8d3b7939b44a HTTP/1.0" 202 Accepted 2026-03-12 05:52:35,288 - lava_callback - INFO - Starting async job submit for node 69afb18e275c8d3b7939b44a 2026-03-12 05:52:35,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:52:35,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb18e275c8d3b7939b44a HTTP/1.1" 200 None 2026-03-12 05:52:35,304 - lava_callback - DEBUG - Processing node 69afb18e275c8d3b7939b44a: baseline-arm64-clabbe 2026-03-12 05:52:35,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afb18e275c8d3b7939b44a 2026-03-12 05:52:35,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:52:35,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afb18e275c8d3b7939b44a HTTP/1.1" 200 None 2026-03-12 05:52:35,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:52:35,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-12 05:52:35,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 05:52:35,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afb18e275c8d3b7939b44a HTTP/1.1" 200 None 2026-03-12 05:52:35,356 - lava_callback - ERROR - Error processing callback for node 69afb18e275c8d3b7939b44a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:38:26,584 - lava_callback - INFO - Received callback for node 69afbc4f275c8d3b7939b4e3 INFO: 172.21.0.1:45958 - "POST /node/69afbc4f275c8d3b7939b4e3 HTTP/1.0" 202 Accepted 2026-03-12 06:38:26,590 - lava_callback - INFO - Starting async job submit for node 69afbc4f275c8d3b7939b4e3 2026-03-12 06:38:26,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:26,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc4f275c8d3b7939b4e3 HTTP/1.1" 200 None 2026-03-12 06:38:26,606 - lava_callback - DEBUG - Processing node 69afbc4f275c8d3b7939b4e3: baseline-arm-baylibre 2026-03-12 06:38:26,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbc4f275c8d3b7939b4e3 2026-03-12 06:38:26,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:26,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc4f275c8d3b7939b4e3 HTTP/1.1" 200 None 2026-03-12 06:38:26,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:26,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:38:26,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:26,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbc4f275c8d3b7939b4e3 HTTP/1.1" 200 None 2026-03-12 06:38:26,671 - lava_callback - ERROR - Error processing callback for node 69afbc4f275c8d3b7939b4e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:38:46,278 - lava_callback - INFO - Received callback for node 69afbc74275c8d3b7939b4f2 INFO: 172.21.0.1:60304 - "POST /node/69afbc74275c8d3b7939b4f2 HTTP/1.0" 202 Accepted 2026-03-12 06:38:46,284 - lava_callback - INFO - Starting async job submit for node 69afbc74275c8d3b7939b4f2 2026-03-12 06:38:46,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:46,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc74275c8d3b7939b4f2 HTTP/1.1" 200 None 2026-03-12 06:38:46,300 - lava_callback - DEBUG - Processing node 69afbc74275c8d3b7939b4f2: baseline-arm-baylibre 2026-03-12 06:38:46,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbc74275c8d3b7939b4f2 2026-03-12 06:38:46,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:46,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc74275c8d3b7939b4f2 HTTP/1.1" 200 None 2026-03-12 06:38:46,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:46,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:38:46,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:38:46,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbc74275c8d3b7939b4f2 HTTP/1.1" 200 None 2026-03-12 06:38:46,359 - lava_callback - ERROR - Error processing callback for node 69afbc74275c8d3b7939b4f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:39:26,304 - lava_callback - INFO - Received callback for node 69afbc98275c8d3b7939b4fb INFO: 172.21.0.1:47868 - "POST /node/69afbc98275c8d3b7939b4fb HTTP/1.0" 202 Accepted 2026-03-12 06:39:26,310 - lava_callback - INFO - Starting async job submit for node 69afbc98275c8d3b7939b4fb 2026-03-12 06:39:26,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:39:26,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc98275c8d3b7939b4fb HTTP/1.1" 200 None 2026-03-12 06:39:26,325 - lava_callback - DEBUG - Processing node 69afbc98275c8d3b7939b4fb: baseline-arm-baylibre 2026-03-12 06:39:26,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbc98275c8d3b7939b4fb 2026-03-12 06:39:26,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:39:26,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbc98275c8d3b7939b4fb HTTP/1.1" 200 None 2026-03-12 06:39:26,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:39:26,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:39:26,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:39:26,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbc98275c8d3b7939b4fb HTTP/1.1" 200 None 2026-03-12 06:39:26,386 - lava_callback - ERROR - Error processing callback for node 69afbc98275c8d3b7939b4fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:40:06,424 - lava_callback - INFO - Received callback for node 69afbcbd275c8d3b7939b508 INFO: 172.21.0.1:38604 - "POST /node/69afbcbd275c8d3b7939b508 HTTP/1.0" 202 Accepted 2026-03-12 06:40:06,429 - lava_callback - INFO - Starting async job submit for node 69afbcbd275c8d3b7939b508 2026-03-12 06:40:06,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:06,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbcbd275c8d3b7939b508 HTTP/1.1" 200 None 2026-03-12 06:40:06,445 - lava_callback - DEBUG - Processing node 69afbcbd275c8d3b7939b508: baseline-arm-baylibre 2026-03-12 06:40:06,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbcbd275c8d3b7939b508 2026-03-12 06:40:06,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:06,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbcbd275c8d3b7939b508 HTTP/1.1" 200 None 2026-03-12 06:40:06,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:06,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:40:06,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:06,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbcbd275c8d3b7939b508 HTTP/1.1" 200 None 2026-03-12 06:40:06,497 - lava_callback - ERROR - Error processing callback for node 69afbcbd275c8d3b7939b508: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:40:46,405 - lava_callback - INFO - Received callback for node 69afbce2275c8d3b7939b511 INFO: 172.21.0.1:48268 - "POST /node/69afbce2275c8d3b7939b511 HTTP/1.0" 202 Accepted 2026-03-12 06:40:46,410 - lava_callback - INFO - Starting async job submit for node 69afbce2275c8d3b7939b511 2026-03-12 06:40:46,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:46,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbce2275c8d3b7939b511 HTTP/1.1" 200 None 2026-03-12 06:40:46,425 - lava_callback - DEBUG - Processing node 69afbce2275c8d3b7939b511: baseline-arm-baylibre 2026-03-12 06:40:46,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbce2275c8d3b7939b511 2026-03-12 06:40:46,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:46,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbce2275c8d3b7939b511 HTTP/1.1" 200 None 2026-03-12 06:40:46,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:46,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:40:46,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:40:46,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbce2275c8d3b7939b511 HTTP/1.1" 200 None 2026-03-12 06:40:46,499 - lava_callback - ERROR - Error processing callback for node 69afbce2275c8d3b7939b511: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:41:26,431 - lava_callback - INFO - Received callback for node 69afbd07275c8d3b7939b51c INFO: 172.21.0.1:53186 - "POST /node/69afbd07275c8d3b7939b51c HTTP/1.0" 202 Accepted 2026-03-12 06:41:26,437 - lava_callback - INFO - Starting async job submit for node 69afbd07275c8d3b7939b51c 2026-03-12 06:41:26,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:41:26,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd07275c8d3b7939b51c HTTP/1.1" 200 None 2026-03-12 06:41:26,481 - lava_callback - DEBUG - Processing node 69afbd07275c8d3b7939b51c: baseline-arm-baylibre 2026-03-12 06:41:26,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbd07275c8d3b7939b51c 2026-03-12 06:41:26,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:41:26,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd07275c8d3b7939b51c HTTP/1.1" 200 None 2026-03-12 06:41:26,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53192 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:41:26,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:41:26,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:41:26,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbd07275c8d3b7939b51c HTTP/1.1" 200 None 2026-03-12 06:41:26,545 - lava_callback - ERROR - Error processing callback for node 69afbd07275c8d3b7939b51c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:43:17,379 - lava_callback - INFO - Received callback for node 69afbd75275c8d3b7939b53f INFO: 172.21.0.1:59326 - "POST /node/69afbd75275c8d3b7939b53f HTTP/1.0" 202 Accepted 2026-03-12 06:43:17,384 - lava_callback - INFO - Starting async job submit for node 69afbd75275c8d3b7939b53f 2026-03-12 06:43:17,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:17,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd75275c8d3b7939b53f HTTP/1.1" 200 None 2026-03-12 06:43:17,400 - lava_callback - DEBUG - Processing node 69afbd75275c8d3b7939b53f: baseline-arm-clabbe 2026-03-12 06:43:17,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbd75275c8d3b7939b53f 2026-03-12 06:43:17,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:17,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd75275c8d3b7939b53f HTTP/1.1" 200 None 2026-03-12 06:43:17,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:17,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:43:17,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:17,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbd75275c8d3b7939b53f HTTP/1.1" 200 None 2026-03-12 06:43:17,458 - lava_callback - ERROR - Error processing callback for node 69afbd75275c8d3b7939b53f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:43:57,349 - lava_callback - INFO - Received callback for node 69afbd9a275c8d3b7939b546 INFO: 172.21.0.1:37234 - "POST /node/69afbd9a275c8d3b7939b546 HTTP/1.0" 202 Accepted 2026-03-12 06:43:57,354 - lava_callback - INFO - Starting async job submit for node 69afbd9a275c8d3b7939b546 2026-03-12 06:43:57,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:57,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd9a275c8d3b7939b546 HTTP/1.1" 200 None 2026-03-12 06:43:57,377 - lava_callback - DEBUG - Processing node 69afbd9a275c8d3b7939b546: baseline-arm-clabbe 2026-03-12 06:43:57,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbd9a275c8d3b7939b546 2026-03-12 06:43:57,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:57,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbd9a275c8d3b7939b546 HTTP/1.1" 200 None 2026-03-12 06:43:57,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:57,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:43:57,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:43:57,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbd9a275c8d3b7939b546 HTTP/1.1" 200 None 2026-03-12 06:43:57,431 - lava_callback - ERROR - Error processing callback for node 69afbd9a275c8d3b7939b546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:44:37,409 - lava_callback - INFO - Received callback for node 69afbdbf275c8d3b7939b551 INFO: 172.21.0.1:35386 - "POST /node/69afbdbf275c8d3b7939b551 HTTP/1.0" 202 Accepted 2026-03-12 06:44:37,414 - lava_callback - INFO - Starting async job submit for node 69afbdbf275c8d3b7939b551 2026-03-12 06:44:37,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:37,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbdbf275c8d3b7939b551 HTTP/1.1" 200 None 2026-03-12 06:44:37,431 - lava_callback - DEBUG - Processing node 69afbdbf275c8d3b7939b551: baseline-arm-clabbe 2026-03-12 06:44:37,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbdbf275c8d3b7939b551 2026-03-12 06:44:37,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:37,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbdbf275c8d3b7939b551 HTTP/1.1" 200 None 2026-03-12 06:44:37,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:37,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:44:37,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:37,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbdbf275c8d3b7939b551 HTTP/1.1" 200 None 2026-03-12 06:44:37,487 - lava_callback - ERROR - Error processing callback for node 69afbdbf275c8d3b7939b551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:44:57,372 - lava_callback - INFO - Received callback for node 69afbde5275c8d3b7939b55c INFO: 172.21.0.1:42852 - "POST /node/69afbde5275c8d3b7939b55c HTTP/1.0" 202 Accepted 2026-03-12 06:44:57,378 - lava_callback - INFO - Starting async job submit for node 69afbde5275c8d3b7939b55c 2026-03-12 06:44:57,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:57,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbde5275c8d3b7939b55c HTTP/1.1" 200 None 2026-03-12 06:44:57,393 - lava_callback - DEBUG - Processing node 69afbde5275c8d3b7939b55c: baseline-arm-clabbe 2026-03-12 06:44:57,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbde5275c8d3b7939b55c 2026-03-12 06:44:57,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:57,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbde5275c8d3b7939b55c HTTP/1.1" 200 None 2026-03-12 06:44:57,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:57,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:44:57,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:44:57,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbde5275c8d3b7939b55c HTTP/1.1" 200 None 2026-03-12 06:44:57,452 - lava_callback - ERROR - Error processing callback for node 69afbde5275c8d3b7939b55c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:45:37,450 - lava_callback - INFO - Received callback for node 69afbe0a275c8d3b7939b56b INFO: 172.21.0.1:47520 - "POST /node/69afbe0a275c8d3b7939b56b HTTP/1.0" 202 Accepted 2026-03-12 06:45:37,455 - lava_callback - INFO - Starting async job submit for node 69afbe0a275c8d3b7939b56b 2026-03-12 06:45:37,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:45:37,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe0a275c8d3b7939b56b HTTP/1.1" 200 None 2026-03-12 06:45:37,489 - lava_callback - DEBUG - Processing node 69afbe0a275c8d3b7939b56b: baseline-arm-clabbe 2026-03-12 06:45:37,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbe0a275c8d3b7939b56b 2026-03-12 06:45:37,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:45:37,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe0a275c8d3b7939b56b HTTP/1.1" 200 None 2026-03-12 06:45:37,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:45:37,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af632c275c8d3b79399db4 HTTP/1.1" 200 None 2026-03-12 06:45:37,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:45:37,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbe0a275c8d3b7939b56b HTTP/1.1" 200 None 2026-03-12 06:45:37,563 - lava_callback - ERROR - Error processing callback for node 69afbe0a275c8d3b7939b56b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:47:37,532 - lava_callback - INFO - Received callback for node 69afbe7a275c8d3b7939b585 INFO: 172.21.0.1:44424 - "POST /node/69afbe7a275c8d3b7939b585 HTTP/1.0" 202 Accepted 2026-03-12 06:47:37,538 - lava_callback - INFO - Starting async job submit for node 69afbe7a275c8d3b7939b585 2026-03-12 06:47:37,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:47:37,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe7a275c8d3b7939b585 HTTP/1.1" 200 None 2026-03-12 06:47:37,553 - lava_callback - DEBUG - Processing node 69afbe7a275c8d3b7939b585: baseline-arm-clabbe 2026-03-12 06:47:37,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbe7a275c8d3b7939b585 2026-03-12 06:47:37,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:47:37,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe7a275c8d3b7939b585 HTTP/1.1" 200 None 2026-03-12 06:47:37,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:47:37,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:47:37,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:47:37,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbe7a275c8d3b7939b585 HTTP/1.1" 200 None 2026-03-12 06:47:37,603 - lava_callback - ERROR - Error processing callback for node 69afbe7a275c8d3b7939b585: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:48:17,524 - lava_callback - INFO - Received callback for node 69afbe9f275c8d3b7939b591 INFO: 172.21.0.1:39512 - "POST /node/69afbe9f275c8d3b7939b591 HTTP/1.0" 202 Accepted 2026-03-12 06:48:17,530 - lava_callback - INFO - Starting async job submit for node 69afbe9f275c8d3b7939b591 2026-03-12 06:48:17,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:17,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe9f275c8d3b7939b591 HTTP/1.1" 200 None 2026-03-12 06:48:17,546 - lava_callback - DEBUG - Processing node 69afbe9f275c8d3b7939b591: baseline-arm-clabbe 2026-03-12 06:48:17,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbe9f275c8d3b7939b591 2026-03-12 06:48:17,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:17,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbe9f275c8d3b7939b591 HTTP/1.1" 200 None 2026-03-12 06:48:17,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:17,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:48:17,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:17,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbe9f275c8d3b7939b591 HTTP/1.1" 200 None 2026-03-12 06:48:17,612 - lava_callback - ERROR - Error processing callback for node 69afbe9f275c8d3b7939b591: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:48:57,574 - lava_callback - INFO - Received callback for node 69afbec4275c8d3b7939b599 INFO: 172.21.0.1:49468 - "POST /node/69afbec4275c8d3b7939b599 HTTP/1.0" 202 Accepted 2026-03-12 06:48:57,580 - lava_callback - INFO - Starting async job submit for node 69afbec4275c8d3b7939b599 2026-03-12 06:48:57,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:57,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbec4275c8d3b7939b599 HTTP/1.1" 200 None 2026-03-12 06:48:57,595 - lava_callback - DEBUG - Processing node 69afbec4275c8d3b7939b599: baseline-arm-clabbe 2026-03-12 06:48:57,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbec4275c8d3b7939b599 2026-03-12 06:48:57,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:57,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbec4275c8d3b7939b599 HTTP/1.1" 200 None 2026-03-12 06:48:57,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:57,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:48:57,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:48:57,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbec4275c8d3b7939b599 HTTP/1.1" 200 None 2026-03-12 06:48:57,657 - lava_callback - ERROR - Error processing callback for node 69afbec4275c8d3b7939b599: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46146 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:49:17,552 - lava_callback - INFO - Received callback for node 69afbee8275c8d3b7939b5a2 INFO: 172.21.0.1:46148 - "POST /node/69afbee8275c8d3b7939b5a2 HTTP/1.0" 202 Accepted 2026-03-12 06:49:17,558 - lava_callback - INFO - Starting async job submit for node 69afbee8275c8d3b7939b5a2 2026-03-12 06:49:17,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:17,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbee8275c8d3b7939b5a2 HTTP/1.1" 200 None 2026-03-12 06:49:17,575 - lava_callback - DEBUG - Processing node 69afbee8275c8d3b7939b5a2: baseline-arm-clabbe 2026-03-12 06:49:17,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbee8275c8d3b7939b5a2 2026-03-12 06:49:17,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:17,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbee8275c8d3b7939b5a2 HTTP/1.1" 200 None 2026-03-12 06:49:17,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:17,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:49:17,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:17,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbee8275c8d3b7939b5a2 HTTP/1.1" 200 None 2026-03-12 06:49:17,638 - lava_callback - ERROR - Error processing callback for node 69afbee8275c8d3b7939b5a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:49:57,619 - lava_callback - INFO - Received callback for node 69afbf0d275c8d3b7939b5ab INFO: 172.21.0.1:38106 - "POST /node/69afbf0d275c8d3b7939b5ab HTTP/1.0" 202 Accepted 2026-03-12 06:49:57,625 - lava_callback - INFO - Starting async job submit for node 69afbf0d275c8d3b7939b5ab 2026-03-12 06:49:57,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:57,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf0d275c8d3b7939b5ab HTTP/1.1" 200 None 2026-03-12 06:49:57,641 - lava_callback - DEBUG - Processing node 69afbf0d275c8d3b7939b5ab: baseline-arm-clabbe 2026-03-12 06:49:57,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbf0d275c8d3b7939b5ab 2026-03-12 06:49:57,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:57,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf0d275c8d3b7939b5ab HTTP/1.1" 200 None 2026-03-12 06:49:57,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:57,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:49:57,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:49:57,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbf0d275c8d3b7939b5ab HTTP/1.1" 200 None 2026-03-12 06:49:57,694 - lava_callback - ERROR - Error processing callback for node 69afbf0d275c8d3b7939b5ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:50:37,893 - lava_callback - INFO - Received callback for node 69afbf32275c8d3b7939b5b4 INFO: 172.21.0.1:51698 - "POST /node/69afbf32275c8d3b7939b5b4 HTTP/1.0" 202 Accepted 2026-03-12 06:50:37,899 - lava_callback - INFO - Starting async job submit for node 69afbf32275c8d3b7939b5b4 2026-03-12 06:50:37,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:50:37,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf32275c8d3b7939b5b4 HTTP/1.1" 200 None 2026-03-12 06:50:37,914 - lava_callback - DEBUG - Processing node 69afbf32275c8d3b7939b5b4: baseline-arm-clabbe 2026-03-12 06:50:37,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbf32275c8d3b7939b5b4 2026-03-12 06:50:37,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:50:37,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf32275c8d3b7939b5b4 HTTP/1.1" 200 None 2026-03-12 06:50:37,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:50:37,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:50:37,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:50:37,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbf32275c8d3b7939b5b4 HTTP/1.1" 200 None 2026-03-12 06:50:37,980 - lava_callback - ERROR - Error processing callback for node 69afbf32275c8d3b7939b5b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:51:17,669 - lava_callback - INFO - Received callback for node 69afbf57275c8d3b7939b5bf INFO: 172.21.0.1:58056 - "POST /node/69afbf57275c8d3b7939b5bf HTTP/1.0" 202 Accepted 2026-03-12 06:51:17,675 - lava_callback - INFO - Starting async job submit for node 69afbf57275c8d3b7939b5bf 2026-03-12 06:51:17,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:17,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf57275c8d3b7939b5bf HTTP/1.1" 200 None 2026-03-12 06:51:17,715 - lava_callback - DEBUG - Processing node 69afbf57275c8d3b7939b5bf: baseline-arm-clabbe 2026-03-12 06:51:17,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbf57275c8d3b7939b5bf 2026-03-12 06:51:17,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:17,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf57275c8d3b7939b5bf HTTP/1.1" 200 None 2026-03-12 06:51:17,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:17,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:51:17,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:17,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbf57275c8d3b7939b5bf HTTP/1.1" 200 None 2026-03-12 06:51:17,799 - lava_callback - ERROR - Error processing callback for node 69afbf57275c8d3b7939b5bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:51:57,616 - lava_callback - INFO - Received callback for node 69afbf7b275c8d3b7939b5c6 INFO: 172.21.0.1:40696 - "POST /node/69afbf7b275c8d3b7939b5c6 HTTP/1.0" 202 Accepted 2026-03-12 06:51:57,622 - lava_callback - INFO - Starting async job submit for node 69afbf7b275c8d3b7939b5c6 2026-03-12 06:51:57,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:57,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf7b275c8d3b7939b5c6 HTTP/1.1" 200 None 2026-03-12 06:51:57,641 - lava_callback - DEBUG - Processing node 69afbf7b275c8d3b7939b5c6: baseline-arm-clabbe 2026-03-12 06:51:57,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbf7b275c8d3b7939b5c6 2026-03-12 06:51:57,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:57,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbf7b275c8d3b7939b5c6 HTTP/1.1" 200 None 2026-03-12 06:51:57,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:57,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:51:57,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:51:57,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbf7b275c8d3b7939b5c6 HTTP/1.1" 200 None 2026-03-12 06:51:57,706 - lava_callback - ERROR - Error processing callback for node 69afbf7b275c8d3b7939b5c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:53:37,720 - lava_callback - INFO - Received callback for node 69afbfed275c8d3b7939b5dd INFO: 172.21.0.1:38856 - "POST /node/69afbfed275c8d3b7939b5dd HTTP/1.0" 202 Accepted 2026-03-12 06:53:37,726 - lava_callback - INFO - Starting async job submit for node 69afbfed275c8d3b7939b5dd 2026-03-12 06:53:37,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:53:37,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbfed275c8d3b7939b5dd HTTP/1.1" 200 None 2026-03-12 06:53:37,742 - lava_callback - DEBUG - Processing node 69afbfed275c8d3b7939b5dd: baseline-arm-clabbe 2026-03-12 06:53:37,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afbfed275c8d3b7939b5dd 2026-03-12 06:53:37,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:53:37,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afbfed275c8d3b7939b5dd HTTP/1.1" 200 None 2026-03-12 06:53:37,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:53:37,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d368c4d487a0e751145 HTTP/1.1" 200 None 2026-03-12 06:53:37,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:53:37,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afbfed275c8d3b7939b5dd HTTP/1.1" 200 None 2026-03-12 06:53:37,805 - lava_callback - ERROR - Error processing callback for node 69afbfed275c8d3b7939b5dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET /node/69aa29f98c4d487a0e751ed1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK 2026-03-12 06:59:07,521 - lava_callback - INFO - Received callback for node 69afc12d275c8d3b7939b639 INFO: 172.21.0.1:57828 - "POST /node/69afc12d275c8d3b7939b639 HTTP/1.0" 202 Accepted 2026-03-12 06:59:07,527 - lava_callback - INFO - Starting async job submit for node 69afc12d275c8d3b7939b639 2026-03-12 06:59:07,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:59:07,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc12d275c8d3b7939b639 HTTP/1.1" 200 None 2026-03-12 06:59:07,542 - lava_callback - DEBUG - Processing node 69afc12d275c8d3b7939b639: baseline-arm64-baylibre 2026-03-12 06:59:07,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc12d275c8d3b7939b639 2026-03-12 06:59:07,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:59:07,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc12d275c8d3b7939b639 HTTP/1.1" 200 None 2026-03-12 06:59:07,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:59:07,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 06:59:07,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 06:59:07,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc12d275c8d3b7939b639 HTTP/1.1" 200 None 2026-03-12 06:59:07,610 - lava_callback - ERROR - Error processing callback for node 69afc12d275c8d3b7939b639: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:00:27,478 - lava_callback - INFO - Received callback for node 69afc17d275c8d3b7939b64d INFO: 172.21.0.1:47842 - "POST /node/69afc17d275c8d3b7939b64d HTTP/1.0" 202 Accepted 2026-03-12 07:00:27,485 - lava_callback - INFO - Starting async job submit for node 69afc17d275c8d3b7939b64d 2026-03-12 07:00:27,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:00:27,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc17d275c8d3b7939b64d HTTP/1.1" 200 None 2026-03-12 07:00:27,514 - lava_callback - DEBUG - Processing node 69afc17d275c8d3b7939b64d: baseline-arm64-baylibre 2026-03-12 07:00:27,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc17d275c8d3b7939b64d 2026-03-12 07:00:27,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:00:27,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc17d275c8d3b7939b64d HTTP/1.1" 200 None 2026-03-12 07:00:27,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:00:27,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:00:27,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:00:27,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc17d275c8d3b7939b64d HTTP/1.1" 200 None 2026-03-12 07:00:27,583 - lava_callback - ERROR - Error processing callback for node 69afc17d275c8d3b7939b64d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:01:47,883 - lava_callback - INFO - Received callback for node 69afc1cd275c8d3b7939b657 INFO: 172.21.0.1:60214 - "POST /node/69afc1cd275c8d3b7939b657 HTTP/1.0" 202 Accepted 2026-03-12 07:01:47,888 - lava_callback - INFO - Starting async job submit for node 69afc1cd275c8d3b7939b657 2026-03-12 07:01:47,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:01:47,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc1cd275c8d3b7939b657 HTTP/1.1" 200 None 2026-03-12 07:01:47,907 - lava_callback - DEBUG - Processing node 69afc1cd275c8d3b7939b657: baseline-arm64-baylibre 2026-03-12 07:01:47,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc1cd275c8d3b7939b657 2026-03-12 07:01:47,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:01:47,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc1cd275c8d3b7939b657 HTTP/1.1" 200 None 2026-03-12 07:01:47,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:01:47,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:01:47,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:01:47,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc1cd275c8d3b7939b657 HTTP/1.1" 200 None 2026-03-12 07:01:47,966 - lava_callback - ERROR - Error processing callback for node 69afc1cd275c8d3b7939b657: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:03:07,653 - lava_callback - INFO - Received callback for node 69afc21e275c8d3b7939b65e INFO: 172.21.0.1:55716 - "POST /node/69afc21e275c8d3b7939b65e HTTP/1.0" 202 Accepted 2026-03-12 07:03:07,659 - lava_callback - INFO - Starting async job submit for node 69afc21e275c8d3b7939b65e 2026-03-12 07:03:07,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:03:07,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc21e275c8d3b7939b65e HTTP/1.1" 200 None 2026-03-12 07:03:07,694 - lava_callback - DEBUG - Processing node 69afc21e275c8d3b7939b65e: baseline-arm64-baylibre 2026-03-12 07:03:07,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc21e275c8d3b7939b65e 2026-03-12 07:03:07,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:03:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc21e275c8d3b7939b65e HTTP/1.1" 200 None 2026-03-12 07:03:07,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:03:07,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:03:07,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:03:07,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc21e275c8d3b7939b65e HTTP/1.1" 200 None 2026-03-12 07:03:07,751 - lava_callback - ERROR - Error processing callback for node 69afc21e275c8d3b7939b65e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:04:27,985 - lava_callback - INFO - Received callback for node 69afc26b275c8d3b7939b66c INFO: 172.21.0.1:57698 - "POST /node/69afc26b275c8d3b7939b66c HTTP/1.0" 202 Accepted 2026-03-12 07:04:27,991 - lava_callback - INFO - Starting async job submit for node 69afc26b275c8d3b7939b66c 2026-03-12 07:04:27,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:04:28,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc26b275c8d3b7939b66c HTTP/1.1" 200 None 2026-03-12 07:04:28,007 - lava_callback - DEBUG - Processing node 69afc26b275c8d3b7939b66c: baseline-arm64-baylibre 2026-03-12 07:04:28,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc26b275c8d3b7939b66c 2026-03-12 07:04:28,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:04:28,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc26b275c8d3b7939b66c HTTP/1.1" 200 None 2026-03-12 07:04:28,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:04:28,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:04:28,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:04:28,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc26b275c8d3b7939b66c HTTP/1.1" 200 None 2026-03-12 07:04:28,061 - lava_callback - ERROR - Error processing callback for node 69afc26b275c8d3b7939b66c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33304 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:05:38,243 - lava_callback - INFO - Received callback for node 69afc2bb275c8d3b7939b67c INFO: 172.21.0.1:33306 - "POST /node/69afc2bb275c8d3b7939b67c HTTP/1.0" 202 Accepted 2026-03-12 07:05:38,251 - lava_callback - INFO - Starting async job submit for node 69afc2bb275c8d3b7939b67c 2026-03-12 07:05:38,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:05:38,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc2bb275c8d3b7939b67c HTTP/1.1" 200 None 2026-03-12 07:05:38,268 - lava_callback - DEBUG - Processing node 69afc2bb275c8d3b7939b67c: baseline-arm64-clabbe 2026-03-12 07:05:38,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc2bb275c8d3b7939b67c 2026-03-12 07:05:38,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:05:38,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc2bb275c8d3b7939b67c HTTP/1.1" 200 None 2026-03-12 07:05:38,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:05:38,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:05:38,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:05:38,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc2bb275c8d3b7939b67c HTTP/1.1" 200 None 2026-03-12 07:05:38,321 - lava_callback - ERROR - Error processing callback for node 69afc2bb275c8d3b7939b67c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:06:58,334 - lava_callback - INFO - Received callback for node 69afc307275c8d3b7939b684 INFO: 172.21.0.1:45774 - "POST /node/69afc307275c8d3b7939b684 HTTP/1.0" 202 Accepted 2026-03-12 07:06:58,339 - lava_callback - INFO - Starting async job submit for node 69afc307275c8d3b7939b684 2026-03-12 07:06:58,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:06:58,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc307275c8d3b7939b684 HTTP/1.1" 200 None 2026-03-12 07:06:58,360 - lava_callback - DEBUG - Processing node 69afc307275c8d3b7939b684: baseline-arm64-clabbe 2026-03-12 07:06:58,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc307275c8d3b7939b684 2026-03-12 07:06:58,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:06:58,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc307275c8d3b7939b684 HTTP/1.1" 200 None 2026-03-12 07:06:58,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:06:58,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:06:58,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:06:58,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc307275c8d3b7939b684 HTTP/1.1" 200 None 2026-03-12 07:06:58,422 - lava_callback - ERROR - Error processing callback for node 69afc307275c8d3b7939b684: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:08:18,382 - lava_callback - INFO - Received callback for node 69afc358275c8d3b7939b690 INFO: 172.21.0.1:53878 - "POST /node/69afc358275c8d3b7939b690 HTTP/1.0" 202 Accepted 2026-03-12 07:08:18,388 - lava_callback - INFO - Starting async job submit for node 69afc358275c8d3b7939b690 2026-03-12 07:08:18,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:08:18,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc358275c8d3b7939b690 HTTP/1.1" 200 None 2026-03-12 07:08:18,403 - lava_callback - DEBUG - Processing node 69afc358275c8d3b7939b690: baseline-arm64-clabbe 2026-03-12 07:08:18,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc358275c8d3b7939b690 2026-03-12 07:08:18,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:08:18,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc358275c8d3b7939b690 HTTP/1.1" 200 None 2026-03-12 07:08:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:08:18,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:08:18,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:08:18,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc358275c8d3b7939b690 HTTP/1.1" 200 None 2026-03-12 07:08:18,463 - lava_callback - ERROR - Error processing callback for node 69afc358275c8d3b7939b690: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:09:38,420 - lava_callback - INFO - Received callback for node 69afc3a6275c8d3b7939b695 INFO: 172.21.0.1:53390 - "POST /node/69afc3a6275c8d3b7939b695 HTTP/1.0" 202 Accepted 2026-03-12 07:09:38,425 - lava_callback - INFO - Starting async job submit for node 69afc3a6275c8d3b7939b695 2026-03-12 07:09:38,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:09:38,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc3a6275c8d3b7939b695 HTTP/1.1" 200 None 2026-03-12 07:09:38,440 - lava_callback - DEBUG - Processing node 69afc3a6275c8d3b7939b695: baseline-arm64-clabbe 2026-03-12 07:09:38,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc3a6275c8d3b7939b695 2026-03-12 07:09:38,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:09:38,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc3a6275c8d3b7939b695 HTTP/1.1" 200 None 2026-03-12 07:09:38,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:09:38,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:09:38,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:09:38,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc3a6275c8d3b7939b695 HTTP/1.1" 200 None 2026-03-12 07:09:38,516 - lava_callback - ERROR - Error processing callback for node 69afc3a6275c8d3b7939b695: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:10:58,632 - lava_callback - INFO - Received callback for node 69afc3f5275c8d3b7939b69f INFO: 172.21.0.1:48436 - "POST /node/69afc3f5275c8d3b7939b69f HTTP/1.0" 202 Accepted 2026-03-12 07:10:58,637 - lava_callback - INFO - Starting async job submit for node 69afc3f5275c8d3b7939b69f 2026-03-12 07:10:58,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:10:58,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc3f5275c8d3b7939b69f HTTP/1.1" 200 None 2026-03-12 07:10:58,656 - lava_callback - DEBUG - Processing node 69afc3f5275c8d3b7939b69f: baseline-arm64-clabbe 2026-03-12 07:10:58,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc3f5275c8d3b7939b69f 2026-03-12 07:10:58,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:10:58,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc3f5275c8d3b7939b69f HTTP/1.1" 200 None 2026-03-12 07:10:58,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:10:58,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:10:58,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:10:58,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc3f5275c8d3b7939b69f HTTP/1.1" 200 None 2026-03-12 07:10:58,714 - lava_callback - ERROR - Error processing callback for node 69afc3f5275c8d3b7939b69f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:12:18,799 - lava_callback - INFO - Received callback for node 69afc443275c8d3b7939b6a8 INFO: 172.21.0.1:45118 - "POST /node/69afc443275c8d3b7939b6a8 HTTP/1.0" 202 Accepted 2026-03-12 07:12:18,805 - lava_callback - INFO - Starting async job submit for node 69afc443275c8d3b7939b6a8 2026-03-12 07:12:18,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:12:18,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc443275c8d3b7939b6a8 HTTP/1.1" 200 None 2026-03-12 07:12:18,820 - lava_callback - DEBUG - Processing node 69afc443275c8d3b7939b6a8: baseline-arm64-clabbe 2026-03-12 07:12:18,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc443275c8d3b7939b6a8 2026-03-12 07:12:18,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:12:18,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc443275c8d3b7939b6a8 HTTP/1.1" 200 None 2026-03-12 07:12:18,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:12:18,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af6340275c8d3b79399dc3 HTTP/1.1" 200 None 2026-03-12 07:12:18,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:12:18,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc443275c8d3b7939b6a8 HTTP/1.1" 200 None 2026-03-12 07:12:18,881 - lava_callback - ERROR - Error processing callback for node 69afc443275c8d3b7939b6a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:13:18,611 - lava_callback - INFO - Received callback for node 69afc483275c8d3b7939b6b1 INFO: 172.21.0.1:33756 - "POST /node/69afc483275c8d3b7939b6b1 HTTP/1.0" 202 Accepted 2026-03-12 07:13:18,617 - lava_callback - INFO - Starting async job submit for node 69afc483275c8d3b7939b6b1 2026-03-12 07:13:18,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:18,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc483275c8d3b7939b6b1 HTTP/1.1" 200 None 2026-03-12 07:13:18,639 - lava_callback - DEBUG - Processing node 69afc483275c8d3b7939b6b1: baseline-arm-clabbe 2026-03-12 07:13:18,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc483275c8d3b7939b6b1 2026-03-12 07:13:18,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:18,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc483275c8d3b7939b6b1 HTTP/1.1" 200 None 2026-03-12 07:13:18,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:18,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:13:18,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:18,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc483275c8d3b7939b6b1 HTTP/1.1" 200 None 2026-03-12 07:13:18,695 - lava_callback - ERROR - Error processing callback for node 69afc483275c8d3b7939b6b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:13:58,587 - lava_callback - INFO - Received callback for node 69afc4a8275c8d3b7939b6bc INFO: 172.21.0.1:52092 - "POST /node/69afc4a8275c8d3b7939b6bc HTTP/1.0" 202 Accepted 2026-03-12 07:13:58,593 - lava_callback - INFO - Starting async job submit for node 69afc4a8275c8d3b7939b6bc 2026-03-12 07:13:58,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:58,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4a8275c8d3b7939b6bc HTTP/1.1" 200 None 2026-03-12 07:13:58,609 - lava_callback - DEBUG - Processing node 69afc4a8275c8d3b7939b6bc: baseline-arm-clabbe 2026-03-12 07:13:58,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc4a8275c8d3b7939b6bc 2026-03-12 07:13:58,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:58,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4a8275c8d3b7939b6bc HTTP/1.1" 200 None 2026-03-12 07:13:58,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:58,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:13:58,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:13:58,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc4a8275c8d3b7939b6bc HTTP/1.1" 200 None 2026-03-12 07:13:58,669 - lava_callback - ERROR - Error processing callback for node 69afc4a8275c8d3b7939b6bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:14:38,624 - lava_callback - INFO - Received callback for node 69afc4cd275c8d3b7939b6c5 INFO: 172.21.0.1:56478 - "POST /node/69afc4cd275c8d3b7939b6c5 HTTP/1.0" 202 Accepted 2026-03-12 07:14:38,629 - lava_callback - INFO - Starting async job submit for node 69afc4cd275c8d3b7939b6c5 2026-03-12 07:14:38,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:14:38,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4cd275c8d3b7939b6c5 HTTP/1.1" 200 None 2026-03-12 07:14:38,669 - lava_callback - DEBUG - Processing node 69afc4cd275c8d3b7939b6c5: baseline-arm-clabbe 2026-03-12 07:14:38,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc4cd275c8d3b7939b6c5 2026-03-12 07:14:38,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:14:38,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4cd275c8d3b7939b6c5 HTTP/1.1" 200 None 2026-03-12 07:14:38,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:14:38,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:14:38,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:14:38,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc4cd275c8d3b7939b6c5 HTTP/1.1" 200 None 2026-03-12 07:14:38,728 - lava_callback - ERROR - Error processing callback for node 69afc4cd275c8d3b7939b6c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:15:18,943 - lava_callback - INFO - Received callback for node 69afc4f3275c8d3b7939b6d1 INFO: 172.21.0.1:49964 - "POST /node/69afc4f3275c8d3b7939b6d1 HTTP/1.0" 202 Accepted 2026-03-12 07:15:18,950 - lava_callback - INFO - Starting async job submit for node 69afc4f3275c8d3b7939b6d1 2026-03-12 07:15:18,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:18,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4f3275c8d3b7939b6d1 HTTP/1.1" 200 None 2026-03-12 07:15:18,971 - lava_callback - DEBUG - Processing node 69afc4f3275c8d3b7939b6d1: baseline-arm-clabbe 2026-03-12 07:15:18,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc4f3275c8d3b7939b6d1 2026-03-12 07:15:18,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:18,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc4f3275c8d3b7939b6d1 HTTP/1.1" 200 None 2026-03-12 07:15:18,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:19,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:15:19,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:19,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc4f3275c8d3b7939b6d1 HTTP/1.1" 200 None 2026-03-12 07:15:19,028 - lava_callback - ERROR - Error processing callback for node 69afc4f3275c8d3b7939b6d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:15:38,701 - lava_callback - INFO - Received callback for node 69afc518275c8d3b7939b6d8 INFO: 172.21.0.1:37840 - "POST /node/69afc518275c8d3b7939b6d8 HTTP/1.0" 202 Accepted 2026-03-12 07:15:38,706 - lava_callback - INFO - Starting async job submit for node 69afc518275c8d3b7939b6d8 2026-03-12 07:15:38,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc518275c8d3b7939b6d8 HTTP/1.1" 200 None 2026-03-12 07:15:38,725 - lava_callback - DEBUG - Processing node 69afc518275c8d3b7939b6d8: baseline-arm-clabbe 2026-03-12 07:15:38,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc518275c8d3b7939b6d8 2026-03-12 07:15:38,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:38,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc518275c8d3b7939b6d8 HTTP/1.1" 200 None 2026-03-12 07:15:38,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:38,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:15:38,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:15:38,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc518275c8d3b7939b6d8 HTTP/1.1" 200 None 2026-03-12 07:15:38,798 - lava_callback - ERROR - Error processing callback for node 69afc518275c8d3b7939b6d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:16:18,690 - lava_callback - INFO - Received callback for node 69afc53c275c8d3b7939b6e2 INFO: 172.21.0.1:55970 - "POST /node/69afc53c275c8d3b7939b6e2 HTTP/1.0" 202 Accepted 2026-03-12 07:16:18,696 - lava_callback - INFO - Starting async job submit for node 69afc53c275c8d3b7939b6e2 2026-03-12 07:16:18,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:16:18,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc53c275c8d3b7939b6e2 HTTP/1.1" 200 None 2026-03-12 07:16:18,712 - lava_callback - DEBUG - Processing node 69afc53c275c8d3b7939b6e2: baseline-arm-clabbe 2026-03-12 07:16:18,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc53c275c8d3b7939b6e2 2026-03-12 07:16:18,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:16:18,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc53c275c8d3b7939b6e2 HTTP/1.1" 200 None 2026-03-12 07:16:18,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:16:18,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc009bcd207e915d76b94 HTTP/1.1" 200 None 2026-03-12 07:16:18,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:16:18,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc53c275c8d3b7939b6e2 HTTP/1.1" 200 None 2026-03-12 07:16:18,782 - lava_callback - ERROR - Error processing callback for node 69afc53c275c8d3b7939b6e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:17:08,479 - lava_callback - INFO - Received callback for node 69afc56b275c8d3b7939b6ee INFO: 172.21.0.1:43762 - "POST /node/69afc56b275c8d3b7939b6ee HTTP/1.0" 202 Accepted 2026-03-12 07:17:08,485 - lava_callback - INFO - Starting async job submit for node 69afc56b275c8d3b7939b6ee 2026-03-12 07:17:08,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:17:08,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc56b275c8d3b7939b6ee HTTP/1.1" 200 None 2026-03-12 07:17:08,507 - lava_callback - DEBUG - Processing node 69afc56b275c8d3b7939b6ee: baseline-arm64-baylibre 2026-03-12 07:17:08,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc56b275c8d3b7939b6ee 2026-03-12 07:17:08,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:17:08,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc56b275c8d3b7939b6ee HTTP/1.1" 200 None 2026-03-12 07:17:08,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:17:08,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:17:08,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:17:08,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc56b275c8d3b7939b6ee HTTP/1.1" 200 None 2026-03-12 07:17:08,572 - lava_callback - ERROR - Error processing callback for node 69afc56b275c8d3b7939b6ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:19:28,786 - lava_callback - INFO - Received callback for node 69afc5fa275c8d3b7939b6f8 INFO: 172.21.0.1:32788 - "POST /node/69afc5fa275c8d3b7939b6f8 HTTP/1.0" 202 Accepted 2026-03-12 07:19:28,792 - lava_callback - INFO - Starting async job submit for node 69afc5fa275c8d3b7939b6f8 2026-03-12 07:19:28,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:19:28,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc5fa275c8d3b7939b6f8 HTTP/1.1" 200 None 2026-03-12 07:19:28,810 - lava_callback - DEBUG - Processing node 69afc5fa275c8d3b7939b6f8: baseline-arm64-baylibre 2026-03-12 07:19:28,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc5fa275c8d3b7939b6f8 2026-03-12 07:19:28,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:19:28,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc5fa275c8d3b7939b6f8 HTTP/1.1" 200 None 2026-03-12 07:19:28,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:19:28,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:19:28,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:19:28,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc5fa275c8d3b7939b6f8 HTTP/1.1" 200 None 2026-03-12 07:19:28,871 - lava_callback - ERROR - Error processing callback for node 69afc5fa275c8d3b7939b6f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:22:19,045 - lava_callback - INFO - Received callback for node 69afc69b275c8d3b7939b713 INFO: 172.21.0.1:44630 - "POST /node/69afc69b275c8d3b7939b713 HTTP/1.0" 202 Accepted 2026-03-12 07:22:19,051 - lava_callback - INFO - Starting async job submit for node 69afc69b275c8d3b7939b713 2026-03-12 07:22:19,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:22:19,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc69b275c8d3b7939b713 HTTP/1.1" 200 None 2026-03-12 07:22:19,067 - lava_callback - DEBUG - Processing node 69afc69b275c8d3b7939b713: baseline-arm64-clabbe 2026-03-12 07:22:19,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc69b275c8d3b7939b713 2026-03-12 07:22:19,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:22:19,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc69b275c8d3b7939b713 HTTP/1.1" 200 None 2026-03-12 07:22:19,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:22:19,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:22:19,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:22:19,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc69b275c8d3b7939b713 HTTP/1.1" 200 None 2026-03-12 07:22:19,124 - lava_callback - ERROR - Error processing callback for node 69afc69b275c8d3b7939b713: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:23:39,104 - lava_callback - INFO - Received callback for node 69afc6e7275c8d3b7939b71b INFO: 172.21.0.1:55890 - "POST /node/69afc6e7275c8d3b7939b71b HTTP/1.0" 202 Accepted 2026-03-12 07:23:39,109 - lava_callback - INFO - Starting async job submit for node 69afc6e7275c8d3b7939b71b 2026-03-12 07:23:39,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:23:39,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc6e7275c8d3b7939b71b HTTP/1.1" 200 None 2026-03-12 07:23:39,125 - lava_callback - DEBUG - Processing node 69afc6e7275c8d3b7939b71b: baseline-arm64-clabbe 2026-03-12 07:23:39,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc6e7275c8d3b7939b71b 2026-03-12 07:23:39,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:23:39,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc6e7275c8d3b7939b71b HTTP/1.1" 200 None 2026-03-12 07:23:39,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:23:39,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:23:39,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:23:39,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc6e7275c8d3b7939b71b HTTP/1.1" 200 None 2026-03-12 07:23:39,191 - lava_callback - ERROR - Error processing callback for node 69afc6e7275c8d3b7939b71b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49654 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:24:39,182 - lava_callback - INFO - Received callback for node 69afc731275c8d3b7939b726 INFO: 172.21.0.1:49664 - "POST /node/69afc731275c8d3b7939b726 HTTP/1.0" 202 Accepted 2026-03-12 07:24:39,188 - lava_callback - INFO - Starting async job submit for node 69afc731275c8d3b7939b726 2026-03-12 07:24:39,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:24:39,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc731275c8d3b7939b726 HTTP/1.1" 200 None 2026-03-12 07:24:39,206 - lava_callback - DEBUG - Processing node 69afc731275c8d3b7939b726: baseline-arm64-clabbe 2026-03-12 07:24:39,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc731275c8d3b7939b726 2026-03-12 07:24:39,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:24:39,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc731275c8d3b7939b726 HTTP/1.1" 200 None 2026-03-12 07:24:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:24:39,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:24:39,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:24:39,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc731275c8d3b7939b726 HTTP/1.1" 200 None 2026-03-12 07:24:39,306 - lava_callback - ERROR - Error processing callback for node 69afc731275c8d3b7939b726: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:25:59,205 - lava_callback - INFO - Received callback for node 69afc77f275c8d3b7939b72c INFO: 172.21.0.1:51150 - "POST /node/69afc77f275c8d3b7939b72c HTTP/1.0" 202 Accepted 2026-03-12 07:25:59,211 - lava_callback - INFO - Starting async job submit for node 69afc77f275c8d3b7939b72c 2026-03-12 07:25:59,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:25:59,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc77f275c8d3b7939b72c HTTP/1.1" 200 None 2026-03-12 07:25:59,228 - lava_callback - DEBUG - Processing node 69afc77f275c8d3b7939b72c: baseline-arm64-clabbe 2026-03-12 07:25:59,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc77f275c8d3b7939b72c 2026-03-12 07:25:59,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:25:59,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc77f275c8d3b7939b72c HTTP/1.1" 200 None 2026-03-12 07:25:59,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:25:59,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:25:59,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:25:59,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc77f275c8d3b7939b72c HTTP/1.1" 200 None 2026-03-12 07:25:59,292 - lava_callback - ERROR - Error processing callback for node 69afc77f275c8d3b7939b72c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:29:49,255 - lava_callback - INFO - Received callback for node 69afc864275c8d3b7939b74a INFO: 172.21.0.1:36416 - "POST /node/69afc864275c8d3b7939b74a HTTP/1.0" 202 Accepted 2026-03-12 07:29:49,260 - lava_callback - INFO - Starting async job submit for node 69afc864275c8d3b7939b74a 2026-03-12 07:29:49,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:29:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc864275c8d3b7939b74a HTTP/1.1" 200 None 2026-03-12 07:29:49,277 - lava_callback - DEBUG - Processing node 69afc864275c8d3b7939b74a: baseline-arm64-baylibre 2026-03-12 07:29:49,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc864275c8d3b7939b74a 2026-03-12 07:29:49,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:29:49,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc864275c8d3b7939b74a HTTP/1.1" 200 None 2026-03-12 07:29:49,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:29:49,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:29:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:29:49,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc864275c8d3b7939b74a HTTP/1.1" 200 None 2026-03-12 07:29:49,339 - lava_callback - ERROR - Error processing callback for node 69afc864275c8d3b7939b74a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41196 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:31:09,103 - lava_callback - INFO - Received callback for node 69afc8b0275c8d3b7939b753 INFO: 172.21.0.1:41210 - "POST /node/69afc8b0275c8d3b7939b753 HTTP/1.0" 202 Accepted 2026-03-12 07:31:09,109 - lava_callback - INFO - Starting async job submit for node 69afc8b0275c8d3b7939b753 2026-03-12 07:31:09,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:31:09,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc8b0275c8d3b7939b753 HTTP/1.1" 200 None 2026-03-12 07:31:09,125 - lava_callback - DEBUG - Processing node 69afc8b0275c8d3b7939b753: baseline-arm64-baylibre 2026-03-12 07:31:09,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc8b0275c8d3b7939b753 2026-03-12 07:31:09,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:31:09,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc8b0275c8d3b7939b753 HTTP/1.1" 200 None 2026-03-12 07:31:09,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:31:09,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:31:09,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:31:09,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc8b0275c8d3b7939b753 HTTP/1.1" 200 None 2026-03-12 07:31:09,184 - lava_callback - ERROR - Error processing callback for node 69afc8b0275c8d3b7939b753: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:32:29,231 - lava_callback - INFO - Received callback for node 69afc8fd275c8d3b7939b763 INFO: 172.21.0.1:44880 - "POST /node/69afc8fd275c8d3b7939b763 HTTP/1.0" 202 Accepted 2026-03-12 07:32:29,237 - lava_callback - INFO - Starting async job submit for node 69afc8fd275c8d3b7939b763 2026-03-12 07:32:29,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:32:29,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc8fd275c8d3b7939b763 HTTP/1.1" 200 None 2026-03-12 07:32:29,255 - lava_callback - DEBUG - Processing node 69afc8fd275c8d3b7939b763: baseline-arm64-baylibre 2026-03-12 07:32:29,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc8fd275c8d3b7939b763 2026-03-12 07:32:29,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:32:29,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc8fd275c8d3b7939b763 HTTP/1.1" 200 None 2026-03-12 07:32:29,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:32:29,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:32:29,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:32:29,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc8fd275c8d3b7939b763 HTTP/1.1" 200 None 2026-03-12 07:32:29,326 - lava_callback - ERROR - Error processing callback for node 69afc8fd275c8d3b7939b763: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:33:49,224 - lava_callback - INFO - Received callback for node 69afc948275c8d3b7939b76b INFO: 172.21.0.1:59732 - "POST /node/69afc948275c8d3b7939b76b HTTP/1.0" 202 Accepted 2026-03-12 07:33:49,229 - lava_callback - INFO - Starting async job submit for node 69afc948275c8d3b7939b76b 2026-03-12 07:33:49,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:33:49,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc948275c8d3b7939b76b HTTP/1.1" 200 None 2026-03-12 07:33:49,246 - lava_callback - DEBUG - Processing node 69afc948275c8d3b7939b76b: baseline-arm64-baylibre 2026-03-12 07:33:49,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc948275c8d3b7939b76b 2026-03-12 07:33:49,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:33:49,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc948275c8d3b7939b76b HTTP/1.1" 200 None 2026-03-12 07:33:49,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:33:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:33:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:33:49,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc948275c8d3b7939b76b HTTP/1.1" 200 None 2026-03-12 07:33:49,303 - lava_callback - ERROR - Error processing callback for node 69afc948275c8d3b7939b76b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:36:19,620 - lava_callback - INFO - Received callback for node 69afc9e7275c8d3b7939b782 INFO: 172.21.0.1:44268 - "POST /node/69afc9e7275c8d3b7939b782 HTTP/1.0" 202 Accepted 2026-03-12 07:36:19,625 - lava_callback - INFO - Starting async job submit for node 69afc9e7275c8d3b7939b782 2026-03-12 07:36:19,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:36:19,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc9e7275c8d3b7939b782 HTTP/1.1" 200 None 2026-03-12 07:36:19,652 - lava_callback - DEBUG - Processing node 69afc9e7275c8d3b7939b782: baseline-arm64-clabbe 2026-03-12 07:36:19,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afc9e7275c8d3b7939b782 2026-03-12 07:36:19,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:36:19,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afc9e7275c8d3b7939b782 HTTP/1.1" 200 None 2026-03-12 07:36:19,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:36:19,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:36:19,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:36:19,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afc9e7275c8d3b7939b782 HTTP/1.1" 200 None 2026-03-12 07:36:19,711 - lava_callback - ERROR - Error processing callback for node 69afc9e7275c8d3b7939b782: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:37:39,674 - lava_callback - INFO - Received callback for node 69afca37275c8d3b7939b788 INFO: 172.21.0.1:38316 - "POST /node/69afca37275c8d3b7939b788 HTTP/1.0" 202 Accepted 2026-03-12 07:37:39,680 - lava_callback - INFO - Starting async job submit for node 69afca37275c8d3b7939b788 2026-03-12 07:37:39,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:37:39,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afca37275c8d3b7939b788 HTTP/1.1" 200 None 2026-03-12 07:37:39,696 - lava_callback - DEBUG - Processing node 69afca37275c8d3b7939b788: baseline-arm64-clabbe 2026-03-12 07:37:39,696 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afca37275c8d3b7939b788 2026-03-12 07:37:39,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:37:39,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afca37275c8d3b7939b788 HTTP/1.1" 200 None 2026-03-12 07:37:39,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:37:39,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69acc01dbcd207e915d76ba7 HTTP/1.1" 200 None 2026-03-12 07:37:39,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:37:39,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afca37275c8d3b7939b788 HTTP/1.1" 200 None 2026-03-12 07:37:39,761 - lava_callback - ERROR - Error processing callback for node 69afca37275c8d3b7939b788: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET /node/6991f92801ff1e8e0859e1c8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:49:30,396 - lava_callback - INFO - Received callback for node 69afccfc275c8d3b7939b7a1 INFO: 172.21.0.1:54328 - "POST /node/69afccfc275c8d3b7939b7a1 HTTP/1.0" 202 Accepted 2026-03-12 07:49:30,402 - lava_callback - INFO - Starting async job submit for node 69afccfc275c8d3b7939b7a1 2026-03-12 07:49:30,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:49:30,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afccfc275c8d3b7939b7a1 HTTP/1.1" 200 None 2026-03-12 07:49:30,418 - lava_callback - DEBUG - Processing node 69afccfc275c8d3b7939b7a1: baseline-arm64-baylibre 2026-03-12 07:49:30,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afccfc275c8d3b7939b7a1 2026-03-12 07:49:30,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:49:30,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afccfc275c8d3b7939b7a1 HTTP/1.1" 200 None 2026-03-12 07:49:30,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:49:30,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:49:30,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:49:30,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afccfc275c8d3b7939b7a1 HTTP/1.1" 200 None 2026-03-12 07:49:30,491 - lava_callback - ERROR - Error processing callback for node 69afccfc275c8d3b7939b7a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:51:40,317 - lava_callback - INFO - Received callback for node 69afcd79275c8d3b7939b7b2 INFO: 172.21.0.1:44368 - "POST /node/69afcd79275c8d3b7939b7b2 HTTP/1.0" 202 Accepted 2026-03-12 07:51:40,322 - lava_callback - INFO - Starting async job submit for node 69afcd79275c8d3b7939b7b2 2026-03-12 07:51:40,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:51:40,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afcd79275c8d3b7939b7b2 HTTP/1.1" 200 None 2026-03-12 07:51:40,339 - lava_callback - DEBUG - Processing node 69afcd79275c8d3b7939b7b2: baseline-arm64-clabbe 2026-03-12 07:51:40,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afcd79275c8d3b7939b7b2 2026-03-12 07:51:40,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:51:40,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afcd79275c8d3b7939b7b2 HTTP/1.1" 200 None 2026-03-12 07:51:40,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:51:40,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:51:40,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:51:40,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afcd79275c8d3b7939b7b2 HTTP/1.1" 200 None 2026-03-12 07:51:40,390 - lava_callback - ERROR - Error processing callback for node 69afcd79275c8d3b7939b7b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK 2026-03-12 07:55:40,414 - lava_callback - INFO - Received callback for node 69afce6a275c8d3b7939b7bd INFO: 172.21.0.1:54444 - "POST /node/69afce6a275c8d3b7939b7bd HTTP/1.0" 202 Accepted 2026-03-12 07:55:40,420 - lava_callback - INFO - Starting async job submit for node 69afce6a275c8d3b7939b7bd 2026-03-12 07:55:40,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:55:40,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afce6a275c8d3b7939b7bd HTTP/1.1" 200 None 2026-03-12 07:55:40,459 - lava_callback - DEBUG - Processing node 69afce6a275c8d3b7939b7bd: baseline-arm64-clabbe 2026-03-12 07:55:40,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69afce6a275c8d3b7939b7bd 2026-03-12 07:55:40,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:55:40,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afce6a275c8d3b7939b7bd HTTP/1.1" 200 None 2026-03-12 07:55:40,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:55:40,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-12 07:55:40,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-12 07:55:40,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69afce6a275c8d3b7939b7bd HTTP/1.1" 200 None 2026-03-12 07:55:40,530 - lava_callback - ERROR - Error processing callback for node 69afce6a275c8d3b7939b7bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]